Customizing GPU provisioning nodes
By default, GPU nodes use the instance type g5.2xlarge. If you need to change the instance type—such as to address performance requirements, carry out these steps:
In your local branch of the
rag-llm-gitopsgit repository change to theansible/playbooks/templatesdirectory.Edit the file
gpu-machine-sets.j2changing theinstanceTypeto for exampleg5.4xlarge. Save and exit.Push the changes to the origin remote repository by running the following command:
$ git push origin my-test-branch
