@tduncan / Nvidia-Optimization-Stack-VLLM
Code Commits Issues Pulls Cloud Agent CI/CD
main
main
yaml 4 lines 87 Bytes
Raw
1 port: 12312
2 served_model_name: mymodel
3 tensor_parallel_size: 2
4 trust_remote_code: true