@tduncan / Nvidia-Optimization-Stack-VLLM
Code Commits Issues Pulls Cloud Agent CI/CD
main
main
yaml 6 lines 159 Bytes
Raw
1 # Same as test_config.yaml but with model specified
2 model: config-model
3 port: 12312
4 served_model_name: mymodel
5 tensor_parallel_size: 2
6 trust_remote_code: true