main
md 8 lines 707 Bytes
Rendered Raw
1 # Benchmark Suites
2
3 vLLM provides comprehensive benchmarking tools for performance testing and evaluation.
4
5 - **[Benchmark CLI](./cli.md)**: `vllm bench` CLI tools and specialized benchmark scripts for interactive performance testing.
6 - **[Parameter Sweeps](./sweeps.md)**: Automate `vllm bench` runs for multiple configurations, useful for [optimization and tuning](../configuration/optimization.md).
7 - **[Performance Dashboard](./dashboard.md)**: Automated CI that publishes benchmarks on each commit.
8 - **[Benchmark using vLLM Recipes](../../tools/recipes/README.md)**: Use the Recipe conversion tool to generate `config.yaml` and `env.sh` from [vLLM Recipes](https://recipes.vllm.ai/) for Benchmarking.