mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-09 04:54:56 +08:00
9bcf92295a
Signed-off-by: LuminolT <lumischen01@gmail.com> Signed-off-by: Lumis Chen <lumischen01@gmail.com> Co-authored-by: Russell Bryant <rbryant@redhat.com>
Benchmark Suites
vLLM provides comprehensive benchmarking tools for performance testing and evaluation:
- Benchmark CLI:
vllm benchCLI tools and specialized benchmark scripts for interactive performance testing. - Parameter Sweeps: Automate
vllm benchruns for multiple configurations, useful for optimization and tuning. - Performance Dashboard: Automated CI that publishes benchmarks on each commit.