"EngineClient" has no attribute "model_config"
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
benchmark_serving.py
vllm bench
vllm bench [latency, throughput]