vllm/tests/evals/gsm8k/configs/DeepSeek-V2-Lite-Instruct-FP8.yaml
Wentao Ye 3c96e7b8a1
[CI] Small Accuracy Eval Test for Deepseek Model (#24259)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2025-09-15 20:14:50 -06:00

7 lines
140 B
YAML

model_name: "RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8"
accuracy_threshold: 0.72
num_questions: 1319
num_fewshot: 5
max_model_len: 4096