Matthew Hendrey 9ddc35220b

[Frontend] generation_config.json for maximum tokens(#12242) ...

Signed-off-by: Matthew Hendrey <matthew.hendrey@gmail.com>
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: shangmingc <caishangming@linux.alibaba.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Yuan Tang <terrytangyuan@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>

2025-01-26 19:59:25 +08:00

..

tool_parsers

[Frontend] Pythonic tool parser (#9859)

2024-11-14 04:14:34 +00:00

__init__.py

[CI/Build] [3/3] Reorganize entrypoints tests (#5966)

2024-06-30 12:58:49 +08:00

test_accuracy.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_tokenization.py

[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635)

2024-11-27 13:21:10 -08:00

test_audio.py

[CI] Fix flaky entrypoint tests (#11403)

2024-12-21 21:08:44 -08:00

test_basic.py

[Bugfix] Fix request cancellation without polling (#11190)

2024-12-17 12:26:32 -08:00

test_chat_echo.py

[Bug]: When apply continue_final_message for OpenAI server, the "echo":false is ignored (#10180)

2024-11-21 16:24:32 +00:00

test_chat_template.py

[Frontend] Added support for HF's new continue_final_message parameter (#8942)

2024-09-29 17:59:47 +00:00

test_chat.py

[CI] Expand OpenAI test_chat.py guided decoding tests (#11048)

2024-12-23 18:35:38 +00:00

test_chunked_prompt.py

[Bugfix] Fix vLLM UsageInfo and logprobs None AssertionError with empty token_ids (#9034)

2024-10-15 15:40:43 -07:00

test_cli_args.py

[Bugfix][Refactor] Unify model management in frontend (#11660)

2025-01-01 02:21:51 +00:00

test_completion.py

[Bugfix] Fix OpenAI parallel sampling when using xgrammar (#11637)

2024-12-31 03:43:54 +00:00

test_embedding.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

test_encoder_decoder.py

[Tests] Disable retries and use context manager for openai client (#7565)

2024-08-26 21:33:17 -07:00

test_lora_adapters.py

[Misc][LoRA] Improve the readability of LoRA error messages (#12102)

2025-01-17 19:32:28 +08:00

test_metrics.py

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

test_models.py

[Core] Support Lora lineage and base model metadata management (#6315)

2024-09-20 06:20:56 +00:00

test_oot_registration.py

[misc][plugin] add plugin system implementation (#7426)

2024-08-13 16:24:17 -07:00

test_pooling.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

test_prompt_validation.py

[Bugfix][Frontend] Reject guided decoding in multistep mode (#9892)

2024-11-01 01:09:46 +00:00

test_return_tokens_as_ids.py

[Tests] Disable retries and use context manager for openai client (#7565)

2024-08-26 21:33:17 -07:00

test_root_path.py

[Bug]: Authorization ignored when root_path is set (#10606)

2024-11-25 16:21:41 +00:00

test_run_batch.py

[Frontend] Create ErrorResponse instead of raising exceptions in run_batch (#8347)

2024-09-11 05:30:11 +00:00

test_score.py

[Bugfix] Fix score api for missing max_model_len validation (#12119)

2025-01-17 16:24:22 +00:00

test_serving_chat.py

[Frontend] generation_config.json for maximum tokens(#12242)

2025-01-26 19:59:25 +08:00

test_serving_models.py

[Bugfix] Validate lora adapters to avoid crashing server (#11727)

2025-01-10 15:56:36 +08:00

test_shutdown.py

[Bugfix] Validate lora adapters to avoid crashing server (#11727)

2025-01-10 15:56:36 +08:00

test_tokenization.py

[Frontend] Chat-based Embeddings API (#9759)

2024-11-01 08:13:35 +00:00

test_video.py

[CI] Fix flaky entrypoint tests (#11403)

2024-12-21 21:08:44 -08:00

test_vision_embedding.py

[VLM] Support caching in merged multi-modal processor (#11396)

2024-12-27 17:22:48 +00:00

test_vision.py

[CI] Fix flaky entrypoint tests (#11403)

2024-12-21 21:08:44 -08:00