Michael Goin c77eb8a33c

[Bugfix] Set temperature=0.7 in test_guided_choice_chat (#11264)

2024-12-17 16:34:06 -08:00

..

tool_parsers

[Frontend] Pythonic tool parser (#9859)

2024-11-14 04:14:34 +00:00

__init__.py

…

test_accuracy.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_tokenization.py

[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635)

2024-11-27 13:21:10 -08:00

test_audio.py

[Frontend] Add OpenAI API support for input_audio (#11027)

2024-12-16 22:09:58 -08:00

test_basic.py

[Bugfix] Fix request cancellation without polling (#11190)

2024-12-17 12:26:32 -08:00

test_chat_echo.py

[Bug]: When apply continue_final_message for OpenAI server, the "echo":false is ignored (#10180)

2024-11-21 16:24:32 +00:00

test_chat_template.py

…

test_chat.py

[Bugfix] Set temperature=0.7 in test_guided_choice_chat (#11264)

2024-12-17 16:34:06 -08:00

test_chunked_prompt.py

…

test_cli_args.py

…

test_completion.py

[Bugfix][Frontend] Guard against bad token ids (#9634)

2024-10-29 14:13:20 -07:00

test_embedding.py

[Frontend] Chat-based Embeddings API (#9759)

2024-11-01 08:13:35 +00:00

test_encoder_decoder.py

…

test_lora_lineage.py

…

test_metrics.py

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

test_models.py

…

test_oot_registration.py

…

test_prompt_validation.py

[Bugfix][Frontend] Reject guided decoding in multistep mode (#9892)

2024-11-01 01:09:46 +00:00

test_return_tokens_as_ids.py

…

test_root_path.py

[Bug]: Authorization ignored when root_path is set (#10606)

2024-11-25 16:21:41 +00:00

test_run_batch.py

…

test_score.py

[Doc] Reorganize online pooling APIs (#11172)

2024-12-14 00:22:22 +08:00

test_serving_chat.py

[Frontend] Add logits_processors as an extra completion argument (#11150)

2024-12-14 16:46:42 +00:00

test_serving_engine.py

[Misc][LoRA] Ensure Lora Adapter requests return adapter name (#11094)

2024-12-12 09:25:16 +00:00

test_shutdown.py

…

test_tokenization.py

[Frontend] Chat-based Embeddings API (#9759)

2024-11-01 08:13:35 +00:00

test_video.py

Online video support for VLMs (#10020)

2024-11-07 20:25:59 +00:00

test_vision_embedding.py

[Misc] Split up pooling tasks (#10820)

2024-12-11 01:28:00 -08:00

test_vision.py

[Model] merged input processor for Phi-3-Vision models (#10977)

2024-12-09 12:55:10 -08:00