Yihua Cheng 5e83a7277f

[v1] [P/D] Adding LMCache KV connector for v1 (#16625)

2025-04-26 03:03:38 +00:00

..

basic

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

disaggregated-prefill-v1

[P/D][V1] KV Connector API V1 (#15960)

2025-04-17 13:22:40 -07:00

openai

…

profiling_tpu

…

qwen2_5_omni

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130)

2025-04-18 23:14:36 -07:00

audio_language.py

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477)

2025-04-19 02:26:11 -07:00

batch_llm_inference.py

[Ray] Improve documentation on batch inference (#16609)

2025-04-16 22:19:26 -07:00

chat_with_tools.py

…

data_parallel.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

disaggregated_prefill.py

[Misc] refactor examples (#16563)

2025-04-14 09:59:15 +00:00

eagle.py

[V1][Spec Decode] EAGLE-3 Support (#16937)

2025-04-25 15:43:07 -07:00

embed_jina_embeddings_v3.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

embed_matryoshka_fy.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

encoder_decoder_multimodal.py

[Bugfix] Update Florence-2 tokenizer to make grounding tasks work (#16734)

2025-04-17 04:17:39 +00:00

encoder_decoder.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

llm_engine_example.py

[Misc] refactor examples series (#16708)

2025-04-16 10:16:36 +00:00

load_sharded_state.py

[Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367)

2025-04-03 07:32:10 +00:00

lora_with_quantization_inference.py

…

mistral-small.py

[VLM] Clean up models (#16873)

2025-04-19 12:13:06 +00:00

mlpspeculator.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

multilora_inference.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

neuron_int8_quantization.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

neuron.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

prefix_caching.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

prithvi_geospatial_mae.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

profiling.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

reproduciblity.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

rlhf_colocate.py

…

rlhf_utils.py

…

rlhf.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

save_sharded_state.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

simple_profiling.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

structured_outputs.py

[Misc] refactor Structured Outputs example (#16322)

2025-04-09 23:32:42 +00:00

torchrun_example.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

tpu.py

[Misc] format and refactor some examples (#16252)

2025-04-08 10:42:32 +00:00

vision_language_embedding.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

vision_language_multi_image.py

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477)

2025-04-19 02:26:11 -07:00

vision_language.py

[VLM] Clean up models (#16873)

2025-04-19 12:13:06 +00:00