Jiayi Yao 2f42a4888c

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

..

basic

Merge similar examples in offline_inference into single basic example (#12737)

2025-02-20 04:53:51 -08:00

openai

…

profiling_tpu

[Bugfix][Example] Fix GCed profiling server for TPU (#12792)

2025-02-13 11:52:11 +08:00

audio_language.py

…

chat_with_tools.py

…

cpu_offload_lmcache.py

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

data_parallel.py

[ci] fix linter (#13701)

2025-02-22 20:28:59 +08:00

disaggregated_prefill_lmcache.py

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

disaggregated_prefill.py

[Bugfix] Offline example of disaggregated prefill (#13214)

2025-02-13 20:20:47 -08:00

distributed.py

…

encoder_decoder.py

…

florence2_inference.py

…

llm_engine_example.py

…

lora_with_quantization_inference.py

…

mlpspeculator.py

…

multilora_inference.py

…

neuron_int8_quantization.py

…

neuron.py

…

pixtral.py

…

prefix_caching.py

…

prithvi_geospatial_mae.py

[Model] IBM/NASA Prithvi Geospatial model (#12830)

2025-02-11 20:34:30 -08:00

profiling.py

…

rlhf_colocate.py

…

rlhf.py

…

save_sharded_state.py

…

simple_profiling.py

…

structured_outputs.py

…

torchrun_example.py

…

tpu.py

…

vision_language_embedding.py

…

vision_language_multi_image.py

[VLM][Bugfix] Pass processor kwargs properly on init (#13516)

2025-02-19 13:13:50 +00:00

vision_language.py

[V1] Update doc and examples for H2O-VL (#13349)

2025-02-16 10:35:54 +00:00

whisper.py

…