ahao-anyscale c8bde93367

[BUG] Allows for RunAI Streamer and Torch.compile cache to be used together (#24922) ...

Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2025-09-23 18:13:32 -06:00

..

__init__.py

[Perf] Change default CUDAGraphMode from PIECEWISE to FULL_AND_PIECEWISE (#25444)

2025-09-23 15:29:26 -04:00

cache.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

compilation.py

[Perf] Change default CUDAGraphMode from PIECEWISE to FULL_AND_PIECEWISE (#25444)

2025-09-23 15:29:26 -04:00

kv_events.py

Move KVEventsConfig from config/__init__.py to config/kv_events.py (#24433)

2025-09-08 06:41:27 -07:00

kv_transfer.py

Move KVTransferConfig from config/__init__.py to config/kv_transfer.py (#24434)

2025-09-08 20:30:32 -07:00

load.py

Fix typing for safetensors_load_strategy (#24641)

2025-09-11 10:41:39 +00:00

lora.py

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

model.py

[BUG] Allows for RunAI Streamer and Torch.compile cache to be used together (#24922)

2025-09-23 18:13:32 -06:00

multimodal.py

Move MultiModalConfig from config/__init__.py to config/multimodal.py (#24659)

2025-09-15 17:43:16 +00:00

parallel.py

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845)

2025-09-23 16:02:10 +00:00

pooler.py

Move PoolerConfig from config/__init__.py to config/pooler.py (#25181)

2025-09-19 11:02:55 +00:00

scheduler.py

[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334)

2025-09-21 08:52:32 -07:00

speculative.py

Enable Eagle3 speculative decoding for GPT-OSS model (#25246)

2025-09-22 08:50:39 +00:00

structured_outputs.py

Move StructuredOutputsConfig from config/__init__.py to config/structured_outputs.py (#25153)

2025-09-18 11:24:27 +00:00

utils.py

Move ModelConfig from config/__init__.py to config/model.py (#25252)

2025-09-19 16:22:33 +00:00