dongluw a5b84f1cbf

[Core] Shared memory based object store for Multimodal data caching and IPC (#20452) ...

Signed-off-by: donglu <donglu@cohere.com>

2025-09-12 07:54:17 -07:00

..

__init__.py

[Core] Shared memory based object store for Multimodal data caching and IPC (#20452)

2025-09-12 07:54:17 -07:00

cache.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

compilation.py

Add the support for the qwen3 next model (a hybrid attention model). (#24526)

2025-09-11 15:32:09 +08:00

kv_events.py

Move KVEventsConfig from config/__init__.py to config/kv_events.py (#24433)

2025-09-08 06:41:27 -07:00

kv_transfer.py

Move KVTransferConfig from config/__init__.py to config/kv_transfer.py (#24434)

2025-09-08 20:30:32 -07:00

load.py

Fix typing for safetensors_load_strategy (#24641)

2025-09-11 10:41:39 +00:00

lora.py

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

parallel.py

[Bugfix] Improve EPLB config validation error message (#24524)

2025-09-10 00:32:36 +00:00

scheduler.py

[V0 Deprecation] Remove args for multi-step scheduling (#22779)

2025-08-12 20:38:18 -07:00

utils.py

Extract CompilationConfig from config.py (#22524)

2025-08-08 16:34:25 -07:00