Gregory Shtrasberg e97f802b2d

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) ...

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

2025-01-23 18:04:03 +00:00

..

__init__.py

[3/N] model runner pass the whole config to model (#9958)

2024-11-02 12:08:49 -07:00

loader.py

[Misc] Improve the readability of BNB error messages (#12320)

2025-01-22 16:56:54 +00:00

neuron.py

[Misc]: Typo fix: Renaming classes (casualLM -> causalLM) (#9801)

2024-10-29 10:39:20 -07:00

openvino.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

tensorizer.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

utils.py

[Misc] Merge bitsandbytes_stacked_params_mapping and packed_modules_mapping (#11924)

2025-01-15 07:49:49 +08:00

weight_utils.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00