Po-Han Huang (NVIDIA) 4f0f844b16

Fix cuda illegal mem access with Llama4 TP8 + rms_norm custom op (#22701) ...

Signed-off-by: Po-Han Huang <pohanh@nvidia.com>

2025-08-12 21:21:50 -07:00

..

layers

Fix torch version check for SM100 mxfp4 (#22535)

2025-08-12 12:54:42 -07:00

model_loader

Enable 4bit bnb prequant MOE (#21548)

2025-08-11 19:02:14 -07:00

models

Fix cuda illegal mem access with Llama4 TP8 + rms_norm custom op (#22701)

2025-08-12 21:21:50 -07:00

warmup

[Docs] Fix warnings in docs build (#22588)

2025-08-10 05:49:51 -07:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

custom_op.py

Optimize configuration access with LRU cache in custom ops (#22204)

2025-08-04 21:43:24 -07:00

parameter.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

pooling_metadata.py

[Model][1/N] Support multiple poolers at model level (#21227)

2025-07-21 02:22:21 -07:00

sampling_metadata.py

Revert "Update sampling_metadata.py (#21937)" (#22088)

2025-08-01 05:24:46 -07:00

utils.py

[Quantization] Enable BNB support for InternS1 (#21953)

2025-08-01 11:09:54 +00:00