chaow-amd 9e90c9f73f

[Bugfix] Fix bugs of running Quark quantized models (#16236) ...

Signed-off-by: chaow <chaow@amd.com>

2025-04-11 10:18:32 -04:00

..

fused_moe

[Kernel] Use moe_wna16 kernel for compressed tensors wna16 moe models (#16038)

2025-04-10 15:08:47 +08:00

mamba

[Model] Reduce redundant computations in mamba2 blocks for Bamba-9B (#15423)

2025-04-10 19:07:07 +00:00

quantization

[Bugfix] Fix bugs of running Quark quantized models (#16236)

2025-04-11 10:18:32 -04:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Neuron] Add custom_ops for neuron backend (#13246)

2025-02-25 11:47:49 -08:00

layernorm.py

Upstream Llama4 Support to Main (#16113)

2025-04-07 08:06:27 -07:00

lightning_attn.py

[Model][MiniMaxText01] Support MiniMaxText01 model inference (#13454)

2025-04-01 16:23:55 -04:00

linear.py

[Bugfix] Handle process_weights_after_loading for QKVCrossParallelLinear (#15328)

2025-04-08 10:02:23 -07:00

logits_processor.py

[Misc][Platform] Move use allgather to platform (#14010)

2025-03-03 15:40:04 +08:00

pooler.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

rejection_sampler.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

resampler.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

rotary_embedding.py

Upstream Llama4 Support to Main (#16113)

2025-04-07 08:06:27 -07:00

sampler.py

[Build] Cython compilation support fix (#14296)

2025-03-24 23:37:54 +00:00

spec_decode_base_sampler.py

[model][refactor] remove cuda hard code in models and layers (#13658)

2025-02-24 06:10:14 -08:00

typical_acceptance_sampler.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

utils.py

[V1] Optimize handling of sampling metadata and req_ids list (#13244)

2025-02-18 12:15:33 -08:00

vocab_parallel_embedding.py

[Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824)

2025-03-31 22:57:59 -07:00