ErezSC42 55509c2114

[MODEL] LoRA support for Jamba model (#11209) ...

Signed-off-by: Erez Schwartz <erezs@ai21.com>

2024-12-27 17:58:21 +00:00

..

fused_moe

[BugFix] Fix quantization for all other methods (#11547)

2024-12-26 22:23:29 -08:00

mamba

[MODEL] LoRA support for Jamba model (#11209)

2024-12-27 17:58:21 +00:00

quantization

[BugFix] Fix quantization for all other methods (#11547)

2024-12-26 22:23:29 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

layernorm.py

[Model] Add has_weight to RMSNorm and re-enable weights loading tracker for Mamba (#10739)

2024-12-10 10:23:07 +08:00

linear.py

[Model] [Quantization] Support deepseek_v3 w8a8 fp8 block-wise quantization (#11523)

2024-12-26 15:33:30 -08:00

logits_processor.py

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856)

2024-12-10 06:28:14 +00:00

pooler.py

[Frontend] Separate pooling APIs in offline inference (#11129)

2024-12-13 10:40:07 +00:00

rejection_sampler.py

[Bugfix] Fix spec decoding when seed is none in a batch (#10863)

2024-12-20 05:15:31 +00:00

resampler.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

rotary_embedding.py

[Bugfix] Fix mrope_position_delta in non-last prefill chunk (#10403)

2024-11-17 08:50:24 +00:00

sampler.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

spec_decode_base_sampler.py

Remove hard-dependencies of Speculative decode to CUDA workers (#10587)

2024-11-26 17:57:11 -08:00

typical_acceptance_sampler.py

Fix typical acceptance sampler with correct recovered token ids (#8562)

2024-09-23 12:32:27 -07:00

utils.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

vocab_parallel_embedding.py

[5/N][torch.compile] torch.jit.script --> torch.compile (#10406)

2024-11-18 23:20:06 +08:00