Alexander Matveev 0310029a2f

[Bugfix] Fix awq_marlin and gptq_marlin flags (#6745)

2024-07-24 22:34:11 -07:00

..

fused_moe

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

ops

[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)

2024-04-22 21:32:44 -07:00

quantization

[Bugfix] Fix awq_marlin and gptq_marlin flags (#6745)

2024-07-24 22:34:11 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Kernel][CPU] Add Quick gelu to CPU (#5717)

2024-06-21 06:39:40 +00:00

layernorm.py

[Model] Add Gemma 2 (#5908)

2024-06-27 13:33:56 -07:00

linear.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00

logits_processor.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

pooler.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

rejection_sampler.py

[Bugfix] Make spec. decode respect per-request seed. (#6034)

2024-07-18 19:22:08 -07:00

rotary_embedding.py

[BugFix] Fix RoPE error in Llama 3.1 (#6693)

2024-07-23 09:46:05 -07:00

sampler.py

[Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338)

2024-07-17 14:30:28 -07:00

spec_decode_base_sampler.py

[Bugfix] Make spec. decode respect per-request seed. (#6034)

2024-07-18 19:22:08 -07:00

typical_acceptance_sampler.py

[Bugfix] Make spec. decode respect per-request seed. (#6034)

2024-07-18 19:22:08 -07:00

vocab_parallel_embedding.py

[ Misc ] fbgemm checkpoints (#6559)

2024-07-20 09:36:57 -07:00