Ekagra Ranjan e71b8e210d

[Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. (#24986) ...

Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

2025-09-25 15:22:03 -07:00

..

logits_processor

[CORE] Prompt Embeddings Support for v1 Engine (#24278)

2025-09-19 08:03:09 +08:00

ops

[ux] Switch a warning to debug about a pytorch fallback (#23750)

2025-09-25 14:38:16 +00:00

tpu

[TPU] Remove TopKTopPSampler dependency for TPU sampler (#24391)

2025-09-07 01:12:36 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

metadata.py

[V1] Logits processors extensibility (#19912)

2025-08-16 12:59:17 -07:00

rejection_sampler.py

[Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. (#24986)

2025-09-25 15:22:03 -07:00

sampler.py

[Bugfix] fix apply_temperature to avoid nan in probs (#24734)

2025-09-25 05:32:21 +00:00