harrywu f458112e8a

[Misc][Typo] type annotation fix (#4495)

2024-04-30 20:21:39 -07:00

..

output_processor

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Kernel] Full Tensor Parallelism for LoRA Layers (#3524)

2024-04-27 00:03:48 -07:00

async_llm_engine.py

[BugFix] fix num_lookahead_slots missing in async executor (#4165)

2024-04-30 10:12:59 -07:00

llm_engine.py

[Misc][Typo] type annotation fix (#4495)

2024-04-30 20:21:39 -07:00

metrics.py

Add more Prometheus metrics (#2764)

2024-04-28 15:59:33 -07:00