13 Commits

Author	SHA1	Message	Date
Chen Wang	cbf4c05b15	Update requirements-dev.txt to include package for benchmarking scripts. (#3181) ... Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>	2024-03-07 08:39:28 +00:00
Robert Shaw	c0c2335ce0	Integrate Marlin Kernels for Int4 GPTQ inference (#2497) ... Co-authored-by: Robert Shaw <114415538+rib-2@users.noreply.github.com> Co-authored-by: alexm <alexm@neuralmagic.com>	2024-03-01 12:47:51 -08:00
Woosuk Kwon	6f32cddf1c	Remove Flash Attention in test env (#2982)	2024-02-22 09:58:29 -08:00
Massimiliano Pronesti	93dc5a2870	chore(vllm): codespell for spell checking (#2820)	2024-02-21 18:56:01 -08:00
FlorianJoncour	14cc317ba4	OpenAI Server refactoring (#2360)	2024-01-16 21:33:14 -08:00
Simon Mo	6e01e8c1c8	[CI] Add Buildkite (#2355)	2024-01-14 12:37:58 -08:00
mezuzza	6774bd50b0	Fix typing in AsyncLLMEngine & add toml to requirements-dev (#2100)	2023-12-14 00:19:41 -08:00
Simon Mo	5ffc0d13a2	Migrate linter from pylint to ruff (#1665)	2023-11-20 11:58:01 -08:00
Stephen Krider	9cabcb7645	Add Dockerfile (#1350)	2023-10-31 12:36:47 -07:00
Antoni Baum	ff36139ffc	Remove AsyncLLMEngine busy loop, shield background task (#1059)	2023-09-17 00:29:08 -07:00
Woosuk Kwon	32b6816e55	Add tests for models (#922)	2023-09-01 11:19:43 +09:00
Zhuohan Li	d6fa1be3a8	[Quality] Add code formatter and linter (#326)	2023-07-03 11:31:55 -07:00
Woosuk Kwon	a283ec2eec	Add contributing guideline and mypy config (#122)	2023-05-23 17:58:51 -07:00