60 Commits

Author	SHA1	Message	Date
AguirreNicolas	24f60a54f4	[Docker] Adding number of nvcc_threads during build as envar (#1893)	2023-12-07 11:00:32 -08:00
Simon Mo	5313c2cb8b	Add Production Metrics in Prometheus format (#1890)	2023-12-02 16:37:44 -08:00
Massimiliano Pronesti	05a38612b0	docs: add instruction for langchain (#1162)	2023-11-30 10:57:44 -08:00
Simon Mo	0f621c2c7d	[Docs] Add information about using shared memory in docker (#1845)	2023-11-29 18:33:56 -08:00
Wen Sun	112627e8b2	[Docs] Fix the code block's format in deploying_with_docker page (#1722)	2023-11-20 01:22:39 -08:00
Simon Mo	37c1e3c218	Documentation about official docker image (#1709)	2023-11-19 20:56:26 -08:00
Stephen Krider	9cabcb7645	Add Dockerfile (#1350)	2023-10-31 12:36:47 -07:00
Tanmay Verma	6f2dd6c37e	Add documentation to Triton server tutorial (#983)	2023-09-20 10:32:40 -07:00
Zhanghao Wu	58df2883cb	[Doc] Add doc for running vLLM on the cloud (#426) ... Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>	2023-07-16 13:37:14 -07:00
Zhuohan Li	2cf1a333b6	[Doc] Documentation for distributed inference (#261)	2023-06-26 11:34:23 -07:00