Sean Gallen 78107fa091

[Doc]Add asynchronous engine arguments to documentation. (#3810) ...

Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

2024-04-04 21:52:01 -07:00

..

assets

fix document error for value and v_vec illustration (#3421)

2024-03-15 16:06:09 -07:00

dev

[Doc] Add docs about OpenAI compatible server (#3288)

2024-03-18 22:05:34 -07:00

getting_started

[Hardware][Intel] Add CPU inference backend (#3634)

2024-04-01 22:07:30 -07:00

models

[Doc]Add asynchronous engine arguments to documentation. (#3810)

2024-04-04 21:52:01 -07:00

quantization

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

serving

Usage Stats Collection (#2852)

2024-03-28 22:16:12 -07:00

conf.py

[Doc] Fix vLLMEngine Doc Page (#3791)

2024-04-02 09:49:37 -07:00

index.rst

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00