mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 06:35:00 +08:00

History

[Model] enable data parallel for InternVL vision encoder (#23909 )

Signed-off-by: Yiwen Chen <yiwen66@berkeley.edu>
Signed-off-by: YiwenC <54658925+666even666@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

2025-09-17 21:11:46 -07:00

conserving_memory.md

[Core] Use key-only cache for BaseMultiModalProcessor (#23018 )

2025-08-27 14:19:13 +08:00

engine_args.md

[Docs] Add comprehensive CLI reference for all large vllm subcommands (#22601 )

2025-08-11 00:13:33 -07:00

env_vars.md

Make distinct code and console admonitions so readers are less likely to miss them (#20585 )

2025-07-07 19:55:28 -07:00

model_resolution.md

[Misc] unify variable for LLM instance (#20996 )

2025-07-21 12:18:33 +01:00

optimization.md

[Model] enable data parallel for InternVL vision encoder (#23909 )

2025-09-17 21:11:46 -07:00

README.md

[Doc] Move examples and further reorganize user guide (#18666 )

2025-05-26 07:38:04 -07:00

serve_args.md

Add full serve CLI reference back to docs (#20978 )

2025-07-15 17:42:30 +00:00

tpu.md

[Docs] Fix a 1-2-3 list and style issues in tpu.md (#23729 )

2025-08-27 05:37:52 -07:00

README.md

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

[Request parameters][completions-api] and [input arguments][sampling-params]
Engine arguments
Environment variables