xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-05 01:10:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/vllm
History
Harry Mellor fcf2e3d7fc
[Bugfix] Fix OpenVINO model runner (#12750)
2025-02-04 22:42:46 -08:00
..
adapter_commons
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
assets
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
attention
[Bugfix] Fix OpenVINO model runner (#12750)
2025-02-04 22:42:46 -08:00
compilation
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
core
[Core] Improve hash collision avoidance in prefix caching (#12621)
2025-02-03 16:28:20 -08:00
device_allocator
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
distributed
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
engine
[Model]: Add transformers backend support (#11330)
2025-02-03 21:30:38 +08:00
entrypoints
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
executor
[doc][misc] clarify VLLM_HOST_IP for multi-node inference (#12667)
2025-02-03 09:32:18 +08:00
inputs
[VLM] merged multimodal processor and V1 support for idefics3 (#12660)
2025-02-04 20:00:51 +08:00
logging_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
lora
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
model_executor
[Bugfix] Fix OpenVINO model runner (#12750)
2025-02-04 22:42:46 -08:00
multimodal
Avoid unnecessary multi-modal input data copy when len(batch) == 1 (#12722)
2025-02-04 21:03:19 +08:00
platforms
[AMD][ROCm] Enable DeepSeek model on ROCm (#12662)
2025-02-04 08:24:11 +00:00
plugins
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
profiler
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompt_adapter
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
spec_decode
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
transformers_utils
make sure mistral_common not imported for non-mistral models (#12669)
2025-02-03 13:40:25 +08:00
triton_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
usage
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
v1
[V1][Metrics] Add request_success_total counter, labelled with finish reason (#12579)
2025-02-04 19:46:54 -05:00
vllm_flash_attn
[ci][build] fix vllm-flash-attn (#8699)
2024-09-21 23:24:58 -07:00
worker
[Bugfix] Fix OpenVINO model runner (#12750)
2025-02-04 22:42:46 -08:00
__init__.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
_custom_ops.py
[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)
2025-02-04 18:22:24 -08:00
_ipex_ops.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
beam_search.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
config.py
[Quant] Fix use_mla TypeError and support loading pure-sparsity Compressed Tensors configs (#12711)
2025-02-03 23:27:11 -08:00
connections.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
envs.py
[Core] add and implement VLLM_LOGITS_PROCESSOR_THREADS (#12368)
2025-02-04 18:46:26 -08:00
forward_context.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
logger.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
logits_process.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
outputs.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
pooling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
scalar_type.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
scripts.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
sequence.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tracing.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
utils.py
[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)
2025-02-04 18:22:24 -08:00
version.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00