xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-21 20:17:03 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/vllm
History
Harry Mellor 1a6fcad4c9
Improve TransformersModel UX (#12785)
2025-02-05 22:24:57 -08:00
..
adapter_commons
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
assets
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
attention
[Hardware][Intel-Gaudi] Enable FusedSDPA support for Intel Gaudi (HPU)
2025-02-05 13:29:45 -08:00
compilation
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
core
[Core] Improve hash collision avoidance in prefix caching (#12621)
2025-02-03 16:28:20 -08:00
device_allocator
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
distributed
[Bugfix] Fix 'ModuleNotFoundError: No module named 'intel_extension_for_pytorch'' for --tensor-parallel-size more than 1 (#12546)
2025-02-04 23:11:02 -08:00
engine
[Model]: Add transformers backend support (#11330)
2025-02-03 21:30:38 +08:00
entrypoints
[VLM] Qwen2.5-VL
2025-02-05 13:31:38 -08:00
executor
[core][distributed] exact ray placement control (#12732)
2025-02-06 02:03:19 +08:00
inputs
[VLM] merged multimodal processor and V1 support for idefics3 (#12660)
2025-02-04 20:00:51 +08:00
logging_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
lora
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
model_executor
Improve TransformersModel UX (#12785)
2025-02-05 22:24:57 -08:00
multimodal
[VLM] Update compatibility with transformers 4.49
2025-02-05 19:09:45 -08:00
platforms
[core][distributed] exact ray placement control (#12732)
2025-02-06 02:03:19 +08:00
plugins
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
profiler
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompt_adapter
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
spec_decode
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
transformers_utils
make sure mistral_common not imported for non-mistral models (#12669)
2025-02-03 13:40:25 +08:00
triton_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
usage
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
v1
[VLM] Qwen2.5-VL
2025-02-05 13:31:38 -08:00
vllm_flash_attn
[ci][build] fix vllm-flash-attn (#8699)
2024-09-21 23:24:58 -07:00
worker
[VLM] Qwen2.5-VL
2025-02-05 13:31:38 -08:00
__init__.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
_custom_ops.py
[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)
2025-02-04 18:22:24 -08:00
_ipex_ops.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
beam_search.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
config.py
[Quant] Fix use_mla TypeError and support loading pure-sparsity Compressed Tensors configs (#12711)
2025-02-03 23:27:11 -08:00
connections.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
envs.py
[core][distributed] exact ray placement control (#12732)
2025-02-06 02:03:19 +08:00
forward_context.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
logger.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
logits_process.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
outputs.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
pooling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
scalar_type.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
scripts.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
sequence.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tracing.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
utils.py
[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)
2025-02-04 18:22:24 -08:00
version.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00