xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-01-02 04:07:27 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/vllm
History
Avshalom Manevich a0f8a79646
[fix] fix qwen image_embeds input (#21049) 
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
2025-07-16 15:17:20 +00:00
..
adapter_commons
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
assets
Add GLM4.1V model (Draft) (#19331)
2025-07-01 12:48:26 +00:00
attention
[CI] update typos config for CI pre-commit and fix some spells (#20919)
2025-07-15 21:12:40 -07:00
benchmarks
Add benchmark dataset for mlperf llama tasks (#20338)
2025-07-14 19:10:07 +00:00
compilation
[Misc] Refactor AllReduceFusionPass. Remove parameter (#20918)
2025-07-15 06:57:40 +00:00
core
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686)
2025-06-17 04:40:58 +00:00
device_allocator
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
distributed
Add pynccl all-gatherv and reducescatterv (#20154)
2025-07-11 18:59:23 -07:00
engine
[Deprecation] Remove nullable_kvs (#20969)
2025-07-15 17:21:50 +00:00
entrypoints
feat - add a new endpoint get_tokenizer_info to provide tokenizer/chat-template information (#20575)
2025-07-16 21:52:14 +08:00
executor
[Intel GPU] support ray as distributed executor backend for XPU. (#20659)
2025-07-09 00:36:58 -07:00
inputs
[CI/Build] Ensure compatability with Transformers v4.53 (#20541)
2025-07-11 20:53:07 -07:00
logging_utils
[BugFix] Don't catch BaseException when dumping execute_model errors (#19626)
2025-06-16 11:01:08 +00:00
lora
[Refactor] Change the way of import triton (#20774)
2025-07-12 19:39:55 -07:00
model_executor
[fix] fix qwen image_embeds input (#21049)
2025-07-16 15:17:20 +00:00
multimodal
[Core] Rename get_max_tokens_per_item for backward compatibility (#20630)
2025-07-08 23:11:30 +00:00
platforms
SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769)
2025-07-15 01:06:38 +00:00
plugins
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
profiler
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_adapter
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
ray
[MISC] Add init files for python package (#20908)
2025-07-15 12:16:33 +00:00
reasoning
[Misc] Log the reason for falling back to FlexAttention (#20699)
2025-07-14 04:16:51 -07:00
spec_decode
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
third_party
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers_utils
[Model] Consolidate pooler implementations (#20927)
2025-07-16 13:39:13 +00:00
triton_utils
[Bugfix] Add missing field to TritonLanguagePlaceholder (#20812)
2025-07-11 05:25:11 -07:00
usage
[Misc] Add logger.exception for TPU information collection failures (#20510)
2025-07-05 07:24:32 -07:00
utils
[Bug Fix] get_distributed_init_method should get the ip from get_ip i… (#20889)
2025-07-15 21:23:52 +00:00
v1
[TPU] fix kv_cache_update kernel block size choosing logic (#21007)
2025-07-16 04:39:48 +00:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
worker
[Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702)
2025-07-12 06:02:10 -07:00
__init__.py
[Perf][CLI] Improve overall startup time (#19941)
2025-06-22 23:11:22 +00:00
_custom_ops.py
SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769)
2025-07-15 01:06:38 +00:00
_ipex_ops.py
[FIX][Intel GPU]fix ipex flash_attn_varlen_func api missing parameter (#20348)
2025-07-01 22:26:40 -07:00
beam_search.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
collect_env.py
[Misc] Refactor: Improve argument handling for conda command (#20481)
2025-07-15 19:43:19 -07:00
config.py
[Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979)
2025-07-15 15:57:53 +00:00
connections.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
env_override.py
[Misc] Reduce warning message introduced in env_override (#19476)
2025-06-11 17:29:54 +08:00
envs.py
[Nvidia] Integrate SM100 cudnn prefill API to MLA prefill (#20411)
2025-07-15 17:56:45 -07:00
forward_context.py
[CUDA] Enable full cudagraph for FlashMLA (#18581)
2025-06-13 18:12:26 +00:00
jsontree.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logger.py
[Attention] MLA - Flashinfer Ragged Prefill (#20034)
2025-07-10 20:17:47 -07:00
logits_process.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
outputs.py
[Model][2/N] Automatic conversion of CrossEncoding model (#19978)
2025-07-03 13:59:23 +00:00
pooling_params.py
[Bugfix] Add use_cross_encoder flag to use correct activation in ClassifierPooler (#20527)
2025-07-06 14:01:48 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979)
2025-07-15 15:57:53 +00:00
scalar_type.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scripts.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
sequence.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
test_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tracing.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
version.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00