Isotr0py 1173804dca

[Bugfix] Fix TP inference for Flex attention backend (#19657) ...

Signed-off-by: Isotr0py <2037008807@qq.com>

2025-06-16 11:21:37 +00:00

..

async_engine

…

basic_correctness

…

benchmarks

[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)

2025-06-12 10:30:56 -07:00

compile

[CUDA] Enable full cudagraph for FlashMLA (#18581)

2025-06-13 18:12:26 +00:00

config

…

core

[Bugfix][Core] Prefix caching causes incorrect outputs due to outdated ComputedBlocksTracker (#18957)

2025-06-15 21:56:37 -07:00

detokenizer

…

distributed

…

encoder_decoder

…

engine

…

entrypoints

[CI] Add mteb testing for rerank models (#19344)

2025-06-16 01:36:43 -07:00

fastsafetensors_loader

…

kernels

[Kernel] Raise verbose error and consolidate num_heads/num_kv_heads divisibility check (#19339)

2025-06-15 13:43:48 +08:00

kv_transfer

…

lora

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

metrics

…

mistral_tool_use

…

model_executor

…

models

[CI] Add mteb testing for rerank models (#19344)

2025-06-16 01:36:43 -07:00

mq_llm_engine

…

multi_step

Adding "AMD: Multi-step Tests" to amdproduction. (#19508)

2025-06-13 17:08:51 -07:00

multimodal

…

neuron

…

plugins

…

plugins_tests

…

prefix_caching

…

prompt_adapter

…

prompts

…

quantization

Fix TorchAOConfig skip layers (#19265)

2025-06-12 22:22:53 +08:00

reasoning

…

runai_model_streamer_test

…

samplers

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

spec_decode

[Bugfix][2/n] Fix speculative decoding CI - Fix test_ngram_e2e_greedy_correctness (#19644)

2025-06-14 21:15:41 -07:00

standalone_tests

…

system_messages

…

tensorizer_loader

…

tokenization

…

tool_use

…

tpu

…

tracing

…

v1

[Bugfix] Fix TP inference for Flex attention backend (#19657)

2025-06-16 11:21:37 +00:00

vllm_test_utils

…

weight_loading

…

worker

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

__init__.py

…

build_cython.py

…

conftest.py

[CI] Add mteb testing for rerank models (#19344)

2025-06-16 01:36:43 -07:00

test_cache_block_hashing.py

…

test_config.py

[Misc] Fix skipped max-model-len validation when deriving max model length from tokenizer config (#19660)

2025-06-16 06:30:29 +00:00

test_embedded_commit.py

…

test_inputs.py

…

test_logger.py

…

test_outputs.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_sharded_state_loader.py

…

test_triton_utils.py

…

test_utils.py

Support non-string values in JSON keys from CLI (#19471)

2025-06-11 09:34:04 +00:00

test_version.py

…

test_vllm_port.py

…

utils.py

[CUDA] Enable full cudagraph for FlashMLA (#18581)

2025-06-13 18:12:26 +00:00