Cody Yu f0ef37233e

[V1] Add uncache_blocks (#12333)

2025-01-23 04:19:21 +00:00

..

async_engine

…

basic_correctness

[Core] Support fully transparent sleep mode (#11743)

2025-01-22 14:39:32 +08:00

compile

[v1] fix compilation cache (#11598)

2024-12-30 04:24:12 +00:00

core

[Core] Support reset_prefix_cache (#12284)

2025-01-22 18:52:27 +00:00

data

…

distributed

Support torchrun and SPMD-style offline inference (#12071)

2025-01-16 19:58:53 +08:00

encoder_decoder

…

engine

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

entrypoints

[Bugfix] Fix score api for missing max_model_len validation (#12119)

2025-01-17 16:24:22 +00:00

fp8_kv

…

kernels

[AMD][Quantization] Add TritonScaledMMLinearKernel since int8 is broken for AMD (#12282)

2025-01-23 00:10:37 +00:00

kv_transfer

[MISC] fix typo in kv transfer send recv test (#11983)

2025-01-13 05:07:48 +00:00

lora

[Misc][LoRA] Improve the readability of LoRA error messages (#12102)

2025-01-17 19:32:28 +08:00

metrics

monitor metrics of tokens per step using cudagraph batchsizes (#11031)

2024-12-09 22:35:36 -08:00

model_executor

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

models

[ci/lint] Add back default arg for pre-commit (#12279)

2025-01-22 01:15:27 +00:00

mq_llm_engine

…

multi_step

[Misc] Add multipstep chunked-prefill support for FlashInfer (#10467)

2025-01-15 12:47:49 +08:00

multimodal

[VLM] Simplify post-processing of replacement info (#12269)

2025-01-21 16:48:13 -08:00

plugins

[Platform] Do not raise error if _Backend is not found (#12023)

2025-01-15 10:14:15 +00:00

plugins_tests

[Platform] Do not raise error if _Backend is not found (#12023)

2025-01-15 10:14:15 +00:00

prefix_caching

…

prompt_adapter

…

prompts

…

quantization

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

runai_model_streamer

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00

samplers

[Bugfix] Multi-sequence broken (#11898)

2025-01-21 11:51:35 -08:00

spec_decode

[ci] fix broken distributed-tests-4-gpus (#11937)

2025-01-11 09:07:24 +08:00

standalone_tests

…

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tensorizer_loader

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

tokenization

…

tool_use

[Model] IBM Granite 3.1 (#11307)

2024-12-19 11:27:24 +08:00

tpu

[TPU][Quantization] TPU W8A8 (#11785)

2025-01-08 19:33:29 +00:00

tracing

[Misc] Remove experimental dep from tracing.py (#12007)

2025-01-21 11:51:55 -08:00

v1

[V1] Add uncache_blocks (#12333)

2025-01-23 04:19:21 +00:00

vllm_test_utils

[misc] improve memory profiling (#11809)

2025-01-08 06:36:03 +00:00

weight_loading

[Model] Support for fairseq2 Llama (#11442)

2025-01-19 10:40:40 -08:00

worker

[core] overhaul memory profiling and fix backward compatibility (#10511)

2024-12-16 13:32:25 -08:00

__init__.py

…

conftest.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

test_cache_block_hashing.py

…

test_config.py

[Misc] Split up pooling tasks (#10820)

2024-12-11 01:28:00 -08:00

test_embedded_commit.py

…

test_inputs.py

…

test_logger.py

…

test_logits_processor.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_sequence.py

…

test_sharded_state_loader.py

…

test_utils.py

[core] further polish memory profiling (#12126)

2025-01-18 12:25:08 +08:00

utils.py

[ci]try to fix flaky multi-step tests (#11894)

2025-01-09 14:47:29 +00:00