youkaichao a36e070dad

[torch.compile] fix functionalization (#8480)

2024-09-14 09:46:04 -07:00

..

async_engine

[HotFix] Fix final output truncation with stop string + streaming (#8468)

2024-09-13 11:31:12 -07:00

basic_correctness

[CI/Build] Reorganize models tests (#7820)

2024-09-13 10:20:06 -07:00

compile

[torch.compile] fix functionalization (#8480)

2024-09-14 09:46:04 -07:00

core

…

data

[Frontend]-config-cli-args (#7737)

2024-08-30 08:21:02 -07:00

distributed

[CI/Build] Reorganize models tests (#7820)

2024-09-13 10:20:06 -07:00

engine

[Core] Factor out input preprocessing to a separate class (#7329)

2024-09-13 02:56:13 +00:00

entrypoints

[Bugfix] Offline mode fix (#8376)

2024-09-12 11:11:57 -07:00

fp8_kv

…

kernels

[Kernel][Hardware][Amd]Custom paged attention kernel for rocm (#8310)

2024-09-13 17:01:11 -07:00

lora

[CI] Change test input in Gemma LoRA test (#8163)

2024-09-04 13:05:50 -07:00

metrics

…

model_executor

…

models

[Model] support minicpm3 (#8297)

2024-09-14 14:50:26 +00:00

multi_step

[multi-step] add flashinfer backend (#7928)

2024-09-12 11:16:22 -07:00

multimodal

…

plugins/vllm_add_dummy_model

…

prefix_caching

…

prompt_adapter

…

prompts

…

quantization

[misc][ci] fix quant test (#8449)

2024-09-13 17:20:14 +08:00

samplers

[SpecDecode][Kernel] Flashinfer Rejection Sampling (#7244)

2024-09-01 21:23:29 -07:00

spec_decode

[Speculative Decoding] Test refactor (#8317)

2024-09-11 14:07:34 -07:00

tensorizer_loader

…

tokenization

…

tool_use

[Bugfix] Streamed tool calls now more strictly follow OpenAI's format; ensures Vercel AI SDK compatibility (#8272)

2024-09-09 10:45:11 -04:00

tpu

…

tracing

…

weight_loading

[Misc] Fused MoE Marlin support for GPTQ (#8217)

2024-09-09 23:02:52 -04:00

worker

…

__init__.py

…

conftest.py

[CI/Build] Reorganize models tests (#7820)

2024-09-13 10:20:06 -07:00

test_cache_block_hashing.py

…

test_config.py

…

test_embedded_commit.py

[Misc] Add generated git commit hash as vllm.__commit__ (#6386)

2024-07-12 22:52:15 +00:00

test_inputs.py

…

test_logger.py

[CI/Build] Use python 3.12 in cuda image (#8133)

2024-09-07 13:03:16 -07:00

test_logits_processor.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_sequence.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

test_sharded_state_loader.py

…

test_utils.py

[Frontend]-config-cli-args (#7737)

2024-08-30 08:21:02 -07:00

utils.py

[CI/Build] Reorganize models tests (#7820)

2024-09-13 10:20:06 -07:00