youkaichao aab0fcdb63

[ci][test] fix RemoteOpenAIServer (#7838)

2024-08-24 17:31:28 +00:00

..

async_engine

…

basic_correctness

[Kernel] Replaced blockReduce[...] functions with cub::BlockReduce (#7233)

2024-08-21 20:18:00 -04:00

compile

…

core

…

distributed

[Ray backend] Better error when pg topology is bad. (#7584)

2024-08-22 17:44:25 -07:00

engine

…

entrypoints

[misc][core] lazy import outlines (#7831)

2024-08-24 00:51:38 -07:00

fp8_kv

…

kernels

[BUG] fix crash on flashinfer backend with cudagraph disabled, when attention group_size not in [1,2,4,8] (#7509)

2024-08-21 08:54:31 -07:00

lora

[Core] Add multi-step support to LLMEngine (#7789)

2024-08-23 12:45:53 -07:00

metrics

…

model_executor

…

models

[Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710)

2024-08-22 09:36:24 +08:00

multi_step

[Core] Add multi-step support to LLMEngine (#7789)

2024-08-23 12:45:53 -07:00

multimodal

…

plugins/vllm_add_dummy_model

…

prefix_caching

…

prompt_adapter

…

prompts

…

quantization

…

samplers

…

spec_decode

[Bugfix] spec decode handle None entries in topk args in create_sequence_group_output (#7232)

2024-08-22 09:33:48 -04:00

tensorizer_loader

…

tokenization

…

tracing

…

weight_loading

[Misc] Update marlin to use vLLMParameters (#7803)

2024-08-23 14:30:52 -04:00

worker

…

__init__.py

…

conftest.py

[Model] Add UltravoxModel and UltravoxConfig (#7615)

2024-08-21 22:49:39 +00:00

test_cache_block_hashing.py

…

test_config.py

…

test_embedded_commit.py

…

test_inputs.py

…

test_logger.py

…

test_logits_processor.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_sequence.py

…

test_sharded_state_loader.py

…

test_utils.py

…

utils.py

[ci][test] fix RemoteOpenAIServer (#7838)

2024-08-24 17:31:28 +00:00