Travis Johnson 2bcbae704c

[Bugfix] Fix edge-case crash when using chat with the Mistral Tekken Tokenizer (#10051) ...

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

2024-11-06 04:28:29 +00:00

..

async_engine

…

basic_correctness

[Bugfix] Fix pickle of input when async output processing is on (#9931)

2024-11-06 00:39:26 +00:00

compile

[bugfix] fix weak ref in piecewise cudagraph and tractable test (#10048)

2024-11-05 14:49:20 -08:00

core

[Core] Make encoder-decoder inputs a nested structure to be more composable (#9604)

2024-11-05 10:07:31 +08:00

data

…

distributed

[torch.compile] Adding torch compile annotations to some models (#9876)

2024-11-01 00:25:47 -07:00

encoder_decoder

[Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559)

2024-11-01 23:22:49 -07:00

engine

[Core] Make encoder-decoder inputs a nested structure to be more composable (#9604)

2024-11-05 10:07:31 +08:00

entrypoints

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

fp8_kv

…

kernels

[CI] Prune back the number of tests in tests/kernels/* (#9932)

2024-11-05 16:02:32 -05:00

lora

[Bugfix][CI/Build][Hardware][AMD] Shard ID parameters in AMD tests running parallel jobs (#9279)

2024-11-04 11:37:46 -08:00

metrics

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

model_executor

…

models

[Bugfix] Fix edge-case crash when using chat with the Mistral Tekken Tokenizer (#10051)

2024-11-06 04:28:29 +00:00

mq_llm_engine

[Bugfix][core] replace heartbeat with pid check (#9818)

2024-10-30 09:34:07 -07:00

multi_step

…

multimodal

[Frontend] Multi-Modality Support for Loading Local Image Files (#9915)

2024-11-04 15:34:57 +00:00

plugins/vllm_add_dummy_model

…

prefix_caching

[Bugfix] Fix illegal memory access error with chunked prefill, prefix caching, block manager v2 and xformers enabled together (#9532)

2024-10-31 11:46:36 -07:00

prompt_adapter

…

prompts

…

quantization

…

samplers

…

spec_decode

[Bugfix][SpecDecode] kv corruption with bonus tokens in spec decode (#9730)

2024-11-06 01:45:45 +00:00

tensorizer_loader

…

tokenization

[Core] Make encoder-decoder inputs a nested structure to be more composable (#9604)

2024-11-05 10:07:31 +08:00

tool_use

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00

tpu

…

tracing

…

weight_loading

…

worker

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

__init__.py

…

conftest.py

[CI/Build] VLM Test Consolidation (#9372)

2024-10-30 09:32:17 -07:00

test_cache_block_hashing.py

[Core] Make encoder-decoder inputs a nested structure to be more composable (#9604)

2024-11-05 10:07:31 +08:00

test_config.py

…

test_embedded_commit.py

…

test_inputs.py

…

test_logger.py

…

test_logits_processor.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_sequence.py

…

test_sharded_state_loader.py

…

test_utils.py

…

utils.py

[torch.compile] rework test plans (#9866)

2024-10-31 22:20:17 -07:00