Yunfeng Bai 4b61c6b669

get_ip(): Fix ipv4 ipv6 dualstack (#2408)

2024-01-10 11:39:58 -08:00

..

core

Changed scheduler to use deques instead of lists (#2290)

2024-01-07 09:48:07 -08:00

engine

Changed scheduler to use deques instead of lists (#2290)

2024-01-07 09:48:07 -08:00

entrypoints

Ensure metrics are logged regardless of requests (#2347)

2024-01-05 05:24:42 -08:00

model_executor

[Speculative decoding 1/9] Optimized rejection sampler (#2336)

2024-01-09 15:38:41 -08:00

transformers_utils

[Minor] Delete Llama tokenizer warnings (#2146)

2023-12-16 22:05:18 -08:00

worker

Fix eager mode performance (#2377)

2024-01-08 10:11:06 -08:00

__init__.py

Bump up to v0.2.7 (#2337)

2024-01-03 17:35:56 -08:00

block.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

config.py

Enable CUDA graph for GPTQ & SqueezeLLM (#2318)

2024-01-03 09:52:29 -08:00

logger.py

[Fix] Fix duplicated logging messages (#1524)

2023-10-31 09:04:47 -07:00

outputs.py

docs: add description (#1553)

2023-11-03 09:14:52 -07:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509)

2023-10-30 14:50:47 -07:00

sampling_params.py

[Minor] Fix typo and remove unused code (#2305)

2024-01-02 19:23:15 -08:00

sequence.py

[FIX] Fix class naming (#1803)

2023-11-28 14:08:01 -08:00

utils.py

get_ip(): Fix ipv4 ipv6 dualstack (#2408)

2024-01-10 11:39:58 -08:00