Cyrus Leung 2497228ad4

[Chore] Factor out logic for requesting initial memory (#30868) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-12-17 07:32:17 -08:00

..

__init__.py

[Misc] Remove redundant attention var constants (#29650)

2025-11-28 04:35:19 -08:00

argparse_utils.py

[Frontend] Remove confusing -O.xx flag error (#30169)

2025-12-07 02:53:42 +00:00

async_utils.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

cache.py

…

collection_utils.py

[Misc] Remove redundant ClassRegistry (#29681)

2025-11-28 15:24:47 -08:00

counter.py

…

deep_gemm.py

[Bugfix] Fix fusion for VL models (#30244)

2025-12-14 21:22:37 +08:00

flashinfer.py

[Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842)

2025-12-17 01:54:21 -08:00

func_utils.py

…

gc_utils.py

[Doc]: fixing typos in multiple files. (#29685)

2025-11-28 08:41:41 -08:00

hashing.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

import_utils.py

…

jsontree.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

math_utils.py

…

mem_constants.py

…

mem_utils.py

[Chore] Factor out logic for requesting initial memory (#30868)

2025-12-17 07:32:17 -08:00

nccl.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

network_utils.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

nvtx_pytorch_hooks.py

[Feature] Add Layer-wise NVTX Support (#29990)

2025-12-05 11:20:07 +00:00

platform_utils.py

…

profiling.py

…

registry.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

serial_utils.py

[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)

2025-12-08 12:01:21 +00:00

system_utils.py

[Bugfix] Respect VLLM_CONFIGURE_LOGGING value (#28671)

2025-12-03 22:00:52 +00:00

tensor_schema.py

…

torch_utils.py

[Fix]Load kv-cache dtype from hf_quant_config.json automatically (fix for reverted PR) (#30785)

2025-12-17 01:56:38 -08:00