Cody Yu b8747e8a7c

[MISC] Skip dumping inputs when unpicklable (#8744)

2024-09-24 06:10:03 +00:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Model] Jamba support (#4115)

2024-07-02 23:11:29 +00:00

cpu_model_runner.py

[Bugfix][CPU] fix missing input intermediate_tensors in the cpu_model_runner (#8733)

2024-09-23 13:15:16 +00:00

cpu_worker.py

[Hardware][Intel] Support compressed-tensor W8A8 for CPU backend (#7257)

2024-09-11 09:46:46 -07:00

embedding_model_runner.py

[VLM] Refactor MultiModalConfig initialization and profiling (#7530)

2024-08-17 13:30:55 -07:00

enc_dec_model_runner.py

[Bugfix] [Encoder-Decoder] Bugfix for encoder specific metadata construction during decode of encoder-decoder models. (#8545)

2024-09-19 02:24:15 +00:00

model_runner_base.py

[MISC] Skip dumping inputs when unpicklable (#8744)

2024-09-24 06:10:03 +00:00

model_runner.py

[MISC] rename CudaMemoryProfiler to DeviceMemoryProfiler (#8703)

2024-09-22 10:44:09 -07:00

multi_step_model_runner.py

[bugfix] [AMD] add multi-step advance_step to ROCmFlashAttentionMetadata (#8474)

2024-09-19 20:49:54 -07:00

multi_step_tpu_worker.py

[TPU] Implement multi-step scheduling (#8489)

2024-09-14 16:58:31 -07:00

multi_step_worker.py

[Core] Optimize Async + Multi-step (#8050)

2024-09-03 18:50:29 +00:00

neuron_model_runner.py

[Neuron] Adding support for adding/ overriding neuron configuration a… (#8062)

2024-09-04 16:33:43 -07:00

neuron_worker.py

[Bugfix] neuron: enable tensor parallelism (#7562)

2024-08-26 15:13:13 -07:00

openvino_model_runner.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

openvino_worker.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

tpu_model_runner.py

[TPU] Implement multi-step scheduling (#8489)

2024-09-14 16:58:31 -07:00

tpu_worker.py

[TPU][Bugfix] Use XLA rank for persistent cache path (#8137)

2024-09-03 18:35:33 -07:00

utils.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631)

2024-09-17 07:35:01 -07:00

worker_base.py

[Core] Logprobs support in Multi-step (#7652)

2024-08-29 19:19:08 -07:00

worker.py

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

xpu_model_runner.py

[MISC] rename CudaMemoryProfiler to DeviceMemoryProfiler (#8703)

2024-09-22 10:44:09 -07:00

xpu_worker.py

[Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810)

2024-08-27 10:07:02 -07:00