youkaichao eed020f673

[misc] use nvml to get consistent device name (#7582)

2024-08-16 21:15:13 -07:00

..

__init__.py

…

cache_engine.py

…

cpu_model_runner.py

…

cpu_worker.py

…

embedding_model_runner.py

…

enc_dec_model_runner.py

…

model_runner_base.py

…

model_runner.py

[Core] Fix tracking of model forward time in case of PP>1 (#7440)

2024-08-16 13:46:01 -07:00

neuron_model_runner.py

[Bugfix] update neuron for version > 0.5.0 (#7175)

2024-08-15 09:44:14 -07:00

neuron_worker.py

[Bugfix] update neuron for version > 0.5.0 (#7175)

2024-08-15 09:44:14 -07:00

openvino_model_runner.py

…

openvino_worker.py

…

tpu_model_runner.py

…

tpu_worker.py

[TPU] Set per-rank XLA cache (#7533)

2024-08-14 14:47:51 -07:00

utils.py

…

worker_base.py

…

worker.py

[misc] use nvml to get consistent device name (#7582)

2024-08-16 21:15:13 -07:00

xpu_model_runner.py

…

xpu_worker.py

…