Siyuan Liu 9112b443a0

[Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) ...

Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

2025-06-03 00:06:20 +00:00

..

basic

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

disaggregated-prefill-v1

add an absolute path for run.sh (#18258)

2025-06-02 19:38:23 +00:00

openai_batch

[Frontend] add run batch to CLI (#18804)

2025-05-28 07:08:57 -07:00

profiling_tpu

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

qwen2_5_omni

[Misc] improve docs (#18734)

2025-05-27 07:07:01 +00:00

audio_language.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

automatic_prefix_caching.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

batch_llm_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

chat_with_tools.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

context_extension.py

[Bugfix] Fix nomic max_model_len (#18755)

2025-05-27 20:29:53 -07:00

data_parallel.py

[BugFix] Fix multi-node offline data-parallel (#18981)

2025-05-31 08:34:52 -07:00

disaggregated_prefill.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

eagle.py

[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)

2025-05-27 09:37:06 +00:00

embed_jina_embeddings_v3.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

embed_matryoshka_fy.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

encoder_decoder_multimodal.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

encoder_decoder.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

llm_engine_example.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

load_sharded_state.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

lora_with_quantization_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

metrics.py

[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)

2025-05-27 09:37:06 +00:00

mistral-small.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

mlpspeculator.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

multilora_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

neuron_eagle.py

[Misc] improve docs (#18734)

2025-05-27 07:07:01 +00:00

neuron_int8_quantization.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

neuron_multimodal.py

[Neuron] Add Multi-Modal model support for Neuron (#18921)

2025-05-31 10:39:11 +00:00

neuron_speculation.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

neuron.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

prefix_caching.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

prithvi_geospatial_mae.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

profiling.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

prompt_embed_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

qwen_1m.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

reproducibility.py

[Doc] Update reproducibility doc and example (#18741)

2025-05-27 07:03:13 +00:00

rlhf_colocate.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

rlhf_utils.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

rlhf.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

save_sharded_state.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

simple_profiling.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

structured_outputs.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

torchrun_example.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

tpu.py

[Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011)

2025-06-03 00:06:20 +00:00

vision_language_embedding.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

vision_language_multi_image.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

vision_language.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00