Ning Xie d97841078b

[Misc] unify variable for LLM instance (#20996) ...

Signed-off-by: Andy Xie <andy.xning@gmail.com>

2025-07-21 12:18:33 +01:00

..

basic

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

disaggregated-prefill-v1

…

openai_batch

…

profiling_tpu

…

qwen2_5_omni

…

audio_language.py

Voxtral (#20970)

2025-07-15 07:35:30 -07:00

automatic_prefix_caching.py

…

batch_llm_inference.py

…

chat_with_tools.py

…

context_extension.py

…

convert_model_to_seq_cls.py

…

data_parallel.py

…

disaggregated_prefill.py

…

embed_jina_embeddings_v3.py

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

embed_matryoshka_fy.py

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

encoder_decoder_multimodal.py

…

encoder_decoder.py

…

llm_engine_example.py

…

load_sharded_state.py

…

lora_with_quantization_inference.py

…

metrics.py

…

mistral-small.py

…

mlpspeculator.py

…

multilora_inference.py

…

neuron_eagle.py

[bugfix] fix syntax warning caused by backslash (#21251)

2025-07-20 17:12:10 +00:00

neuron_int8_quantization.py

…

neuron_multimodal.py

…

neuron_speculation.py

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

neuron.py

…

prefix_caching.py

…

prithvi_geospatial_mae.py

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

profiling.py

…

prompt_embed_inference.py

…

qwen3_reranker.py

[Misc] unify variable for LLM instance (#20996)

2025-07-21 12:18:33 +01:00

qwen_1m.py

…

reproducibility.py

…

rlhf_colocate.py

…

rlhf_utils.py

…

rlhf.py

[Docs] Improve documentation for RLHF example (#20598)

2025-07-15 01:54:10 -07:00

save_sharded_state.py

…

simple_profiling.py

…

skip_loading_weights_in_engine_init.py

[Doc] Add inplace weights loading example (#19640)

2025-07-17 21:12:23 -07:00

spec_decode.py

[Meta] Llama4 EAGLE Support (#20591)

2025-07-15 21:14:15 -07:00

structured_outputs.py

…

torchrun_example.py

…

tpu.py

…

vision_language_multi_image.py

…

vision_language_pooling.py

[Model][VLM] Support JinaVL Reranker (#20260)

2025-07-10 10:43:43 -07:00

vision_language.py

[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349)

2025-07-17 03:07:55 -07:00