Sage Moore 18e7d6c7b8 Merge branch 'main' of https://github.com/neuralmagic/vllm into lwilkinson/attn-slicing

2025-06-03 00:52:39 +00:00

..

basic

revert offline_inference/basic.py

2025-06-02 18:05:48 +00:00

disaggregated-prefill-v1

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

openai_batch

[Frontend] add run batch to CLI (#18804)

2025-05-28 07:08:57 -07:00

profiling_tpu

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

qwen2_5_omni

[Misc] improve docs (#18734)

2025-05-27 07:07:01 +00:00

audio_language.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

automatic_prefix_caching.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

batch_llm_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

chat_with_tools.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

context_extension.py

[Bugfix] Fix nomic max_model_len (#18755)

2025-05-27 20:29:53 -07:00

data_parallel.py

Merge branch 'main' of https://github.com/neuralmagic/vllm into lwilkinson/attn-slicing

2025-06-03 00:52:39 +00:00

disaggregated_prefill.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

eagle.py

[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)

2025-05-27 09:37:06 +00:00

embed_jina_embeddings_v3.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

embed_matryoshka_fy.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

encoder_decoder_multimodal.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

encoder_decoder.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

llm_engine_example.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

load_sharded_state.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

lora_with_quantization_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

metrics.py

[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)

2025-05-27 09:37:06 +00:00

mistral-small.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

mlpspeculator.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

multilora_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

neuron_eagle.py

[Misc] improve docs (#18734)

2025-05-27 07:07:01 +00:00

neuron_int8_quantization.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

neuron_multimodal.py

[Neuron] Add Multi-Modal model support for Neuron (#18921)

2025-05-31 10:39:11 +00:00

neuron_speculation.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

neuron.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

prefix_caching.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

prithvi_geospatial_mae.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

profiling.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

prompt_embed_inference.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

qwen_1m.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

reproducibility.py

[Doc] Update reproducibility doc and example (#18741)

2025-05-27 07:03:13 +00:00

rlhf_colocate.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

rlhf_utils.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

rlhf.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

save_sharded_state.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

simple_profiling.py

[Misc] refactor argument parsing in examples (#16635)

2025-04-15 08:05:30 +00:00

structured_outputs.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

torchrun_example.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

tpu.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

vision_language_embedding.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

vision_language_multi_image.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

vision_language.py

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00