Cyrus Leung 91445c7bc8

[Bugfix] Fix image input for Pixtral-HF (#11741) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-01-08 10:17:16 +08:00

..

chart-helm

…

fp8

[Doc] Group examples into categories (#11782)

2025-01-08 09:20:12 +08:00

opentelemetry

[Doc] Group examples into categories (#11782)

2025-01-08 09:20:12 +08:00

prometheus_grafana

[Doc] Group examples into categories (#11782)

2025-01-08 09:20:12 +08:00

api_client.py

…

aqlm_example.py

…

cpu_offload.py

…

disaggregated_prefill.sh

…

florence2_inference.py

…

gguf_inference.py

…

gradio_openai_chatbot_webserver.py

…

gradio_webserver.py

…

llm_engine_example.py

…

logging_configuration.md

…

lora_with_quantization_inference.py

…

multilora_inference.py

…

offline_chat_with_tools.py

…

offline_inference_arctic.py

…

offline_inference_audio_language.py

[VLM] Merged multimodal processor for Qwen2-Audio (#11303)

2024-12-19 06:14:17 +00:00

offline_inference_chat.py

…

offline_inference_classification.py

[Frontend] Separate pooling APIs in offline inference (#11129)

2024-12-13 10:40:07 +00:00

offline_inference_cli.py

…

offline_inference_distributed.py

…

offline_inference_embedding.py

[Frontend] Separate pooling APIs in offline inference (#11129)

2024-12-13 10:40:07 +00:00

offline_inference_encoder_decoder.py

…

offline_inference_mlpspeculator.py

…

offline_inference_neuron_int8_quantization.py

…

offline_inference_neuron.py

[CI] Fix neuron CI and run offline tests (#11779)

2025-01-06 21:36:10 -08:00

offline_inference_openai.md

[Doc] Reorganize online pooling APIs (#11172)

2024-12-14 00:22:22 +08:00

offline_inference_pixtral.py

…

offline_inference_scoring.py

[Frontend] Separate pooling APIs in offline inference (#11129)

2024-12-13 10:40:07 +00:00

offline_inference_structured_outputs.py

…

offline_inference_tpu.py

…

offline_inference_vision_language_embedding.py

[Frontend] Separate pooling APIs in offline inference (#11129)

2024-12-13 10:40:07 +00:00

offline_inference_vision_language_multi_image.py

[Bugfix] Fix image input for Pixtral-HF (#11741)

2025-01-08 10:17:16 +08:00

offline_inference_vision_language.py

[V1][VLM] V1 support for selected single-image models. (#11632)

2024-12-31 21:17:22 +00:00

offline_inference_whisper.py

[Model] Whisper model implementation (#11280)

2025-01-03 16:39:19 +08:00

offline_inference_with_default_generation_config.py

[Feature] Add load generation config from model (#11164)

2024-12-19 10:50:38 +00:00

offline_inference_with_prefix.py

…

offline_inference_with_profiler.py

[V1] Fix torch profiling for offline inference (#11125)

2024-12-12 15:51:53 +00:00

offline_inference.py

…

offline_profile.py

[misc] Layerwise profile updates (#10242)

2024-12-16 18:14:57 +00:00

openai_chat_completion_client_for_multimodal.py

[Doc] Add video example to openai client for multimodal (#11521)

2024-12-26 17:31:29 +00:00

openai_chat_completion_client_with_tools.py

…

openai_chat_completion_client.py

…

openai_chat_completion_structured_outputs.py

…

openai_chat_embedding_client_for_multimodal.py

[Doc] Reorganize online pooling APIs (#11172)

2024-12-14 00:22:22 +08:00

openai_completion_client.py

…

openai_cross_encoder_score.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

openai_embedding_client.py

…

openai_example_batch.jsonl

…

openai_pooling_client.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

run_cluster.sh

…

sagemaker-entrypoint.sh

[Misc] Minimum requirements for SageMaker compatibility (#11576)

2025-01-02 15:59:25 -08:00

save_sharded_state.py

…

template_alpaca.jinja

…

template_baichuan.jinja

…

template_blip2.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_dse_qwen2_vl.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_llava.jinja

…

template_vlm2vec.jinja

…

tensorize_vllm_model.py

…

tool_chat_template_granite_20b_fc.jinja

…

tool_chat_template_granite.jinja

…

tool_chat_template_hermes.jinja

…

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

…

tool_chat_template_llama3.2_json.jinja

…

tool_chat_template_llama3.2_pythonic.jinja

…

tool_chat_template_mistral_parallel.jinja

…

tool_chat_template_mistral.jinja

…

tool_chat_template_toolace.jinja

…