Roger Wang 5231f0898e

[Frontend][VLM] Add support for multiple multi-modal items (#8049)

2024-08-31 16:35:53 -07:00

..

fp8

…

production_monitoring

[CI/Build] Pin OpenTelemetry versions and make errors clearer (#7266)

2024-08-20 10:02:21 -07:00

api_client.py

…

aqlm_example.py

…

cpu_offload.py

…

gguf_inference.py

[Core] Support loading GGUF model (#5191)

2024-08-05 17:54:23 -06:00

gradio_openai_chatbot_webserver.py

…

gradio_webserver.py

…

llm_engine_example.py

…

logging_configuration.md

…

lora_with_quantization_inference.py

…

multilora_inference.py

…

offline_inference_arctic.py

…

offline_inference_audio_language.py

[Doc] Fix incorrect docs from #7615 (#7788)

2024-08-22 10:02:06 -07:00

offline_inference_chat.py

Chat method for offline llm (#5049)

2024-08-15 19:41:34 -07:00

offline_inference_distributed.py

…

offline_inference_embedding.py

…

offline_inference_encoder_decoder.py

[Core] Support serving encoder/decoder models (#7258)

2024-08-09 10:39:41 +08:00

offline_inference_mlpspeculator.py

…

offline_inference_neuron.py

[Neuron] Adding support for context-lenght, token-gen buckets. (#7885)

2024-08-29 13:58:14 -07:00

offline_inference_openai.md

[Frontend] Support embeddings in the run_batch API (#7132)

2024-08-09 09:48:21 -07:00

offline_inference_tpu.py

…

offline_inference_vision_language.py

[VLM][Doc] Add stop_token_ids to InternVL example (#7354)

2024-08-09 14:51:04 +00:00

offline_inference_with_prefix.py

…

offline_inference.py

…

openai_audio_api_client.py

[Model] Add UltravoxModel and UltravoxConfig (#7615)

2024-08-21 22:49:39 +00:00

openai_chat_completion_client.py

…

openai_completion_client.py

…

openai_embedding_client.py

[Bugfix]: Use float32 for base64 embedding (#7855)

2024-08-26 03:16:38 +00:00

openai_example_batch.jsonl

…

openai_vision_api_client.py

[Frontend][VLM] Add support for multiple multi-modal items (#8049)

2024-08-31 16:35:53 -07:00

run_cluster.sh

…

save_sharded_state.py

…

template_alpaca.jinja

…

template_baichuan.jinja

…

template_blip2.jinja

[Model] Initial support for BLIP-2 (#5920)

2024-07-27 11:53:07 +00:00

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_llava.jinja

…

tensorize_vllm_model.py

…