mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-24 17:25:51 +08:00
10 lines
667 B
Markdown
10 lines
667 B
Markdown
---
|
|
title: Anyscale
|
|
---
|
|
[](){ #deployment-anyscale }
|
|
|
|
[Anyscale](https://www.anyscale.com) is a managed, multi-cloud platform developed by the creators of Ray.
|
|
It hosts Ray clusters inside your own AWS, GCP, or Azure account, delivering the flexibility of open-source Ray
|
|
without the operational overhead of maintaining Kubernetes control planes, configuring autoscalers, or managing observability stacks.
|
|
When serving large language models with vLLM, Anyscale can rapidly provision [production-ready HTTPS endpoints](https://docs.anyscale.com/examples/deploy-ray-serve-llms) or [fault-tolerant batch inference jobs](https://docs.anyscale.com/examples/ray-data-llm).
|