xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 05:24:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
vllm/README.md
Woosuk Kwon c84c708a1d Add README
2023-02-24 12:04:49 +00:00

134 B
Raw Blame History

CacheFlow

Installation

pip install cmake torch transformers
pip install -e .

Run

python server.py