vllm/README.md
2023-02-24 12:04:49 +00:00

15 lines
134 B
Markdown

# CacheFlow
## Installation
```bash
pip install cmake torch transformers
pip install -e .
```
## Run
```bash
python server.py
```