mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2025-12-09 21:45:44 +08:00
16 lines
195 B
Markdown
16 lines
195 B
Markdown
# CacheFlow
|
|
|
|
## Installation
|
|
|
|
```bash
|
|
pip install psutil numpy torch transformers
|
|
pip install flash-attn # This may take up to 10 mins.
|
|
pip install -e .
|
|
```
|
|
|
|
## Run
|
|
|
|
```bash
|
|
python server.py
|
|
```
|