xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-10 04:44:57 +08:00
Code Issues Packages Projects Releases Wiki Activity

Remove python 3.10 requirement (#2040)

Browse Source
This commit is contained in:
Woosuk Kwon 2023-12-11 12:26:42 -08:00 committed by GitHub
parent eb17212858
commit 31d2ab4aff
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 2 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -72,7 +72,7 @@ Install vLLM with pip or [from source](https://vllm.readthedocs.io/en/latest/get
```bash
pip install vllm
```
**NOTE:** The Mixtral model additionally requires `megablocks` which can be installed with pip or [from source](https://github.com/stanford-futuredata/megablocks) on **Python 3.10**:
**NOTE:** The Mixtral model additionally requires `megablocks` which can be installed with pip or [from source](https://github.com/stanford-futuredata/megablocks):
```bash
pip install megablocks
```

4
vllm/model_executor/models/mixtral.py
View File

@ -35,9 +35,7 @@ try:
import megablocks.ops as ops
except ImportError:
print(
"MegaBlocks not found. Please install it by `pip install megablocks`. "
"Note that MegaBlocks depends on mosaicml-turbo, which only supports "
"Python 3.10 for now.")
"MegaBlocks not found. Please install it by `pip install megablocks`.")
try:
import stk
except ImportError: