xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-14 07:15:01 +08:00
Code Issues Packages Projects Releases Wiki Activity

Remove python 3.10 requirement (#2040)

Browse Source
This commit is contained in:
Woosuk Kwon 2023-12-11 12:26:42 -08:00 committed by GitHub
parent eb17212858
commit 31d2ab4aff
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 2 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -72,7 +72,7 @@ Install vLLM with pip or [from source](https://vllm.readthedocs.io/en/latest/get
```bash ```bash
pip install vllm pip install vllm
``` ```
**NOTE:** The Mixtral model additionally requires `megablocks` which can be installed with pip or [from source](https://github.com/stanford-futuredata/megablocks) on **Python 3.10**: **NOTE:** The Mixtral model additionally requires `megablocks` which can be installed with pip or [from source](https://github.com/stanford-futuredata/megablocks):
```bash ```bash
pip install megablocks pip install megablocks
``` ```

4
vllm/model_executor/models/mixtral.py
View File

@ -35,9 +35,7 @@ try:
import megablocks.ops as ops import megablocks.ops as ops
except ImportError: except ImportError:
print( print(
"MegaBlocks not found. Please install it by `pip install megablocks`. " "MegaBlocks not found. Please install it by `pip install megablocks`.")
"Note that MegaBlocks depends on mosaicml-turbo, which only supports "
"Python 3.10 for now.")
try: try:
import stk import stk
except ImportError: except ImportError: