[Misc][Bugfix] Update transformers for tokenizer issue (#6364)

This commit is contained in:
Roger Wang 2024-07-12 01:40:07 -07:00 committed by GitHub
parent 6047187cd8
commit f7160d946a
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -6,7 +6,7 @@ numpy < 2.0.0
requests
tqdm
py-cpuinfo
transformers >= 4.42.0 # Required for Gemma 2 and for additional chat template parameters.
transformers >= 4.42.4 # Required for Gemma 2 and for additional chat template parameters.
tokenizers >= 0.19.1 # Required for Llama 3.
fastapi
aiohttp