xinyun/QwQ-32B
1
0
Fork 0
mirror of https://www.modelscope.cn/Qwen/QwQ-32B.git synced 2025-12-09 13:54:21 +08:00
Code Issues Packages Projects Releases Wiki Activity
19 Commits 7 Branches 0 Tags
Commit Graph

19 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
rudy0053
8245fd1aaf 当我使用指令： 
```
# We recommend using the tokenizer from base model to avoid long-time and buggy tokenizer conversion.
CUDA_VISIBLE_DEVICES=0,1 \
vllm serve /data/models/ollama-model/QwQ-32B-GGUF/qwq-32b-q4_k_m.gguf \
--tensor-parallel-size 2 \
--port 8132 \
--max-model-len 1024 \
--gpu-memory-utilization 0.7 \
> /data/models/qwq32-q4.log 2>&1
```, 出现了报错：
The tokenizer class you load from this checkpoint is 'LlamaTokenizer'.
The class this function is called from is 'Qwen2TokenizerFast'.

模型检查点（qwq-32b-q4_k_m.gguf）内部分词器配置为LlamaTokenizer，但代码中实际使用的是Qwen2TokenizerFast（通义千问的分词器），为什么是这样？
 2025-03-19 02:52:36 +00:00
ai-modelscope
b8bda72841 update tokenizer_config.json 2025-03-11 20:28:39 +08:00
ai-modelscope
98a80c3f08 update tokenizer.json 2025-03-11 19:04:44 +08:00
ai-modelscope
2a776a8f45 update README & config 2025-03-10 23:13:16 +08:00
ai-modelscope
c9bbf86d9f Update README.md 2025-03-08 02:55:53 +08:00
ai-modelscope
887ddbd72b update README 2025-03-07 01:07:39 +08:00
Cherrytest
debcd63c0c add 2025-03-06 07:26:24 +00:00
Cherrytest
b8b5532982 System delete file 2025-03-06 07:25:42 +00:00
Cherrytest
045961d999 Add transformers as library! (#1) 
- Add transformers as library! (cc1ce1debef18f3a714143d45c50a15893dd2dff)


Co-authored-by: Vaibhav Srivastav <reach-vb@users.noreply.huggingface.co>
 2025-03-06 06:44:41 +00:00
Cherrytest
9987c9d176 Update README.md 2025-03-05 17:26:36 +00:00
Cherrytest
770a0a9dda Update tokenizer_config.json 2025-03-05 16:30:19 +00:00
Cherrytest
5826c73bfd Update README.md 2025-03-05 16:27:58 +00:00
Cherrytest
9abfdb4e5a Update README.md 2025-03-05 16:27:56 +00:00
Cherrytest
f5244dd874 Update config.json 2025-03-05 16:27:05 +00:00
Cherrytest
247d06c0e3 Upload to Qwen/QwQ-32B on ModelScope hub 2025-03-05 15:36:35 +00:00
Cherrytest
8bb8cb7cc2 Upload to Qwen/QwQ-32B on ModelScope hub 2025-03-05 15:36:33 +00:00
Cherrytest
cce874c0ca System init configuration.json 2025-03-05 15:32:17 +00:00
Cherrytest
314bca6c4f System update meta information 2025-03-05 15:32:16 +00:00
Cherrytest
6e74315bbc System init .gitattributes 2025-03-05 15:32:15 +00:00