xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-04-07 05:27:02 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,613 Commits 155 Branches 89 Tags
Commit Graph

4 Commits

Author SHA1 Message Date
Lucas Wilkinson
9c60a6299d tp1 working multistream tp > 1 broken 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2025-05-22 20:51:36 +00:00
Lucas Wilkinson
04f11d97a0 working but only on the same stream 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2025-05-22 20:51:36 +00:00
Sage Moore
020269c4c5 added multhreading support 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2025-05-22 20:51:36 +00:00
Lucas Wilkinson
9ccfd094ff fix dummy mode 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2025-05-22 20:51:35 +00:00