xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-12 12:49:57 +08:00
Code Issues Packages Projects Releases Wiki Activity
154 Commits 155 Branches 89 Tags
Commit Graph

4 Commits

Author SHA1 Message Date
Woosuk Kwon
211318d44a
Add throughput benchmarking script (#133) 2023-05-28 03:20:05 -07:00
Woosuk Kwon
4a151dd453
Add activation registry (#126) 2023-05-25 00:09:07 -07:00
Woosuk Kwon
3f942acfe1
Fix latency benchmark script (#118) 2023-05-22 17:03:40 -07:00
Woosuk Kwon
655a5e48df
Introduce LLM class for offline inference (#115) 2023-05-21 17:04:18 -07:00