RYDE-WORK/ktransformers
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/ktransformers.git synced 2026-02-05 05:53:13 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
18 Commits 1 Branch 0 Tags
Commit Graph

4 Commits

Author SHA1 Message Date
chenxl
f5f79f5c0e [ADD] support multi-gpu qlen>1 q5_k 2024-08-12 11:41:26 +00:00
chenht2022
c1cc7d2cd2 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. 2024-08-08 09:04:36 +00:00
chenxl
112cb3c962 [feature] support python 310 and multi instruction 2024-07-31 13:58:17 +00:00
chenxl
18c42e67df Initial commit 2024-07-27 16:06:58 +08:00