BITcyman 7c4cb520bd [feature] support q2_k & q3_k dequantize on gpu

2024-08-12 12:53:12 +00:00

..

configs

Initial commit

2024-07-27 16:06:58 +08:00

ktransformers_ext

[feature] support q2_k & q3_k dequantize on gpu

2024-08-12 12:53:12 +00:00

models

[ADD] support multi-gpu qlen>1 q5_k

2024-08-12 11:41:26 +00:00

operators

[ADD] support multi-gpu qlen>1 q5_k

2024-08-12 11:41:26 +00:00

optimize

[ADD] support multi-gpu qlen>1 q5_k

2024-08-12 11:41:26 +00:00

server

Initial commit

2024-07-27 16:06:58 +08:00

tests

[ADD] support multi-gpu qlen>1 q5_k

2024-08-12 11:41:26 +00:00

util

[feature] support q2_k & q3_k dequantize on gpu

2024-08-12 12:53:12 +00:00

website

Initial commit

2024-07-27 16:06:58 +08:00

__init__.py

[feature] support python 310 and multi instruction

2024-07-31 13:58:17 +00:00

local_chat.py

[ADD] support multi-gpu qlen>1 q5_k

2024-08-12 11:41:26 +00:00