Atream 412055d450 [feature] experts can be injected using CPUInfer ...

[fix] fix ktransformers interface when use new CUDAGraphRunner
[fix] fix YAML and optimize logic, the top rule has the highest priority

2024-08-14 16:10:54 +08:00

..

cuda_graph_runner.py

[ADD] support multi-gpu qlen>1 q5_k

2024-08-12 11:41:26 +00:00

custom_gguf.py

[feature] support q2_k & q3_k dequantize on gpu

2024-08-12 12:53:12 +00:00

textstream.py

Initial commit

2024-07-27 16:06:58 +08:00

utils.py

[feature] experts can be injected using CPUInfer

2024-08-14 16:10:54 +08:00