Atream 85e2cc7bf4

Merge pull request #719 from kvcache-ai/fix-use-generation-json ...

use generation config from json file in official repo

2025-02-27 19:49:41 +08:00

..

configs

update rope calculation; update modeling.py; update gate for moe

2025-02-01 07:32:21 +00:00

ktransformers_ext

Merge pull request #622 from akemimadoka/fix-msvc

2025-02-27 17:42:00 +08:00

models

optimize gguf dequant, save mem, support Q2_K

2025-02-22 06:13:01 +00:00

operators

use generation config from json file in official repo

2025-02-27 11:48:34 +00:00

optimize

Update DeepSeek-V3-Chat-multi-gpu-marlin.yaml

2025-02-26 21:53:50 +08:00

server

Fix according to upstream changes

2025-02-27 18:11:35 +08:00

tests

⚡ update git ignore add docker dev container

2025-02-25 17:22:11 +08:00

util

Merge pull request #719 from kvcache-ai/fix-use-generation-json

2025-02-27 19:49:41 +08:00

website

✨: refactor local_chat and fix message slice bug in server

2024-11-04 14:02:19 +08:00

__init__.py

⚡ release v0.2.2rc1

2025-02-25 22:06:36 +08:00

local_chat.py

use generation config from json file in official repo

2025-02-27 11:48:34 +00:00