liam ddf3339339 ⚡ release v0.2.2rc1

2025-02-25 22:06:36 +08:00

..

configs

update rope calculation; update modeling.py; update gate for moe

2025-02-01 07:32:21 +00:00

ktransformers_ext

fix fp8 multi gpu; update FQA

2025-02-25 10:52:29 +00:00

models

optimize gguf dequant, save mem, support Q2_K

2025-02-22 06:13:01 +00:00

operators

fix-update-flashinfer_wrapper_local_chat

2025-02-25 12:47:31 +00:00

optimize

Merge branch 'develop-0.2.2' into support-fp8

2025-02-25 13:43:26 +00:00

server

Merge pull request #657 from kvcache-ai/feat-absorb-for-long-prefill

2025-02-25 16:53:21 +08:00

tests

⚡ update git ignore add docker dev container

2025-02-25 17:22:11 +08:00

util

fix-update-flashinfer_wrapper_local_chat

2025-02-25 12:47:31 +00:00

website

✨: refactor local_chat and fix message slice bug in server

2024-11-04 14:02:19 +08:00

__init__.py

⚡ release v0.2.2rc1

2025-02-25 22:06:36 +08:00

local_chat.py

Merge pull request #657 from kvcache-ai/feat-absorb-for-long-prefill

2025-02-25 16:53:21 +08:00