ceerrep db61375f1a Merge remote-tracking branch 'kvai/main' into server-prefix-cache

2025-02-18 17:51:22 +08:00

..

configs

update rope calculation; update modeling.py; update gate for moe

2025-02-01 07:32:21 +00:00

ktransformers_ext

toy support for experts on GPU, no CUDA Graph

2025-02-15 15:16:00 +00:00

models

Merge branch 'fix_precision_MLA' of https://github.com/kvcache-ai/ktransformers into server-prefix-cache

2025-02-17 18:08:04 +08:00

operators

fix: adapt prefix cache in forward_linux_flashinfer

2025-02-18 11:40:15 +08:00

optimize

toy support for experts on GPU, no CUDA Graph

2025-02-15 15:16:00 +00:00

server

⚡ fix device and add test

2025-02-18 12:52:17 +08:00

tests

⚡ add mmlu_pro test

2025-02-18 14:43:38 +08:00

util

fix precision bug imported by position_ids in 0.2.0

2025-02-17 09:23:14 +00:00

website

✨: refactor local_chat and fix message slice bug in server

2024-11-04 14:02:19 +08:00

__init__.py

[feature] update docker image and entrypoint

2025-02-15 07:55:33 +00:00

local_chat.py

fix precision bug imported by position_ids in 0.2.0

2025-02-17 09:23:14 +00:00