Azure 2c0cce90d0 add fp8 multi gpu yaml example

2025-02-25 13:32:09 +00:00

..

configs

update rope calculation; update modeling.py; update gate for moe

2025-02-01 07:32:21 +00:00

ktransformers_ext

Merge remote-tracking branch 'upstream/develop-0.2.2' into support-fp8

2025-02-24 11:58:10 +00:00

models

optimize gguf dequant, save mem, support Q2_K

2025-02-22 06:13:01 +00:00

operators

Merge remote-tracking branch 'upstream/develop-0.2.2' into support-fp8

2025-02-24 11:58:10 +00:00

optimize

add fp8 multi gpu yaml example

2025-02-25 13:32:09 +00:00

server

Update doc

2025-02-25 08:21:18 +00:00

tests

Merge remote-tracking branch 'upstream/develop-0.2.2' into support-fp8

2025-02-24 11:58:10 +00:00

util

Merge remote-tracking branch 'upstream/develop-0.2.2' into support-fp8

2025-02-24 11:58:10 +00:00

website

✨: refactor local_chat and fix message slice bug in server

2024-11-04 14:02:19 +08:00

__init__.py

🔖 release v0.2.1.post1

2025-02-18 20:45:48 +08:00

local_chat.py

Update doc

2025-02-25 08:21:18 +00:00