RYDE-WORK/ktransformers
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/ktransformers.git synced 2026-02-06 06:23:15 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Mingxing Zhang 2024-07-27 23:12:00 +08:00 committed by GitHub
parent 01df4a6b3f
commit 935c28c277
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 14 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
README.md
View File

@ -26,20 +26,14 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin
<h2 id="show-cases">🔥 Show Cases</h2> <h2 id="show-cases">🔥 Show Cases</h2>
<h3>GPT-4-level Local VSCode Copilot on a Desktop with only 24GB VRAM</h3> <h3>GPT-4-level Local VSCode Copilot on a Desktop with only 24GB VRAM</h3>
<p align="center"> <p align="center">
https://github.com/user-attachments/assets/38ee32c7-4280-4563-b068-78181f9c3694
Uploading ktransformers_vs_llamacpp.mp4…
</p> </p>
- **Local 236B DeepSeek-Coder-V2:** Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM, attainable on a local desktop machine, which scores even better than GPT4-0613 in [BigCodeBench](https://huggingface.co/blog/leaderboard-bigcodebench). - **Local 236B DeepSeek-Coder-V2:** Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM, attainable on a local desktop machine, which scores even better than GPT4-0613 in [BigCodeBench](https://huggingface.co/blog/leaderboard-bigcodebench).
<p align="center"> <p align="center">
<picture> <picture>
<img alt="DeepSeek-Coder-V2 Score" src="https://github.com/user-attachments/assets/81efb94f-f859-4413-b6e0-d986508ad667" width=80%> <img alt="DeepSeek-Coder-V2 Score" src="https://github.com/user-attachments/assets/6adb26bd-719a-4b77-9513-8e1b4e79b52b" width=80%>
</picture> </picture>
</p> </p>
@ -47,15 +41,9 @@ Uploading ktransformers_vs_llamacpp.mp4…
- **VSCode Integration:** Wrapped into an OpenAI and Ollama compatible API for seamless integration as a backend for [Tabby](https://github.com/TabbyML/tabby) and various other frontends. - **VSCode Integration:** Wrapped into an OpenAI and Ollama compatible API for seamless integration as a backend for [Tabby](https://github.com/TabbyML/tabby) and various other frontends.
<p align="center"> <p align="center">
<!-- <img alt="Tabby integration" src="https://XXXX.png" width=55%> -->
https://github.com/user-attachments/assets/4cf59f33-8f67-4806-a5c0-540e49bb8305 https://github.com/user-attachments/assets/4cf59f33-8f67-4806-a5c0-540e49bb8305
</p> </p>