diff --git a/README.md b/README.md index a4bc878..db39365 100644 --- a/README.md +++ b/README.md @@ -26,20 +26,14 @@ Our vision for KTransformers is to serve as a flexible platform for experimentin

🔥 Show Cases

GPT-4-level Local VSCode Copilot on a Desktop with only 24GB VRAM

- - -Uploading ktransformers_vs_llamacpp.mp4… - - - - +https://github.com/user-attachments/assets/38ee32c7-4280-4563-b068-78181f9c3694

- **Local 236B DeepSeek-Coder-V2:** Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM, attainable on a local desktop machine, which scores even better than GPT4-0613 in [BigCodeBench](https://huggingface.co/blog/leaderboard-bigcodebench).

- DeepSeek-Coder-V2 Score + DeepSeek-Coder-V2 Score

@@ -47,14 +41,8 @@ Uploading ktransformers_vs_llamacpp.mp4… - **VSCode Integration:** Wrapped into an OpenAI and Ollama compatible API for seamless integration as a backend for [Tabby](https://github.com/TabbyML/tabby) and various other frontends.

- - - https://github.com/user-attachments/assets/4cf59f33-8f67-4806-a5c0-540e49bb8305 - - -