RYDE-WORK/llama.cpp
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/llama.cpp.git synced 2026-01-21 06:45:36 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
3,228 Commits 1 Branch 0 Tags
Commit Graph

2 Commits

Author SHA1 Message Date
0cc4m
45c0e2e4c1
Refactor Vulkan backend to allow multiple contexts (#7961) 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
 2024-06-23 10:21:25 +02:00
0cc4m
7c7836d9d4
Vulkan Shader Refactor, Memory Debugging Option (#7947) 
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
 2024-06-16 07:17:31 +02:00