RYDE-WORK/llama.cpp
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/llama.cpp.git synced 2026-01-21 15:11:29 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
llama.cpp/ggml/src
History
Markus Tavenrath daa9623ab0
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. (#9118) 
* Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.

* fix compile issues

* Fix issues where the last submit wasn't executed or handled properly.

* remove trailing whitespace

* Repair GGML_VULKAN_CHECK_RESULTS

* Increase submit counter only if actual work has been submitted and increase submit count to 100.

* Fix some nodes are not checked with GGML_VULKAN_CHECK_RESULTS enabled.
2024-09-08 21:43:48 +02:00
..
ggml-cann
cann : fix doxy (ggml/0)
2024-09-08 11:05:55 +03:00
ggml-cuda
cuda : fix FA Q src index (1 -> 0) (#9374)
2024-09-08 22:01:02 +03:00
ggml-sycl
[SYCL] Fix DMMV dequantization (#9279)
2024-09-04 16:26:33 +01:00
kompute @ 4565194ed7
llama : reorganize source code + improve CMake (#8006)
2024-06-26 18:33:02 +03:00
kompute-shaders
ggml : move rope type enum to ggml.h (#8949)
2024-08-13 21:13:15 +02:00
llamafile
llamafile : disable sgemm for batch-size 1 (#9330)
2024-09-07 22:02:26 +03:00
vulkan-shaders
Improve Vulkan shader build system (#9239)
2024-09-06 08:56:17 +02:00
CMakeLists.txt
Improve Vulkan shader build system (#9239)
2024-09-06 08:56:17 +02:00
ggml-aarch64.c
ggml : AVX2 support for Q4_0_8_8 (#8713)
2024-09-04 19:51:22 +03:00
ggml-aarch64.h
ggml : minor naming changes (#8433)
2024-07-12 10:46:02 +03:00
ggml-alloc.c
ggml : reduce hash table reset cost (#8698)
2024-07-27 04:41:55 +02:00
ggml-backend-impl.h
llama : reorganize source code + improve CMake (#8006)
2024-06-26 18:33:02 +03:00
ggml-backend.c
tests: add gradient tests for all backends (ggml/932)
2024-09-08 11:05:55 +03:00
ggml-blas.cpp
ggml : reduce hash table reset cost (#8698)
2024-07-27 04:41:55 +02:00
ggml-cann.cpp
[CANN]: Fix ggml_backend_cann_buffer_get_tensor (#8871)
2024-08-06 12:42:42 +08:00
ggml-common.h
ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)
2024-09-05 21:48:47 -04:00
ggml-cuda.cu
tests: add gradient tests for all backends (ggml/932)
2024-09-08 11:05:55 +03:00
ggml-impl.h
ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)
2024-09-05 21:48:47 -04:00
ggml-kompute.cpp
ggml : reduce hash table reset cost (#8698)
2024-07-27 04:41:55 +02:00
ggml-metal.m
metal : update support condition for im2col + fix warning (#0)
2024-09-08 11:05:55 +03:00
ggml-metal.metal
sync : ggml
2024-08-27 22:41:27 +03:00
ggml-quants.c
ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)
2024-09-05 21:48:47 -04:00
ggml-quants.h
ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)
2024-09-05 21:48:47 -04:00
ggml-rpc.cpp
rpc : print error message when failed to connect endpoint (#9042)
2024-08-19 10:11:45 +03:00
ggml-sycl.cpp
[SYCL] add check malloc result on device (#9346)
2024-09-08 19:05:29 +08:00
ggml-vulkan.cpp
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. (#9118)
2024-09-08 21:43:48 +02:00
ggml.c
tests: add gradient tests for all backends (ggml/932)
2024-09-08 11:05:55 +03:00