RYDE-WORK/llama.cpp
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/llama.cpp.git synced 2026-01-24 08:33:17 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
llama.cpp/ggml/src
History
Diego Devesa a394039db0
ggml-cpu : add chunking support to mul_mat_id (#11666) 
* ggml-cpu : add chunking support to mul_mat_id

* allocate chunk counter in wdata
parallelize src1 quantization by column to allows parallelization even when there is only one row

* disable for arm

* cleanup

* better way to disable for arm

* fix uninitialized counter when using 1 thread only

* revert test-backend-ops changes
2025-02-13 01:02:38 +01:00
..
ggml-blas
ggml : add support for dynamic loading of backends (#10469)
2024-11-25 15:13:39 +01:00
ggml-cann
llama : add Qwen2VL support + multimodal RoPE (#10361)
2024-12-14 14:43:46 +02:00
ggml-cpu
ggml-cpu : add chunking support to mul_mat_id (#11666)
2025-02-13 01:02:38 +01:00
ggml-cuda
HIP: Remove GCN from list of devices that avoid MMQ (#11831)
2025-02-12 22:25:28 +01:00
ggml-hip
HIP: force max threads per block to be 1024 (#11621)
2025-02-04 19:18:38 +01:00
ggml-kompute
llama : add Qwen2VL support + multimodal RoPE (#10361)
2024-12-14 14:43:46 +02:00
ggml-metal
metal : avoid breaking build when metal API predates TARGET_OS_VISION (#11690)
2025-02-06 09:52:31 +08:00
ggml-musa
CUDA: use mma PTX instructions for FlashAttention (#11583)
2025-02-02 19:31:09 +01:00
ggml-opencl
common, examples, ggml : fix MSYS2 GCC compiler errors and warnings when building with LLAMA_CURL=ON and GGML_OPENCL=ON (#11013)
2024-12-31 01:46:06 +01:00
ggml-rpc
rpc: fix known RCE in rpc-server (ggml/1103)
2025-02-06 21:22:54 +02:00
ggml-sycl
SYCL: remove XMX info from print devices (#11712)
2025-02-07 09:27:53 +00:00
ggml-vulkan
vulkan: Make Vulkan optional at runtime (#11493). (#11494)
2025-02-10 07:17:21 +01:00
CMakeLists.txt
ci: use sccache on windows instead of ccache (#11545)
2025-01-31 17:12:40 +00:00
ggml-alloc.c
vulkan: use smaller combined allocations to avoid fragmentation (#11551)
2025-02-06 07:02:18 +01:00
ggml-backend-impl.h
rpc : early register backend devices (#11262)
2025-01-17 10:57:09 +02:00
ggml-backend-reg.cpp
ggml : allow loading backend with env variable (ggml/1059)
2025-01-08 13:40:18 +02:00
ggml-backend.cpp
ggml-backend : only offload from host buffers (fix) (#11124)
2025-01-07 16:11:57 +01:00
ggml-common.h
CUDA: use arch list for compatibility check (#11775)
2025-02-11 00:17:22 +01:00
ggml-impl.h
GGUF: C++ refactor, backend support, misc fixes (#11030)
2025-01-07 18:01:58 +01:00
ggml-opt.cpp
ggml-opt: fix data corruption (ggml/1022)
2024-11-21 09:22:02 +02:00
ggml-quants.c
ggml : refactor online repacking (#10446)
2024-12-07 14:37:50 +02:00
ggml-quants.h
ggml : build backends as libraries (#10256)
2024-11-14 18:04:35 +01:00
ggml-threading.cpp
ggml : build backends as libraries (#10256)
2024-11-14 18:04:35 +01:00
ggml-threading.h
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
ggml.c
fix: typos in documentation files (#11791)
2025-02-10 23:21:31 +01:00
gguf.cpp
cmake : add sanitizer flags for llama.cpp (#11279)
2025-01-18 16:18:15 +02:00