mirror of
https://github.com/RYDE-WORK/llama.cpp.git
synced 2026-01-20 21:53:39 +08:00
Change the code to do 16b loads when possible and extract the appropriate component late, so the code is effectively decoding a pair of elements and then selecting one. This can allow more commoning to happen in the compiler when neighboring elements are loaded.