llama.cpp

mirror of https://github.com/RYDE-WORK/llama.cpp.git synced 2026-01-19 21:23:26 +08:00

History

llama : fix time complexity of string replacement (#9163 )

This change fixes a bug where replacing text in a very long string could
cause llama.cpp to hang indefinitely. This is because the algorithm used
was quadratic, due to memmove() when s.replace() is called in a loop. It
seems most search results and LLM responses actually provide the O(n**2)
algorithm, which is a great tragedy. Using a builder string fixes things

2024-08-26 09:09:53 +03:00

CMakeLists.txt

llama : move vocab, grammar and sampling into separate files (#8508 )

2024-07-23 13:10:17 +03:00

llama-grammar.cpp

ggml : reduce hash table reset cost (#8698 )

2024-07-27 04:41:55 +02:00

llama-grammar.h

llama : fix build + fix fabs compile warnings (#8683 )

2024-07-25 19:57:31 +03:00

llama-impl.h

llama : fix time complexity of string replacement (#9163 )