Georgi Gerganov faf69d4237

llama : sanitize invalid tokens (#9357) ...

* common : do not add null tokens during warmup

ggml-ci

* llama : check that the input tokens are valid

ggml-ci

* tests : fix batch size of bert model

ggml-ci

2024-09-08 00:33:13 +03:00

..

cmake

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

CMakeLists.txt

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

common.cpp

llama : sanitize invalid tokens (#9357)

2024-09-08 00:33:13 +03:00

common.h

common : refactor arg parser (#9308)

2024-09-07 20:43:51 +02:00

console.cpp

check C++ code with -Wmissing-declarations (#3184)

2023-09-15 15:38:27 -04:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

json-schema-to-grammar.cpp

json: restore default additionalProperties to false, fix some pattern escapes (#8180)

2024-06-28 09:26:45 +01:00

json-schema-to-grammar.h

JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)

2024-05-08 21:53:08 +02:00

json.hpp

json-schema-to-grammar improvements (+ added to server) (#5978)

2024-03-21 11:50:43 +00:00

log.h

infill : assert prefix/suffix tokens + remove old space logic (#8351)

2024-07-08 09:34:35 +03:00

ngram-cache.cpp

Fixed lookup compilation issues on Windows (#6273)

2024-03-24 14:21:17 +01:00

ngram-cache.h

lookup: fibonacci hashing, fix crashes (#8548)

2024-07-17 23:35:44 +02:00

sampling.cpp

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

sampling.h

llama : refactor sampling v2 (#9294)

2024-09-07 15:16:19 +03:00

stb_image.h

common : Update stb_image.h to latest version (#9161)

2024-08-27 08:58:50 +03:00

train.cpp

train : change default FA argument (#7528)

2024-05-25 15:22:35 +03:00

train.h

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00