Georgi Gerganov 11ac9800af

llama : improve infill support and special token detection (#9798) ...

* llama : improve infill support

ggml-ci

* llama : add more FIM token strings

ggml-ci

* server : update prompt on slot restore (#9800)

* gguf : deprecate old FIM token KVs

2024-10-12 08:21:51 +03:00

..

__init__.py

convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (#7499)

2024-07-18 20:40:15 +10:00

constants.py

llama : improve infill support and special token detection (#9798)

2024-10-12 08:21:51 +03:00

gguf_reader.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

gguf_writer.py

llama : improve infill support and special token detection (#9798)

2024-10-12 08:21:51 +03:00

gguf.py

gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)

2023-11-11 08:04:50 +03:00

lazy.py

gguf-py : simplify support for quant types (#8838)

2024-08-08 13:33:09 -04:00

metadata.py

server : add lora hotswap endpoint (WIP) (#8857)

2024-08-06 17:33:39 +02:00

py.typed

convert : various script cleanups/fixes + merges and special token handling (#2842)

2023-08-30 11:25:50 +03:00

quants.py

ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)

2024-09-05 21:48:47 -04:00

tensor_mapping.py

convert : refactor rope_freqs generation (#9396)

2024-10-01 09:31:36 +03:00

utility.py

gguf-py : fix some metadata name extraction edge cases (#8591)

2024-07-20 21:58:49 -04:00

vocab.py

convert : handle tokenizer merges format from transformers 4.45 (#9696)

2024-10-03 17:22:15 +03:00