compilade ee52225067

convert-hf : support direct Q8_0 conversion (#7234) ...

* convert-hf : support q8_0 conversion

* convert-hf : add missing ftype

This was messing with the checksums otherwise.

* convert-hf : add missing ftype to Baichuan and Xverse

I didn't notice these on my first pass.

2024-05-13 14:10:51 -04:00

..

__init__.py

convert-hf : support direct Q8_0 conversion (#7234)

2024-05-13 14:10:51 -04:00

constants.py

convert-hf : support bfloat16 conversion (#7158)

2024-05-11 11:06:26 -04:00

gguf_reader.py

convert-hf : save memory with lazy evaluation (#7075)

2024-05-08 18:16:38 -04:00

gguf_writer.py

convert-hf : support direct Q8_0 conversion (#7234)

2024-05-13 14:10:51 -04:00

gguf.py

gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)

2023-11-11 08:04:50 +03:00

lazy.py

convert-hf : support direct Q8_0 conversion (#7234)

2024-05-13 14:10:51 -04:00

py.typed

convert : various script cleanups/fixes + merges and special token handling (#2842)

2023-08-30 11:25:50 +03:00

quants.py

convert-hf : support direct Q8_0 conversion (#7234)

2024-05-13 14:10:51 -04:00

tensor_mapping.py

llama : add Jina Embeddings architecture (#6826)

2024-05-11 10:46:09 +03:00

vocab.py

convert-hf : save memory with lazy evaluation (#7075)

2024-05-08 18:16:38 -04:00