compilade 7acfd4e8d5

convert_hf : faster lazy safetensors (#8482) ...

* convert_hf : faster lazy safetensors

This makes '--dry-run' much, much faster.

* convert_hf : fix memory leak in lazy MoE conversion

The '_lazy' queue was sometimes self-referential,
which caused reference cycles of objects old enough
to avoid garbage collection until potential memory exhaustion.

2024-07-15 23:13:10 -04:00

..

__init__.py

convert-hf : support direct Q8_0 conversion (#7234)

2024-05-13 14:10:51 -04:00

constants.py

Refactor lora adapter support (#8332)

2024-07-15 20:50:47 +02:00

gguf_reader.py

py : type-check all Python scripts with Pyright (#8341)

2024-07-07 15:04:39 -04:00

gguf_writer.py

Refactor lora adapter support (#8332)

2024-07-15 20:50:47 +02:00

gguf.py

gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)

2023-11-11 08:04:50 +03:00

lazy.py

convert_hf : faster lazy safetensors (#8482)

2024-07-15 23:13:10 -04:00

py.typed

convert : various script cleanups/fixes + merges and special token handling (#2842)

2023-08-30 11:25:50 +03:00

quants.py

Refactor lora adapter support (#8332)

2024-07-15 20:50:47 +02:00

tensor_mapping.py

convert_hf : faster lazy safetensors (#8482)

2024-07-15 23:13:10 -04:00

vocab.py

Move convert.py to examples/convert-legacy-llama.py (#7430)

2024-05-30 21:40:00 +10:00