GGML has been replaced with GGUF now and GGML is no longer getting any updates. ...

		smcleod on Oct 16, 2023 \| parent \| context \| favorite \| on: GPU Embedding with GGML GGML has been replaced with GGUF now and GGML is no longer getting any updates. GPU offloading for GGUF/GGML has been available for quite a long time in Text Generation WebUI and works very well, but isn’t nearly as fast as GPTQ or the new AWQ format.

GGUF is the file format, but GGML is still the framework