What it does
This skill covers the GGUF model format and llama.cpp quantization, which are used for efficient CPU and GPU inference. It supports quantization from 2 to 8 bits.
It is intended for deploying models on consumer hardware and Apple Silicon, or for flexible quantization where no GPU is available. The skill is released under the MIT license.
Safety
Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.
- Runs code or changes an assistant's behaviour
Sources
- AI Templates (aitmpl) first seen 13 Nov 2026 · last seen 18 Nov 2026 · its page on the source · figures reported by the source: aitmpl downloads 51
optimization-gguf
GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.
v1.0.0As shown on www.aitmpl.com when we last read it