AI & New Tech

Transformers now runs GGUF quantized models from llama.cpp natively

Hugging Face integrated llama.cpp's ggml kernels into the transformers library, allowing GGUF checkpoints to be loaded directly with from_pretrained and run local inference on Apple Silicon without leaving the PyTorch ecosystem.