#huggingface

Deploying Gemma 1B GGUF model with llama.cpp on Ubuntu

This is a step-by-step guide on deploying and interacting with quantized gemma 1b from Google using llama-server