@sigit / SiGit-Coder-1.5B-GGUF

Local code-completion model behind the siGit editor's inline suggestions.

Text Generation gguf License: apache-2.0 text-generation code code-completion gguf

SiGit-Coder-1.5B-GGUF

A small, fast code-completion model that powers inline suggestions in the siGit Code & Deploy editor. GGUF quantizations run locally with llama.cpp, so completions stay on your machine.

Quant table

File Quant Size Notes
SiGit-Coder-1.5B-Q8_0.gguf Q8_0 1.6 GB Best quality
SiGit-Coder-1.5B-Q5_K_M.gguf Q5_K_M 1.1 GB Balanced
SiGit-Coder-1.5B-Q4_K_M.gguf Q4_K_M 1.0 GB Recommended default

Run it

llama-cli -hf sigit/SiGit-Coder-1.5B-GGUF -p "def fib(n):"