Add go-llama.cpp backend

This commit is contained in:
Chandler Swift 2025-12-17 22:39:18 -06:00
parent 9b80f6733d
commit 2a335176e6
5 changed files with 99 additions and 1 deletions

View file

@ -36,3 +36,6 @@ To start, generate main.go.
# GGUF
https://huggingface.co/QuantFactory/SmolLM-135M-GGUF/resolve/main/SmolLM-135M.Q8_0.gguf?download=true
# TODO:
Consider using llama-server instead?