Add go-llama.cpp backend
This commit is contained in:
parent
9b80f6733d
commit
2a335176e6
5 changed files with 99 additions and 1 deletions
|
|
@ -36,3 +36,6 @@ To start, generate main.go.
|
|||
# GGUF
|
||||
|
||||
https://huggingface.co/QuantFactory/SmolLM-135M-GGUF/resolve/main/SmolLM-135M.Q8_0.gguf?download=true
|
||||
|
||||
# TODO:
|
||||
Consider using llama-server instead?
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue