GitHub - goccy/go-llama: llama.cpp in pure Go

llama.cpp in pure Go — run GGUF models anywhere Go runs. No cgo, no shared library, one static binary. The inference engine is llama.cpp compiled to WebAssembly and then translated to Go — no wasm runtime is involved at run time — built on the llamawasm2go module. package main import ( "fmt" llama "github.com/goccy/go-llama" ) func main() { inst, err := llama.New() if err != nil { panic(err) } def

[pchatsu]

via https://x.com/goccy54/status/2092156440786186315