This project lets you use Go for hardware accelerated local inference with llama.cpp directly integrated into your applications via the yzma module. Kronk provides a high-level API that feels similar to using an OpenAI compatible API.

Starter-kit for writing services in Go using Kubernetes.

Go Training Class Material :

Provide examples for Go developers to use AI in their products

Catalog of models that have been verified to be compatible with Kronk. Kronk can work with any GGUF based models that can perform Text Generation, Audio/Image Text to Text, and Embedding.

Arm Class

Package conf provides support for using environmental variables and command line arguments for configuration.

Platform for the liar's dice game