🦙 Ollama Haskell
ollama-haskell is an unofficial Haskell client for Ollama, inspired by ollama-python. It enables interaction with locally running LLMs through the Ollama HTTP API — directly from Haskell.
✨ Features
- 💬 Chat with models
- ✍️ Text generation (with streaming)
- ✅ Chat with structured messages and tools
- 🧠 Embeddings
- 🧰 Model management (list, pull, push, show, delete)
- 🗃️ In-memory conversation history
- ⚙️ Configurable timeouts, retries, streaming handlers
⚡ Quick Example
{-# LANGUAGE OverloadedStrings #-} module Main where import Data.Ollama.Generate import qualified Data.Text.IO as T main :: IO () main = do let ops = defaultGenerateOps { modelName = "gemma3" , prompt = "What is the meaning of life?" } eRes <- generate ops Nothing case eRes of Left err -> putStrLn $ "Something went wrong: " ++ show err Right r -> do putStr "LLM response: " T.putStrLn (genResponse r)
📦 Installation
Add to your .cabal file:
build-depends: base >=4.7 && <5, ollama-haskell
Or use with stack/nix-shell.
📚 More Examples
See examples/OllamaExamples.hs for:
- Chat with conversation memory
- Structured JSON output
- Embeddings
- Tool/function calling
- Multimodal input
- Streaming and non-streaming variants
🛠 Prerequisite
Make sure you have Ollama installed and running locally. Run ollama pull llama3 to download a model.
🧪 Dev & Nix Support
Use Nix:
nix-shell
This will install stack and Ollama.
👨💻 Author
Created and maintained by @tusharad. PRs and feedback are welcome!
🤝 Contributing
Have ideas or improvements? Feel free to open an issue or submit a PR!
