Tooling for Vercel AI SDK: enable tool calling with models lacking native tools, plus evaluation utilities.

• @ai-sdk-tool/parser: add tool-calling via middleware; works with any provider supported by AI SDK wrapLanguageModel.
• @ai-sdk-tool/eval: benchmarks and evaluation helpers (BFCL, JSON generation).

Note: Requires AI SDK v5. For AI SDK v4, use @ai-sdk-tool/parser@1.0.0.

• packages/parser — core tool‑call parsing middleware and prebuilt middlewares (gemmaToolMiddleware, hermesToolMiddleware, morphXmlToolMiddleware).
  • Quickstarts: packages/parser/README.md
  • Official docs reference: Custom tool call parser
• packages/eval — evaluation utilities (BFCL, JSON generation).
  – Quickstarts: packages/eval/README.md

• gemmaToolMiddleware: JSON tool calls inside markdown fences. Best for Gemma-like models.
• morphXmlToolMiddleware: Plain XML tool calls. Good fit for GLM/GLM-like models.
• hermesToolMiddleware: JSON payload wrapped in <tool_call> XML tags. Hermes/Llama-style prompts.

pnpm add @ai-sdk-tool/parser pnpm add @ai-sdk-tool/eval

import { wrapLanguageModel, streamText } from "ai"; import { createOpenAICompatible } from "@ai-sdk/openai-compatible"; import { gemmaToolMiddleware } from "@ai-sdk-tool/parser"; const client = createOpenAICompatible({ /* baseURL, apiKey */ }); const result = streamText({ model: wrapLanguageModel({ model: client("google/gemma-3-27b-it"), middleware: gemmaToolMiddleware, }), tools: { /* your tools */ }, prompt: "Find weather for Seoul today", }); for await (const part of result.fullStream) { // handle text and tool events }

• Parser examples: examples/parser-core/src/ (streaming/non‑streaming, tool choice variants)
• Eval examples: examples/eval-core/src/

Run examples locally (after pnpm install at repo root):

cd examples/parser-core && pnpm dlx tsx src/00-stream-tool-call.ts cd examples/eval-core && pnpm dlx tsx src/bfcl-simple.ts

This is a pnpm workspace managed by Turborepo.

# install deps pnpm install # build/lint/test all packages pnpm build pnpm test pnpm typecheck pnpm lint pnpm lint:fix pnpm fmt pnpm fmt:fix # develop (watch builds) pnpm dev

• Node >= 18
• pnpm 9.x (repo sets packageManager)

cd packages/parser && pnpm test:watch cd packages/eval && pnpm dev

Issues and PRs are welcome. See CONTRIBUTING.md and AGENTS.md for architecture and workflow.

Full docs: docs/index.md

Licensed under Apache License 2.0. See LICENSE for full terms. If you distribute binaries or source, include the NOTICE file as required by the license.