InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →
Top 23 Rust AI Projects
-
-
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
-
Tabby is a modern terminal emulator that emphasizes usability and extensibility.
-
tensorzero
TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.
Project mention: Supervised Fine Tuning on Curated Data Is Reinforcement Learning | news.ycombinator.com | 2025-07-29[I'm his coworker.] We ran Unsloth ourselves on a GPU-by-the-hour server. We have a notebook in the repository showing how to query historical data and use it with Unsloth.
It's a WIP PR that we plan to merge soon: https://github.com/tensorzero/tensorzero/pull/2273
-
databend
One Warehouse for Analytics, Search, AI. Snowflake + Elasticsearch + Vector DB — rebuilt from scratch. Unified architecture on your S3.
Check out what we're building at https://github.com/databendlabs/databend.
-
aichat
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
Project mention: Show HN: qqqa – a fast, stateless LLM-powered assistant for your shell | news.ycombinator.com | 2025-11-06Feel like this might have already been done and beyond by aichat (which I give the alias `ai` on my machines)
https://github.com/sigoden/aichat
-
meeting-minutes
Open-source Rust based AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted Ai meeting note taker for macOS & Windows.
Download Free → | Star on GitHub →
-
code2prompt
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
Project mention: Revolutionizing LLM Interactions: Code2Prompt – Your Code's New AI Assistant | dev.to | 2025-06-29View the Project on GitHub
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
-
superagent
Superagent provides purpose-trained guardrails that make AI-agents secure and compliant. (by superagent-ai)
Project mention: Show HN: Local Privacy Firewall-blocks PII and secrets before ChatGPT sees them | news.ycombinator.com | 2025-12-09 -
deepreasoning
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
If you would like to see the CoT process visualized, try the “Improve prompt” feature in Anthropic console. Also check out https://github.com/getAsterisk/deepclaude
-
During one of our internal weekly meetings at work, we decided that we wanted to get Rig to JavaScript so that we can run it in the browser and in Node applications. Of course, there was a potential tonne of code rewriting to do if we were to write it entirely from TypeScript. Therefore, we ended up using WASM to port the inner core to TypeScript and then using manual glue code from TypeScript to be able to finish off the parts that couldn't be done directly through the Rust-WASM bridge.
-
> what does the rag for uploaded files do in discourse?
You can upload files that will act as RAG files for an AI bot. The bot can also have access to forum content, plus the ability to run tools in our sandboxed JS environment, making it possible for Discourse to host AI bots.
> also, when i run a discourse search does it really do both a regular keyword search and a vector search? how do you combine results?
Yes, it does both. In the full page search it does keyword first, then vector asynchronously, which can be toggled by the user in the UI. It's auto toggled when keyword has zero results now. Results are combined using reciprocal rank fusion.
In the quick header search we simply append vector search to keyword search results when keyword returns less than 4 results.
> does all discourse instances have those features? for example, internals.rust-lang.org, do they use pgvector?
Yes, all use PGvector. In our hosting all instances default to having the vector features enabled, we run embeddings using https://github.com/huggingface/text-embeddings-inference
- Project mention: Microsandbox: Virtual Machines that feel and perform like containers | news.ycombinator.com | 2025-05-30
This is very neat tech, but I think you might want to wait until you actually have Windows covered before making claims like https://github.com/microsandbox/microsandbox/blob/main/MSB_V...
-
cocoindex
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
Project mention: Build a Real-Time Codebase Index in 5 Minutes with CocoIndex (Rust + Tree-sitter) | dev.to | 2025-12-14 -
lsp-ai
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
Unless something's changed, every AI-backed language server I've tried in Helix suffers from the same limitation when it comes to completions: Suggestions aren't shown until the last language server has responded or timed-out. Your slowest language server determines how long you'll be waiting.
The only project I know of that recognizes this is https://github.com/SilasMarvin/lsp-ai, which pivoted away from completions to chat interactions via code actions.
- Project mention: Ask HN: Looking for Headless CMS Recommendation | news.ycombinator.com | 2025-09-03
-
-
Oh yeah, it can certainly work, sounds like cool stuff! The question is not whether it can work, but whether it works better than an edit tool using textual search/replace blocks. Not to throw shade on the idea, there's certainly tons of variations that I'm sure haven't yet been tried.
Yes agentic loop with diagnostic feedback is quite powerful. I'd love to have more controllable structured decode from the big llm providers to skip some sources of needing to loop - something like https://github.com/microsoft/aici
-
-
amazon-q-developer-cli
✨ Agentic chat experience in your terminal. Build applications using natural language.
Project mention: Measuring Chat Count After Hitting the Amazon Q Developer (Claude Sonnet 4) Pro Limit | dev.to | 2025-08-30 - Project mention: Building Sentence Transformers in Rust: A Practical Guide with Burn, ONNX Runtime, and Candle | dev.to | 2025-10-30
ONNX Runtime Rust: https://ort.pyke.io
-
-
korvus
Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).
Rust AI discussion
Rust AI related posts
-
Build a Real-Time Codebase Index in 5 Minutes with CocoIndex (Rust + Tree-sitter)
-
10,000 eBPF Events to 1 Alert: Don’t burn the CPU
-
My hands-on experience with Qdrant and Docling (and Ollama)
-
I Built a Rust Data Engine That Hit #1 Trending — Here's What Actually Worked
-
From Catalog Chaos to Real-Time Recommendations: Building a Product Graph with LLMs and Neo4j
-
How I Built a Self-Updating Neo4j Knowledge Graph from Meeting Notes (That Saves 99% on LLM Costs)
-
I Turned My Meeting Notes Into a Self-Updating Neo4j Knowledge Graph
- A note from our sponsor - InfluxDB www.influxdata.com | 22 Dec 2025
Index
What are some of the best open-source AI projects in Rust? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | ChatGPT | 54,338 |
| 2 | tabby | 32,596 |
| 3 | tensorzero | 10,721 |
| 4 | databend | 9,046 |
| 5 | aichat | 8,890 |
| 6 | meeting-minutes | 8,877 |
| 7 | code2prompt | 6,895 |
| 8 | postgresml | 6,651 |
| 9 | superagent | 6,293 |
| 10 | deepreasoning | 5,362 |
| 11 | rig | 5,209 |
| 12 | text-embeddings-inference | 4,319 |
| 13 | microsandbox | 4,202 |
| 14 | cocoindex | 4,029 |
| 15 | lsp-ai | 3,074 |
| 16 | trieve | 2,578 |
| 17 | floneum | 2,103 |
| 18 | aici | 2,058 |
| 19 | chat-ai-desktop | 2,013 |
| 20 | amazon-q-developer-cli | 1,852 |
| 21 | ort | 1,820 |
| 22 | smartgpt | 1,755 |
| 23 | korvus | 1,456 |
Sponsored
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io