Distributed document RAG system with intelligent GPU/CPU orchestration. Auto-discovers heterogeneous nodes, routes workloads adaptively, and achieves 60x+ speedups through VRAM-aware load balancing. Privacy-first architecture with 4 interfaces (CLI, API, MCP, Web UI). Real distributed systems engineering, not just an API wrapper.
python api cli mcp web-ui auto-discovery semantic-search document-processing load-balancing privacy-first rag heterogeneous-computing vector-database llm chromadb ollama gpu-orchestration distributed-rag vram-aware workload-orchestration
- Updated
Oct 17, 2025 - Python