#

llm-inference

Here are 18 public repositories matching this topic...

gitleaks / gitleaks

Find secrets with Gitleaks 🔑

git go cli golang open-source security secret ci-cd cicd hacktoberfest dlp security-tools devsecops data-loss-prevention gitleaks ai-powered llm llm-training llm-inference

Updated Jul 9, 2025
Go

beam-cloud / beta9

Secure, high-performance AI infrastructure in Python.

serverless gpu distributed-computing cuda self-hosted paas faas functions-as-a-service autoscaler fine-tuning developer-productivity cloudrun serverless-containers ml-platform large-language-models llm generative-ai llm-inference

Updated Jul 9, 2025
Go

devflowinc / uzi

CLI for running large numbers of coding agents in parallel with git worktrees

go golang ai parallelization codegen llm llm-inference agentic-ai

Updated Jun 4, 2025
Go

substratusai / runbooks

Finetune LLMs on K8s by using Runbooks

kubernetes kubernetes-operator mlops ml-platform llmops llm-serving llm-training llm-inference

Updated Aug 28, 2024
Go

sgl-project / ome

OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

k8s oracle-cloud model-serving model-as-a-service multi-node-kubernetes llm llm-inference sglang sgl-router

Updated Jul 10, 2025
Go

Hoshinonyaruko / Gensokyo-llm

开源的智能体项目支持6种聊天平台 Onebotv11一对多连接流式信息 agent 对话keyboard气泡生成支持10+大模型接口(持续更新) 具有将多种大模型接口转化为带有上下文的通用格式的能力.

chatbot qqbot ai-agents onebot onebot-plugin llm onebot11 llm-inference ai-agents-framework llm-api

Updated Sep 6, 2024
Go

Climatik-Project / Climatik-Project

Carbon Limiting Auto Tuning for Kubernetes

kubernetes sustainability kepler kubernetes-operator power-capping green-computing keda kserve llm vllm llm-inference

Updated Nov 11, 2024
Go

Lifailon / openrouter-bot

This project allows to launch your Telegram bot in a few minutes to communicate with free or paid AI models via OpenRouter.

go ai gpt chat-bot telegrambot llm llm-inference openrouter ai-integration

Updated Jul 2, 2025
Go

RamboRogers / cyberai

WebUI for OpenAI, Ollama and Anthropic

golang-application webui-based llm llm-inference

Updated May 30, 2025
Go

ket0x4 / ket.ai

Overengineered telegram bot that functions as a chatbot

go ai telegram telegram-bot python3 web-scraping llm-inference

Updated Jul 9, 2025
Go

im-knots / ea-monorepo

An AI agent workflow engine designed for scale

golang machine-learning nextjs kubernetes-operator low-code ai-agents platform-engineering api-wrappers llm-inference ai-agents-framework

Updated May 30, 2025
Go

liuy / wukong

Democratizing AI Innovation to the Masses on Commodity Hardware

agent golang high-performance llm-inference

Updated Mar 13, 2025
Go

muzzlol / nomodit

A tui/cli tool for interfacing with a LLM fine-tuned on various language tasks. It emphasizes on making the user see the changes made in order to learn

go cli tui bubbletea llm llm-training llm-inference diffing-algorithm

Updated Jun 29, 2025
Go

inference-gateway / operator

This project provides a Kubernetes Operator for managing the lifecycle of the inference-gateway and its related components. It simplifies deployment, configuration, and scaling of the gateway within Kubernetes clusters, enabling seamless integration of inference workflows.

kubernetes operator kubernetes-operator vendor-agnostic llm llm-inference inference-gateway

Updated Jun 28, 2025
Go

nullxjx / LLM-Profiler

LLM-Profiler is a tool for evaluating the performance of online serving engine for LLMs

profiling llm-inference

Updated Mar 22, 2025
Go

denarsh / aiscalerctrl

AI based Kubernetes deployment autoscaler

kubernetes ai autoscaling llm llm-inference

Updated Jul 9, 2025
Go

plastic-plant / fhir-gpt

Enriching health care data with prompt generated summaries.

go svelte fhir-server llm-inference

Updated Aug 31, 2024
Go

contenox / runtime-mvp

runtime for agent-based applications, conversational interfaces, and knowledge-grounded automation

go gemini openai workflows semantic-search orchestrator llm vllm llm-inference ollama

Updated Jul 9, 2025
Go

Improve this page

Add a description, image, and links to the llm-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-inference topic, visit your repo's landing page and select "manage topics."