#

cpu-inference

Here are 4 public repositories matching this topic...

lucienhuangfu / eLLM

eLLM Infers LLM on CPUs in Real Time

llama cpu-inference deep-thinking llm-infernece deep-research context-engineering rust-llm

Updated Oct 29, 2025
Rust

yybit / pllm

Portable LLM - A rust library for LLM inference

cpu-inference aigc llm llama2

Updated Apr 13, 2024
Rust

codito / arey

Simple large language model playground app

cli ai mistral cpu-inference large-language-models llm local-model llamacpp llama2 gguf

Updated Oct 27, 2025
Rust

JohnClaw / chatllm.rs

rust api wrapper for llm-inference chatllm.cpp

rust chatbot inference bindings api-wrapper llama quantization gemma mistral cpu-inference llm llms chatllm ggml llm-inference qwen

Updated Nov 27, 2024
Rust

Improve this page

Add a description, image, and links to the cpu-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the cpu-inference topic, visit your repo's landing page and select "manage topics."