Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

26,322

Full-text search

Active filters: 8-bit

openai/gpt-oss-20b

Text Generation • 22B • Updated Aug 26 • 7.19M • • 4.1k

openai/gpt-oss-120b

Text Generation • 120B • Updated Aug 26 • 3.91M • • 4.27k

cybermotaz/nemotron3-nano-nvfp4-w4a16

Text Generation • 18B • Updated 5 days ago • 1.94k • 5

openai/gpt-oss-safeguard-20b

Text Generation • 22B • Updated Oct 29 • 42.2k • • 164

Firworks/NVIDIA-Nemotron-3-Nano-30B-A3B-nvfp4

18B • Updated 6 days ago • 685 • 3

lmstudio-community/functiongemma-270m-it-MLX-8bit

Text Generation • 75.4M • Updated 5 days ago • 1.61k • 3

microsoft/bitnet-b1.58-2B-4T

Text Generation • 0.8B • Updated 6 days ago • 8k • 1.23k

lmstudio-community/gpt-oss-20b-MLX-8bit

Text Generation • 21B • Updated Aug 5 • 2.43k • 46

openai/gpt-oss-safeguard-120b

Text Generation • 120B • Updated Oct 29 • 23.5k • 73

FabioSarracino/VibeVoice-Large-Q8

Text-to-Audio • 9B • Updated Oct 1 • 2.8k • 68

eousphoros/DeepSeek-V3.2-NVFP4

Text Generation • 387B • Updated 20 days ago • 458 • 5

mlx-community/GLM-4.7-8bit

Text Generation • 353B • Updated about 4 hours ago • 105 • 2

Salyut1/GLM-4.7-NVFP4

Text Generation • 177B • Updated about 11 hours ago • 122 • 2

mlx-community/GLM-4.7-8bit-gs32

Text Generation • 353B • Updated about 1 hour ago • 2

MaziyarPanahi/gemma-2b-GGUF

Text Generation • 3B • Updated Feb 27, 2024 • 2.65k • 7

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • 141B • Updated Apr 18, 2024 • 2.75k • 34

MaziyarPanahi/Llama-3-8B-Instruct-v0.1-GGUF

Text Generation • 8B • Updated May 4, 2024 • 421 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 164k • 129

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • 1B • Updated Sep 4, 2024 • 151k • 16

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • 3B • Updated Sep 19, 2024 • 1.25k • 197

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • 22B • Updated Sep 13, 2024 • 150k • 27

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated Oct 18, 2024 • 7.24k • 17

MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF

Text Generation • 22B • Updated Jan 1 • 153k • 3

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23 • 155k • 8

Zoont/faster-whisper-large-v3-turbo-int8-ct2

Automatic Speech Recognition • Updated Jan 31 • 308 • 13

RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • 8B • Updated Feb 27 • 5.34k • 5

nvidia/DeepSeek-R1-NVFP4

Text Generation • 397B • Updated Jun 6 • 30.2k • 267

Tonic/GemmaX2-28-2B-8bit

Translation • 3B • Updated Feb 26 • 6 • 1

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12 • 154k • 13

unsloth/Llama-4-Scout-17B-16E-unsloth-bnb-8bit

Any-to-Any • 109B • Updated Apr 23 • 58 • 4