Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

40,380

Full-text search

Active filters: 4-bit

huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit

Text Generation • 353B • Updated 9 days ago • 883 • 16

Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32

Text-to-Image • Updated 8 days ago • 21.4k • 45

mlx-community/GLM-4.6V-Flash-4bit

Image-Text-to-Text • Updated 4 days ago • 825 • 5

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21 • 531k • 42

huihui-ai/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-4bit

Text Generation • 80B • Updated 2 days ago • 1.74k • 3

mlx-community/GLM-4.6V-4bit

Image-Text-to-Text • Updated 3 days ago • 411 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 54.2k • 592

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • 4B • Updated Nov 12, 2024 • 14.4k • 13

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6 • 181k • 95

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • 12B • Updated Apr 6 • 3.84k • 22

IDEA-Research/Rex-Omni-AWQ

4B • Updated Oct 31 • 1.95k • 3

nightmedia/gpt-oss-120b-heretic-v2-mxfp4-q8-hi-mlx

Text Generation • 117B • Updated 22 days ago • 897 • 6

Disty0/FLUX.2-dev-SDNQ-uint4-svd-r32

Updated 8 days ago • 620 • 11

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 271B • Updated 12 days ago • 241 • 2

QuantTrio/DeepSeek-V3.2-Speciale-AWQ

Text Generation • 685B • Updated 8 days ago • 149 • 4

MaziyarPanahi/Hermes-4.3-36B-GGUF

Text Generation • 36B • Updated 5 days ago • 17.4k • 2

steampunque/Ministral-3-3B-Instruct-2512-Hybrid-GGUF

3B • Updated 4 days ago • 146 • 2

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated 4 days ago • 12.7k • 2

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 135 • 68

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 10.4k • 267

TheBloke/Octocoder-GPTQ

Text Generation • 16B • Updated Sep 27, 2023 • 25 • 8

jxy/Tongyi-Finance-14B-Chat-Int4

Text Generation • Updated Nov 25, 2023 • 12 • 2

TheBloke/saiga_mistral_7b-AWQ

Text Generation • 7B • Updated Nov 28, 2023 • 154 • 4

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 47B • Updated Dec 14, 2023 • 345k • 140

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 7B • Updated Dec 11, 2023 • 31k • 55

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • 4B • Updated Nov 22, 2024 • 10.9k • 34

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • 4B • Updated Sep 11, 2024 • 534 • 7

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 182k • 80

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 5B • Updated Feb 15 • 295k • 89

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 115k • 40