Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,562

Base only

Active filters: quantization

Helllbos/Qwen2.5-7B-Instruct-INT8-Quanto

Text Generation • 8B • Updated Jul 10 • 8

KryptykAngel/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-i1-GGUF

Text Generation • 27B • Updated Jul 11 • 343

aquaman164/MiniMax-M3-VQ-2.4bit

Text Generation • 39B • Updated Jul 11 • 66

BCCard/MoAI-gemma-4-31B-it-mxfp4

18B • Updated Jul 12 • 226

realrebelai/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated Jul 12 • 777 • 12

Litwein/Qwable-v2-oQ4e-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 6B • Updated Jul 11 • 418 • 3

Danny-Dasilva/gemma-4-12B-it-antidoom-W4A16-GPTQ-g32-DSpark

Text Generation • 12B • Updated Jul 11 • 384

Litwein/Qwable-v2-oQ4e-DWQ-MTP-MLX

Text Generation • 6B • Updated Jul 11 • 161

maczzinatui/Tess-4-27B-ROCmFP4_FAST-GGUF

27B • Updated Jul 11 • 180 • 1

maczzinatui/Tess-4-27B-TQ3_4S-GGUF

27B • Updated Jul 11 • 15 • 1

maczzinatui/ThinkingCap-Qwen3.6-27B-TQ3_4S-GGUF

27B • Updated Jul 11 • 116 • 2

FarhanAK128/Optipros

BCCard/MoAI-gemma-4-12B-it-mxfp4

7B • Updated Jul 12 • 67

alenisaw/turkicocr-svtrv2-b-int8

Image-to-Text • Updated 1 day ago • 8

lite-infer/flux.1-kontext-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Image-to-Image • 5B • Updated Jul 12 • 2

lite-infer/flux.1-kontext-dev-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Image-to-Image • 6B • Updated Jul 12 • 2

lite-infer/flux.1-schnell-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 12

lite-infer/flux.1-schnell-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 6B • Updated Jul 12 • 13

lite-infer/flux.1-krea-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 8

lite-infer/flux.1-krea-dev-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 6B • Updated Jul 12 • 7

lite-infer/flux.1-dev-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 5B • Updated Jul 12 • 29

lite-infer/flux.1-dev-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 6B • Updated Jul 12 • 5

thisisaditichouhan/Phi-2-4bit-Quantized-Model

Text Generation • Updated Jul 12 • 1 • 1

lite-infer/z-image-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 3B • Updated Jul 12 • 42

lite-infer/z-image-turbo-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 4B • Updated Jul 12 • 18

SC117/Ornith-1.0-35B-Heretic-MTP

Text Generation • 665k • Updated Jul 12 • 776 • 2

adrahmana/NanoFable-1M-fp16

Text Generation • 1.38M • Updated Jul 13 • 69

adrahmana/NanoFable-6M-fp16

Text Generation • 5.87M • Updated Jul 13 • 73

adrahmana/NanoFable-16M-fp16

Text Generation • 15.7M • Updated Jul 13 • 74

developerabu/IndicF5-MNN

Text-to-Speech • Updated Jul 13