Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,563

Base only

Active filters: quantization

mradermacher/Ornith-1.0-35B-Heretic-MTP-i1-GGUF

36B • Updated Jul 14 • 1.46k • 2

Majipa/Qwen3-0.6B-GGUF-Quantized

Text Generation • 0.8B • Updated Jul 13 • 291 • 2

gvij/parakeet-tdt-0.6b-v3-onnx-static-qdq-pc

Automatic Speech Recognition • Updated Jul 15 • 35 • 2

mastersubhajit/sarvam-30b-AWQ-GPTQ-Hybrid

6B • Updated about 1 month ago • 3

adrahmana/NanoFable-1M-ternary

Text Generation • 1.38M • Updated Jul 13 • 54

adrahmana/NanoFable-6M-ternary

Text Generation • 5.87M • Updated Jul 13 • 62

adrahmana/NanoFable-16M-ternary

Text Generation • 15.7M • Updated Jul 13 • 63

adrahmana/NanoFable-28M-ternary

Text Generation • 27.8M • Updated Jul 13 • 67

adrahmana/NanoFable-28M-fp16

Text Generation • 27.8M • Updated Jul 13 • 82

milo01/INT4-Convrot-Comfy-Models

Updated Jul 13 • 1

arathishree/gpt-oss-20b-NVFP4

21B • Updated Jul 14 • 11

Ares-Realm-Studios/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated Jul 14 • 110 • 1

mastersubhajit/sarvam-30b-AWQ-4bit

7B • Updated 10 days ago • 1.75k

alonsopg/wmt26-layeraware-native-mlp-q4

Text Generation • Updated Jul 14 • 20

fieldsmodelorg/Olmo-3.1-32B-Think-OPD-ProofPilot

Updated 7 days ago

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-Vision-MLX

Image-Text-to-Text • 6B • Updated Jul 15 • 400 • 1

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-MLX

Text Generation • 6B • Updated Jul 15 • 412 • 1

Albertchen96/FlowDIS-int8-convrot

Image Segmentation • Updated Jul 14

mirai-community/granite-3.3-2b-instruct-int4-gram

1B • Updated 11 days ago • 11

realrebelai/Wan_Dancer_GGUFs

17B • Updated about 1 month ago • 8.18k • 16

KeinNiemand/Kuwutu-7B-CYOA-GGUF-v2

Text Generation • 8B • Updated Jul 15 • 54

KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF-v2

Text Generation • 8B • Updated Jul 15 • 40

xprtaker/gemma-4-E2B-unimodal-JANG-Q4-lite

0.7B • Updated Jul 15 • 34

InsecureErasure/Krea2-Turbo-mixed-NVFP4

Text-to-Image • Updated Jul 15 • 4.01k

modulsx/Wan_Dancer_GGUFs

17B • Updated Jul 16 • 324 • 1

steven0226/Qwen3.5-9B-GGUF-Quant-Lab

Text Generation • 9B • Updated Jul 16 • 309

kaaaaan/t5gemma-sa3-int8-mlx

Updated Jul 16 • 1

kaaaaan/t5gemma-sa3-int8

Updated Jul 16 • 1

juanginer/Voxtral-Mini-3B-2507-AWQ4-EN

Automatic Speech Recognition • 5B • Updated 29 days ago • 229 • 1

juanginer/Voxtral-Mini-3B-2507-AWQ4-ARG

Automatic Speech Recognition • 5B • Updated 29 days ago • 234