Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12

Full-text search

Active filters: open4bits

Open4bits/LFM2.5-1.2B-Base-Quantized

Text Generation • Updated 6 days ago

Open4bits/granite-4.0-h-micro-quantized

Text Generation • Updated 6 days ago

Open4bits/gemma-3-270m-it-gguf

Text Generation • 0.3B • Updated 1 day ago • 948

Open4bits/Qwen3-0.6b-gguf

Text Generation • 0.8B • Updated 7 days ago • 568

Open4bits/whisper-tiny-f16

Automatic Speech Recognition • 37.8M • Updated 7 days ago • 35

Open4bits/whisper-base-f16

Automatic Speech Recognition • 72.6M • Updated 7 days ago • 26

Open4bits/llama-3.2-1b-onnx

Text Generation • Updated 6 days ago • 24

Open4bits/Qwen3-0.6B-onnx

Text Generation • Updated 6 days ago • 10

Open4bits/llama3.2-1b-gguf

Text Generation • 1B • Updated 3 days ago • 542

Open4bits/EXAONE-4.0-1.2B-gguf

Text Generation • 1B • Updated 3 days ago • 541

Open4bits/Ministral-3-3B-Base-2512-gguf

Image-Text-to-Text • 3B • Updated 1 day ago • 345

Open4bits/Schematron-3B-gguf

Text Generation • 3B • Updated 1 day ago • 211