Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,569

Base only

Active filters: quantization

Lufel6848/Qwen3.5-9B-GGUF

9B • Updated 3 days ago • 683

Lufel6848/Qwen3.5-4B-GGUF

4B • Updated 3 days ago • 329

Lufel6848/Qwen3.5-2B-GGUF

2B • Updated 3 days ago • 311

ucsbcit/InternVL3_5-38B-Flash-FP8

Image-Text-to-Text • 40B • Updated 3 days ago • 13

JackBinary/ROCmFPX-Quantize-Playbook

Updated 3 days ago

Lufel6848/DeepSeek-R1-Distill-Qwen-7B-to-GGUF

8B • Updated 3 days ago • 256

kaminoke0731/wan22-qx-encoders-gguf

Text-to-Video • 6B • Updated 3 days ago • 834

mph/qwen3.8-27b-mxfp8

Image-Text-to-Text • 27B • Updated 3 days ago • 28

Lufel6848/Ministral-3-8B-Reasoning-2512-GGUF

8B • Updated 3 days ago • 393

Lufel6848/LFM2.5-2.6B-GGUF

3B • Updated 3 days ago • 300

KanakMalpani/bnn-lab-wrap-demo

Other • Updated 3 days ago

Lufel6848/Qwen3.5-0.8B-GGUF

0.8B • Updated 3 days ago • 332

yongyizang/TinyMOSS-Diarize

Automatic Speech Recognition • Updated 3 days ago

petergilani/Qwen3.8-27B-MTP-8bit

Text Generation • 8B • Updated 3 days ago • 115

brandonmusic/GLM-5.2-SQG-Coupled-H512-H128-K96Tail

Text Generation • Updated 2 days ago

haihengh/Qwen3.6-35B-A3B-finchmoe-3bit

Updated 3 days ago

HarimxChoi/WarpQuant-Qwen3.8-27B-R16E4H4

Image-Text-to-Text • 28B • Updated 2 days ago • 15

caiovicentino1/Qwen3.8-27B-GPTQ-gs64-FOEM

Text Generation • 27B • Updated 2 days ago • 84

PollardWeights/Qwen2.5-1.5B-Instruct-Pollard

Text Generation • 2B • Updated 2 days ago • 305

mickyba/Qwen3.8-27B-3bit-mlx

Image-Text-to-Text • 4B • Updated 2 days ago • 251

Lynxpda/DeepSeek-V4-Flash-0731-DSpark-Drafter-Q2_K_S-GGUF

20B • Updated 2 days ago • 58

HarimxChoi/WarpQuant-Qwen3.8-27B-R16E4H4-Text

Text Generation • 27B • Updated 2 days ago • 214

Myric/abliteration-token-efficiency-study

27B • Updated 2 days ago • 45

trentzap/QTensor-TinyLlama-1.1B-Asymmetric-v2

Text Generation • 0.7B • Updated 2 days ago • 277

CobrIX/CobrIX-1.0-Coder-Flash-33B-A13B-GGUF

Text Generation • 33B • Updated 2 days ago • 155

HarimxChoi/WarpQuant-Qwen3.5-4B-R16E4V4

Image-Text-to-Text • 5B • Updated 2 days ago • 14

HarimxChoi/WarpQuant-Qwen3.5-4B-R16E4-Text

Text Generation • 4B • Updated 2 days ago • 131

HarimxChoi/WarpQuant-Llama-3-8B-R16E4H4

Text Generation • 8B • Updated 2 days ago • 125

superniker/qwen3.8-27b-g8l4i

Text Generation • Updated 1 day ago • 169

Ank0X0/needle2

Text Generation • Updated 1 day ago • 13