Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,477

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 2 days ago • 74k • • 568

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 2 days ago • 559k • 325

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 52.8k • 91

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 1 day ago • 10.6k • 55

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 14.3k • 748

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 19 days ago • 36.3k • 42

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 21.7k • 101

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 18.3k • 116

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 2.9k • 32

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 3 days ago • 829 • 5

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 2.05k • 44

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 2.32k • 24

Jiunsong/SuperHY3-abliterated-gguf

Text Generation • 299B • Updated 3 days ago • 313 • 4

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 7.3k • 79

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated about 1 month ago • 57.5k • 70

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 16 days ago • 36.2k • 14

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 9.15k • 52

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 74 • 8

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 4.91k • 30

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 56

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 19 days ago • 6.75k • 29

audarai/Audar-TTS-V1-Flash

Text-to-Speech • 0.6B • Updated 9 days ago • 260 • 4

GZGavinZhao/Leanstral-1.5-119B-A6B-GGUF

119B • Updated 10 days ago • 3.28k • 6

Abiray/ThinkingCap-Qwen3.6-27B-MTP-Q4_K_M-GGUF

27B • Updated 9 days ago • 965 • 7

maczzzzzz/ThinkingCap-Qwen3.6-27B-TQ3_4S-GGUF

27B • Updated 5 days ago • 262 • 2

Bahushruth/Qwen3.6-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 4 days ago • 4.31k • 2

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • 3B • Updated May 11, 2024 • 27 • 1

faerdhinen/Fimbulvetr-11B-v2-Q4_K_M-GGUF

11B • Updated Jul 29, 2024 • 70 • 1

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 1.15k • 53

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 11.1k • 49