dispatchAI/Qwen2.5-1.5B-Instruct-mobile-int4
Text Generation • 2B • Updated • 610
⚡ Quantized Models (Q4-Q8)
Aggressively quantized: Q4_K_M, Q5_K_M, Q6_K, Q8_0, int4. Same model, fraction of the size.
-
-
dispatchAI/Qwen2.5-0.5B-Instruct-mobile-int4
Text Generation • 0.6B • Updated • 1.05k -
dispatchAI/TinyLlama-1.1B-Chat-mobile-int4
Text Generation • 1B • Updated • 227 -
dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile
Text Generation • 1B • Updated • 1.25k -
dispatchAI/Phi-3.5-mini-instruct-Q5-mobile
Text Generation • 4B • Updated • 89 -
dispatchAI/EmbeddingGemma-300M-Q8-mobile
0.3B • Updated • 337 -
dispatchAI/Qwen3-Embedding-0.6B-Q8-mobile
0.6B • Updated • 296 -
dispatchAI/TinyLlama-1.1B-Chat-Q5-mobile
Text Generation • 1B • Updated • 202 -
dispatchAI/Gemma-2-2B-IT-Q5-mobile
Text Generation • 3B • Updated • 539 -
dispatchAI/Llama-3.2-1B-Instruct-Q6-mobile
Text Generation • 1B • Updated • 994 -
dispatchAI/SmolLM2-1.7B-Instruct-Q5-mobile
Text Generation • 2B • Updated • 142 -
dispatchAI/Qwen2.5-1.5B-Instruct-Q5-mobile
Text Generation • 2B • Updated • 488 -
dispatchAI/Qwen2.5-1.5B-Instruct-Q8-mobile
Text Generation • 2B • Updated • 514 -
dispatchAI/Llama-3.2-3B-Instruct-Q5-mobile
Text Generation • 3B • Updated • 507