EdgeCompress01/Llama-3.2-3B-Instruct-GGUF
3B • Updated • 12
Quantized Models
-
-
EdgeCompress01/Llama-3.2-3B-Instruct-GPTQ-4bit
3B • Updated • 29 -
EdgeCompress01/Llama-3.2-3B-Instruct-AWQ-4bit
3B • Updated • 22 -
EdgeCompress01/Qwen3-4B-GGUF
4B • Updated • 1 -
EdgeCompress01/Qwen3-4B-GPTQ-4bit
4B • Updated -
EdgeCompress01/Qwen3-4B-AWQ-4bit
4B • Updated • 7 -
EdgeCompress01/Qwen3-4B-Instruct-2507-AWQ-4bit
4B • Updated • 45 -
EdgeCompress01/Qwen3-4B-Instruct-2507-GPTQ-4bit
4B • Updated • 76 -
EdgeCompress01/Phi-4-mini-instruct-AWQ-4bit
4B • Updated • 142 -
EdgeCompress01/Phi-4-mini-instruct-GPTQ-4bit
4B • Updated • 180 • 1