alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.rtn-nvfp4-llmcompressor 1B • Updated 3 days ago • 21
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.autoround-nvfp4-llmcompressor 1B • Updated 3 days ago • 123
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.autoround-mxfp4-llmcompressor 1B • Updated 3 days ago • 104
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8fp8-llmcompressor 8B • Updated 15 days ago • 62
alishafique/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8fp8-llmcompressor 2B • Updated 15 days ago • 41
alishafique/DeepSeek-R1-Distill-Qwen-14B-quantized.autoround-w4a16-llmcompressor 3B • Updated 15 days ago • 14
alishafique/DeepSeek-R1-Distill-Qwen-14B-quantized.gptq-w4a16-llmcompressor 3B • Updated 16 days ago • 16
alishafique/DeepSeek-R1-Distill-Qwen-14B-quantized.awq-w4a16-llmcompressor 3B • Updated 16 days ago • 18
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.autoround-w4a16-llmcompressor 2B • Updated 16 days ago • 42
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.gptq-w4a16-llmcompressor 2B • Updated 16 days ago • 29
alishafique/DeepSeek-R1-Distill-Qwen-7B-quantized.awq-w4a16-llmcompressor 2B • Updated 16 days ago • 29
alishafique/Qwen2.5-Coder-14B-Instruct-quantized.autoround-w4a16-llmcompressor 3B • Updated 16 days ago • 18
alishafique/Qwen2.5-Coder-14B-Instruct-quantized.gptq-w4a16-llmcompressor 3B • Updated 16 days ago • 96
alishafique/Qwen2.5-Coder-14B-Instruct-quantized.awq-w4a16-llmcompressor 3B • Updated 16 days ago • 77
alishafique/Qwen2.5-Coder-7B-Instruct-quantized.autoround-w4a16-llmcompressor 2B • Updated 16 days ago • 21
alishafique/Qwen2.5-Coder-7B-Instruct-quantized.gptq-w4a16-llmcompressor 2B • Updated 16 days ago • 52