stelterlab/Nemotron-Cascade-2-30B-A3B-AWQ
Text Generation • 5B • Updated • 9.25k • 1
Christian Otto Stelter PRO
stelterlab
dark-side-of-the-code's profile picture
bakbeest's profile picture
prashanthellina's profile picture·
AI & ML interests
None yet
Recent Activity
new activity 15 days ago
nvidia/Nemotron-Cascade-2-30B-A3B:Add documentation on how to use with vLLM to README.md published a model 16 days ago
stelterlab/Nemotron-Cascade-2-30B-A3B-AWQ updated a model 16 days ago
stelterlab/Nemotron-Cascade-2-30B-A3B-AWQOrganizations
None yet
Add documentation on how to use with vLLM to README.md
🤝👍 6
1
#7 opened 15 days ago
by stelterlab
published a
model 16 days ago
updated a
model 16 days ago
liked a
model 23 days ago
Qwen3.5-35B-A3B AWQ quant planned?
2
#1 opened about 1 month ago
by 
amidwestnoob
Which transformer version did you use?
#3 opened about 1 month ago
by stelterlab
tokenizer_config.json missing chat_template field (tool calling broken without workaround)
1
#1 opened about 1 month ago
by 
seanthomaswilliams
Updated tokenizer_config.json now w/ chat_template included
#2 opened about 1 month ago
by stelterlab
updated a
model 2 months ago
published a
model 2 months ago
NVFP4 / AWQ Quants or llm-compressor recipe
🤗 2
1
#1 opened 4 months ago
by stelterlab
vLLM v0.11.1 seems to work, but v0.11.2 fails
❤️👍 2
9
#3 opened 4 months ago
by stelterlab
Error when running in VLLM
👍 2
21
#1 opened 7 months ago
by 
d8rt8v
liked a
model 8 months ago
updated a
model 8 months ago
published a
model 8 months ago
updated a
model 8 months ago
Unable to run the model in VLLM: KeyError: 'layers.14.mlp.gate.qweight'
3
#1 opened 8 months ago
by 
fredericodeveloper
published a
model 8 months ago
updated a
model 8 months ago