The Drummer's
Collection
A bit less censored models
β’
6 items
β’
Updated
β’
3
| Parameter | Value |
|---|---|
| direction_index | 54.60 |
| attn.o_proj.max_weight | 1.18 |
| attn.o_proj.max_weight_position | 55.35 |
| attn.o_proj.min_weight | 0.61 |
| attn.o_proj.min_weight_distance | 34.03 |
| mlp.down_proj.max_weight | 0.83 |
| mlp.down_proj.max_weight_position | 53.27 |
| mlp.down_proj.min_weight | 0.50 |
| mlp.down_proj.min_weight_distance | 22.81 |
| Metric | This model | Original model (TheDrummer/Big-Tiger-Gemma-27B-v3) |
|---|---|---|
| KL divergence | 0.2434 | 0 (by definition) |
| Refusals | 5/100 | 51/100 |
Gemma 3 27B tune that unlocks more capabilities and less positivity! Should be vision capable.
config-v3a
Base model
google/gemma-3-27b-pt