Dan P

Ok its up but here they are:
Banaxi-Tech/skarlet-alpha (75,054,720 params) RESULTS
hellaswag acc 28.76% | acc_norm 30.91%
arc_easy acc 49.41% | acc_norm 42.38%
arc_challenge acc 20.56% | acc_norm 23.98%
arc_average acc 34.99% | acc_norm 33.18%
piqa acc 61.48% | acc_norm 60.55%
arithmark_2 26.68%

Do you have discord? Can send you the results privately

Requested access will let you know how it goes when approved!

Yeah definitely not, excited to see how it does when its fully trained!