🏝️ On Vacation

Aditya Tiwari

SyncreticAI

AI & ML interests

None yet

Recent Activity

liked a model about 8 hours ago

deepseek-ai/DeepSeek-V4-Flash-0731

updated a collection 4 days ago

LLM Training

updated a collection 4 days ago

LLM Training

View all activity

Organizations

None yet

liked a model about 8 hours ago

deepseek-ai/DeepSeek-V4-Flash-0731

Text Generation • 304B • Updated 21 days ago • 2.83M • • 3.62k

updated 2 collections 4 days ago

LLM Training

Collection

3 items • Updated 4 days ago

Edge Inference

Collection

4 items • Updated 4 days ago

liked a model 11 days ago

InternScience/Agents-A1-4B

Text Generation • 5B • Updated Jul 14 • 251k • • 82

reacted to Banaxi-Tech's post with 🔥 11 days ago

Post

2809

We're excited to release BananaMind 2 Micro, our smallest model yet.
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech