Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
appvoid 
posted an update 1 day ago
Post
3278
if you are a tinkerer of small language models and want to stay ahead of what small models can do, follow me!!! seriously, start following people that actually still makes small models

i've made one recently btw

also, i'm keeping an eye on AxiomicLabs leaderboard, looks like the only current alternative to check where the things are going to

though, between us, i think they should add agentic/tool use benchmarks there

anyways,


enjoy!

appvoid/a-cool-model

Cool post and earned a follow, you should train a sub 150m model and commit it to the axiomic leaderboard!

·

I'm in the works for one actually. I have been talking about it forever but I want to make sure is at the level of people's expectation.

Looks great!!
Why did you choose models under 0.5B?

·

I have been always fascinated to discover what's the minimum core of actual usefulness.

5 years ago I thought it was 1 billion parameters, but recently I discovered a 350m that is better than most 1b models.

350m is not perfect but as of today, if you go lower you lose general language understanding.

yeah im making some

·

cool, mind sharing it?

I want to follow people that also make super cool small models so comment here to follow you

·