pinned
Running
1
Meta Arena
📉
testing fewshot learning at small scale
appvoid
appvoid
AI & ML interests
Working on symbolic models
Recent Activity
posted an update about 9 hours ago
model | epoch | step | val_loss |
c-gpt-1| 5 | 41365 | 1.0175 |
If you don't understand what you see, this is just one the coolest proof of concepts I've ever made. I just trained a char-level, super small model (~80 million parameters) on millions of high-quality examples on a curated dataset and is slowly getting davinci-003 vibes liked a model 5 days ago
Eclipse-Senpai/KeyLM-75M posted an update 8 days ago
As an advocate for small language models I just want to say. It might not actually be the end for small models. We are just getting started! Now that we have super good models we can find creative ways to replicate the behavior at small scale!
I'll show you in a few weeks what a small model is capable of, you will surprised.Organizations
