Differential Transformer
Paper
•
2410.05258
•
Published
•
180
Viktor Shcherbakov
viktoroo
AI & ML interests
NLP, Transformers
Recent Activity
updated
a dataset
about 15 hours ago
viktoroo/longbench-pro-128k-plus
published
a dataset
about 15 hours ago
viktoroo/longbench-pro-128k-plus
updated
a dataset
9 days ago
viktoroo/sniffed-qk-smollm2-360m-fineweb-edu-10bt-l06-pre-rope
Organizations
upvoted
a
paper
about 1 year ago