gräfics's picture

gräfics

graefics

·

https://www.openmachine.ai

AI & ML interests

None yet

Recent Activity

new activity 4 days ago

zai-org/GLM-5.1:[Feature request] Eliminate pre-attention RMSNorm in MLA-models via scale invariance + weight folding

new activity 4 days ago

deepseek-ai/DeepSeek-R1:[Feature request] Eliminate pre-attention RMSNorm in MLA-models via scale invariance + weight folding

new activity 4 days ago

moonshotai/Kimi-K2.6:[Feature request] Eliminate pre-attention RMSNorm in MLA-models via scale invariance + weight folding

View all activity

Organizations

authored a paper almost 2 years ago

Flash normalization: fast RMSNorm for LLMs

Paper • 2407.09577 • Published Jul 12, 2024 • 3