Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Kaiyue Wen's picture
2 1

Kaiyue Wen PRO

KaiyueWen
dlwh's profile picture Calvin-Xu's profile picture openhonor's profile picture
·

AI & ML interests

None yet

Recent Activity

updated a model 25 days ago
OptimizerStudy/muon_96B_3.54e-3
published a model 25 days ago
OptimizerStudy/muon_96B_3.54e-3
updated a model 25 days ago
OptimizerStudy/muon_6B_1.00e-2
View all activity

Organizations

The Marin Project's profile picture Optimizer Study Group's profile picture

authored 3 papers 12 months ago

Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization

Paper • 2307.11007 • Published Jul 20, 2023

RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval

Paper • 2402.18510 • Published Feb 28, 2024

Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models

Paper • 2501.11873 • Published Jan 21, 2025 • 66
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs