Simran

simarora

·

simran-arora

AI & ML interests

None yet

Recent Activity

updated a model 11 days ago

simarora/qwen3_5-cylon-k4-p1b-t10b-re0

published a model 11 days ago

simarora/qwen3_5-cylon-k4-p1b-t10b-re0

updated a model 11 days ago

simarora/qwen3_5-qk256-v256-p1b-t10b-re0

View all activity

Organizations

simarora 's models 35

simarora/qwen3_5-cylon-k4-p1b-t10b-re0

Updated 11 days ago

simarora/qwen3_5-qk256-v256-p1b-t10b-re0

Updated 11 days ago

simarora/qwen3_5-full-attention-mha-fullrope-p1b-t10b-re0

Updated 11 days ago

simarora/qwen3_5-qk256-p1b-t10b-re0

Updated 11 days ago

simarora/qwen3_5-cylon-k2-p1b-t10b-re0

Updated 11 days ago

simarora/cylon-nocumsum-k8-v256-sep-wide-dtype32-p1b-t50b-re0

simarora/cylon-nocumsum-fd1024-v256-sep-wide-dtype32-p1b-t50b-re0

simarora/cylon-nocumsum-k16-v256-sep-wide-dtype32-p1b-t50b-re0

simarora/cylon-nocumsum-fd1024-v256-sep-wide-dtype32-p1b-t10b-re0

simarora/cylon-nocumsum-k8-v256-sep-wide-dtype32-p1b-t10b-re0

simarora/cylon-nocumsum-k16-v256-sep-wide-dtype32-p1b-t10b-re0

simarora/gdn-paper-120m-hdim512-lr0.0005-layers12-dmodel768-n2048-head12-numQK1-v02

simarora/gdn-paper-120m-hdim1024-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-numQK_1-sim

simarora/gdn-paper-noswiglu-120m-h6-numQK1-rerun

simarora/gdn-paper-noswiglu-120m-h12-numQK1-rerun

simarora/bilinear-gdn-paper-initstd1-120m-h6-fd128-rerun

simarora/bilinear-gdn-paper-initstd1-120m-h12-fd64-rerun

simarora/bilinear-gdn-paper-initstd1-120m-h12-fd64

simarora/gdn-paper-4096-120m

simarora/bilinear-growing-concat-4096-std1-120m

simarora/bilinear-growing-concat-4096-std002-120m

simarora/m04d26y26-online-hebbian-v10-noSiLU-initSmall-120m-initstd_0.02-featdim_256

simarora/m04d26y26-online-hebbian-v10-noSiLU-initSmall-120m-initstd_0.02-featdim_22

simarora/m04d26y26-online-hebbian-v10-noSiLU-initSmall-120m-initstd_0.02-featdim_128

simarora/m04d25y26-online-hebbian-v10-noSiLU-initSmall-linear-l2norm-120m

simarora/m04d22y26-gdn-paper-120m-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-numQK_1

simarora/m04d18y26-attn-120m-lr_0.0005-layers_12-dmodel_768-n_2048-head_16-baseline

simarora/m04d18y26-attn-120m-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-ffn_4-baseline

simarora/gated-deltanet-k4-p1b-t50b-pile-re0

simarora/gated-deltanet-d256-p1b-t50b-pile-re0