simarora/gdn-paper-120m-hdim512-lr0.0005-layers12-dmodel768-n2048-head12-numQK1-v02
Updated
Simran
simarora
AI & ML interests
None yet
Recent Activity
updated a model 3 days ago
simarora/gdn-paper-120m-hdim512-lr0.0005-layers12-dmodel768-n2048-head12-numQK1-v02 published a model 3 days ago
simarora/gdn-paper-120m-hdim512-lr0.0005-layers12-dmodel768-n2048-head12-numQK1-v02 updated a model 3 days ago
simarora/gdn-paper-120m-hdim1024-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-numQK_1-simOrganizations
simarora/gdn-paper-120m-hdim1024-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-numQK_1-sim
Updated
simarora/cylon-nocumsum-routing-top2-k4-sep-wide-dtype32-p1b-t10b-re0-v02a
Updated
simarora/cylon-nocumsum-routing-k2-sep-wide-dtype32-p1b-t10b-re0
Updated
simarora/gdn-paper-noswiglu-120m-h6-numQK1-rerun
Updated
simarora/gdn-paper-noswiglu-120m-h12-numQK1-rerun
Updated
simarora/bilinear-gdn-paper-initstd1-120m-h6-fd128-rerun
Updated
simarora/bilinear-gdn-paper-initstd1-120m-h12-fd64-rerun
Updated
simarora/bilinear-gdn-paper-initstd1-120m-h12-fd64
Updated
simarora/gdn-paper-4096-120m
Updated
simarora/bilinear-growing-concat-4096-std1-120m
Updated
simarora/bilinear-growing-concat-4096-std002-120m
Updated
simarora/m04d26y26-online-hebbian-v10-noSiLU-initSmall-120m-initstd_0.02-featdim_256
Updated
simarora/m04d26y26-online-hebbian-v10-noSiLU-initSmall-120m-initstd_0.02-featdim_22
Updated
simarora/m04d26y26-online-hebbian-v10-noSiLU-initSmall-120m-initstd_0.02-featdim_128
Updated
simarora/m04d25y26-online-hebbian-v10-noSiLU-initSmall-linear-l2norm-120m
Updated
simarora/m04d22y26-gdn-paper-120m-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-numQK_1
Updated
simarora/m04d18y26-attn-120m-lr_0.0005-layers_12-dmodel_768-n_2048-head_16-baseline
Updated
simarora/m04d18y26-attn-120m-lr_0.0005-layers_12-dmodel_768-n_2048-head_12-ffn_4-baseline
Updated
simarora/gated-deltanet-k4-p1b-t50b-pile-re0
Updated
simarora/gated-deltanet-d256-p1b-t50b-pile-re0
Updated
simarora/cylon-nocumsum-k4-sep-wide-dtype32-p1b-t50b-re0
Updated
simarora/cylon-nocumsum-k2-sep-wide-dtype32-p1b-t50b-re0
Updated
simarora/cylon-nocumsum-k1-sep-wide-dtype32-p1b-t50b-re0
Updated
simarora/cylon-nocumsum-fd512-sep-wide-dtype32-p1b-t50b-re0
Updated
simarora/cylon-nocumsum-fd256-sep-wide-dtype32-p1b-t50b-re0-redo
Updated