Scalable Data Ablation Approximations for Language Models through Modular Training and Merging
Paper
•
2410.15661
•
Published
Scalable Data Ablations
Datasets and models for EMNLP paper "Scalable Data Ablation Approximations for Language Models through Modular Training and Merging"
-
-
claran/modular-s2orc
Viewer • Updated • 7.47M • 1.8k -
claran/m2d2-wiki-decon
Viewer • Updated • 5.3M • 96 -
claran/seed-pretrain-decon
Viewer • Updated • 3.45M • 25 -
claran/seed-pretrain-1_1b
Updated • 7 -
claran/seed-pretrain-130m
Updated • 6 -
claran/s2orc-biology-seq-130m
Updated • 6 -
claran/s2orc-business-seq-130m
Updated • 6 -
claran/s2orc-biology-merged-130m
Updated • 6 -
claran/s2orc-business-merged-130m
Updated • 4 -
claran/s2orc-mix-biology-business-seq-1_1b
Updated • 6 -
claran/s2orc-mix-biology-business-seq-110m
Updated • 9 -
claran/s2orc-business1970-2017-ind-130m
Updated • 8 -
claran/s2orc-business2018-2019-ind-130m
Updated • 6 -
claran/s2orc-business2020-2020-ind-130m
Updated • 10 -
claran/s2orc-business2021-2022-ind-130m
Updated • 8 -
claran/s2orc-biology1970-1993-ind-130m
Updated • 6 -
claran/s2orc-biology1994-1999-ind-130m
Updated • 6 -
claran/s2orc-biology2000-2003-ind-130m
Updated • 8 -
claran/s2orc-biology2004-2006-ind-130m
Updated • 6 -
claran/s2orc-biology2007-2008-ind-130m
Updated • 6 -
claran/s2orc-biology2009-2010-ind-130m
Updated • 6 -
claran/s2orc-biology2011-2011-ind-130m
Updated • 6 -
claran/s2orc-biology2012-2012-ind-130m
Updated • 8 -
claran/s2orc-biology2013-2013-ind-130m
Updated • 8 -
claran/s2orc-biology2014-2014-ind-130m
Updated • 8 -
claran/s2orc-biology2015-2015-ind-130m
Updated • 9 -
claran/s2orc-biology2016-2016-ind-130m
Updated • 9 -
claran/s2orc-biology2017-2017-ind-130m
Updated • 8 -
claran/s2orc-biology2018-2018-ind-130m
Updated • 6 -
claran/s2orc-biology2019-2019-ind-130m
Updated • 8 -
claran/s2orc-biology2020-2020-ind-130m
Updated • 10 -
claran/s2orc-biology2021-2021-ind-130m
Updated • 8 -
claran/s2orc-biology2022-2022-ind-130m
Updated • 6