Pretraining Data
updated
opencsg/Fineweb-Edu-Chinese-V2.1
Preview
• Updated • 37k
• 81
Viewer
• Updated • 28.9B • 21.1k
• 42
Viewer
• Updated • 3.8B • 15.4k
• 146
allenai/dolma3_dolmino_pool
Updated • 23.5k
• 9
allenai/dolma3_longmino_pool
Updated • 10.7k
• 14
Viewer
• Updated • 476M • 79.1k
• 951
Viewer
• Updated • 4.48B • 128k
• 917
Viewer
• Updated • 61.6M • 13.5k
• 341
Viewer
• Updated • 819M • 4.62k
• 14
tokyotech-llm/swallow-code-v2
Viewer
• Updated • 147M • 6.58k
• 56
ByteDance-Seed/Code-Contests-Plus
Viewer
• Updated • 70.1k • 14k
• 70
Viewer
• Updated • 7.09M • 8.15k
• 201
nvidia/Nemotron-Pretraining-Code-v2
Viewer
• Updated • 836M • 4.94k
• 137
nvidia/Nemotron-Pretraining-Specialized-v1
Viewer
• Updated • 60.7M • 6.5k
• 89
nvidia/Nemotron-CC-Math-v1
Viewer
• Updated • 190M • 8.64k
• 104
nvidia/Nemotron-Pretraining-SFT-v1
Viewer
• Updated • 299M • 2.47k
• 75
Viewer
• Updated • 1.86M • 7.8k
• 259
EssentialAI/essential-web-v1.0
Preview
• Updated • 163k
• 252
EssentialAI/eai-taxonomy-stem-w-dclm
Preview
• Updated • 3.93k
• 6
EssentialAI/eai-taxonomy-med-w-dclm
Viewer
• Updated • 81.2M • 1.46k
• 8
EssentialAI/eai-taxonomy-code-w-dclm
Viewer
• Updated • 274M • 3.67k
• 11
EssentialAI/eai-taxonomy-math-w-fm
Viewer
• Updated • 21.6M • 1.32k
• 5
Viewer
• Updated • 27.9B • 307
• 7
DataMuncher-Labs/UltiMath
Viewer
• Updated • 32.9B • 41.3k
• 46
HuggingFaceFW/finetranslations
Viewer
• Updated • 3.33B • 17.1k
• 308
Viewer
• Updated • 69.9k • 149k
• 443
JetBrains-Research/commit-chronicle
Viewer
• Updated • 10.9M • 2.12k
• 13
ASSERT-KTH/repairllama-datasets
Viewer
• Updated • 460k • 114
• 3
Updated • 12.6k
• 81
Viewer
• Updated • 778k • 33
• 1
Viewer
• Updated • 3.5M • 176
nick007x/github-code-2025
Viewer
• Updated • 148M • 2.65k
• 122
tokyotech-llm/swallow-code
Viewer
• Updated • 129M • 1.29k
• 81
macrocosm-os/code-parrot-github-code
Viewer
• Updated • 115M • 461
• 13
nyuuzyou/google-code-archive
Viewer
• Updated • 65.8M • 558
• 73
ad6398/Deepmind-CodeContest-Unrolled
Viewer
• Updated • 13.2M • 280
• 2
datablations/python-megatron
Updated • 2.66k
• 1
nomic-ai/cornstack-python-v1
Viewer
• Updated • 23.6M • 2.15k
• 28
Viewer
• Updated • 22.6M • 11.3k
Viewer
• Updated • 552k • 382
utter-project/github-code-2025-above-2-stars
Viewer
• Updated • 103M • 293
• 4
tokyotech-llm/swallow-math-v2
Viewer
• Updated • 17.4M • 7.86k
• 34
Viewer
• Updated • 181M • 26.6k
• 362
Viewer
• Updated • 513k • 45
• 8
Updated • 779
• 1
Preview
• Updated • 40.6k
• 105
CodedotAI/code_clippy_github
Viewer
• Updated • 2.4M • 4.78k
• 20
Lichess/standard-chess-games
Viewer
• Updated • 7.14B • 836k
• 119
jablonkagroup/chempile-mlift
Viewer
• Updated • 51.5M • 13.1k
• 14
Viewer
• Updated • 49.8M • 44
jablonkagroup/chempile-code
Viewer
• Updated • 2.27M • 723
• 5
jablonkagroup/chempile-paper
Viewer
• Updated • 11.7M • 555
• 8
jablonkagroup/chempile-education
Viewer
• Updated • 66.9k • 272
• 8
Viewer
• Updated • 164k • 159
• 2
institutional/institutional-books-hl
Preview
• Updated • 7.5k
• 304
Viewer
• Updated • 34.5k • 171
common-pile/youtube_filtered
Viewer
• Updated • 986k • 1.56k
• 7
common-pile/ubuntu_irc_filtered
Viewer
• Updated • 216k • 704
• 2
common-pile/pubmed_filtered
Viewer
• Updated • 4.77M • 3.74k
• 6
common-pile/github_archive_filtered
Viewer
• Updated • 23.3M • 1.49k
• 2
common-pile/biodiversity_heritage_library_filtered
Viewer
• Updated • 16.5M • 654
• 2
common-pile/uspto_filtered
Viewer
• Updated • 14.4M • 4.3k
• 4
common-pile/usgpo_filtered
Viewer
• Updated • 2.34M • 2.06k
• 3
soda-research/emilia-mm-pretrain-fix
Viewer
• Updated • 12.6M • 580
fineinstructions/fineinstructions_nemotron
Viewer
• Updated • 1.23B • 2.34k
• 28
Viewer
• Updated • 1.38M • 352
• 1
Viewer
• Updated • 23.5k • 9.66k
• 56
Viewer
• Updated • 12.3M • 86.7k
• 103