jhu-clsp/mmBERT-base
Fill-Mask
•
Updated
•
233k
•
•
172
mmBERT: a modern multilingual encoder
mmBERT is trained on 3T tokens from over 1800 languages, showing SoTA scores on benchmarks and exceptional low-resource performance
-
jhu-clsp/mmBERT-small
Fill-Mask • Updated • 10.8k • • 58Note Intermediate checkpoints for continued pre-training (MosiacML Composer format)
jhu-clsp/mmBERT-checkpoints
Updated • 3Note Pre-training Data
-
orionweller/mmBERT-pretrain-p1-fineweb2-langs
Updated • 2.58k • 4 -
orionweller/mmBERT-pretrain-p2-fineweb2-remaining
Updated • 5.93k -
orionweller/mmBERT-pretrain-p3-others
Updated • 10.2k -
jhu-clsp/mmBERT-midtraining-data
Updated • 9.16k • 1
jhu-clsp/mmBERT-decay-data
Updated • 6.4k • 3Note Randomized data for training (not recommended unless you are using the same data mix)
-
orionweller/mmBERT-data-decay-all
Updated • 1.5k -
orionweller/mmBERT-data-decay-cont
Updated • 1.25k -
orionweller/mmBERT-data-decay-eng
Updated • 1.45k -
orionweller/mmBERT-data-midtraining
Updated • 1.84k -
orionweller/mmBERT-pretraining-data-chunk0
Preview • Updated • 2.8k -
orionweller/mmBERT-pretraining-data-chunk1
Preview • Updated • 2.25k -
orionweller/mmBERT-pretraining-data-chunk2
Preview • Updated • 2.25k -
orionweller/mmBERT-pretraining-data-chunk3
Preview • Updated • 2.91k