MultilingualUnigramLM/ft-langmap-gemma3-1b-fineweb100M-tur-original
Updated
AI & ML interests
Multilingual Tokenization
Recent Activity
View all activity
models 484
MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-tur-original
Updated
MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-hun-original
Updated
MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-fin-original
Updated
MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-khm
Updated
MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-tam
Updated
MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-ben
Updated
MultilingualUnigramLM/las-tokenizers-phi-4-khm
Updated
MultilingualUnigramLM/las-tokenizers-phi-4-ben
Updated
MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-tha
Updated
datasets 35
MultilingualUnigramLM/FineWeb2-500M-tur_Latn
Viewer • Updated • 419k
MultilingualUnigramLM/FineWeb2-500M-hun_Latn
Viewer • Updated • 312k
MultilingualUnigramLM/FineWeb2-500M-fin_Latn
Viewer • Updated • 387k • 1
MultilingualUnigramLM/FineWeb2-khm_Khmr-100M
Viewer • Updated • 1.01M • 13
MultilingualUnigramLM/FineWeb2-tha_Thai-100M
Viewer • Updated • 710k • 13
MultilingualUnigramLM/FineWeb2-tam_Taml-100M
Viewer • Updated • 264k • 12
MultilingualUnigramLM/FineWeb2-arb_Arab-100M
Viewer • Updated • 188k • 11
MultilingualUnigramLM/FineWeb2-ben_Beng-100M
Viewer • Updated • 254k • 11
MultilingualUnigramLM/FineWeb2-amh_Ethi-100M
Viewer • Updated • 197k • 13
MultilingualUnigramLM/FineWeb2-yor_Latn-100M
Viewer • Updated • 80k • 11