Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
DatarrX
/
myX-Tokenizer
like
2
Follow
DatarrX
11
Feature Extraction
9 datasets
Burmese
English
Pāli
sentencepiece
tokenizer
unigram
myanmar
burmese
nlp
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
myX-Tokenizer
8.92 MB
Ctrl+K
Ctrl+K
1 contributor
History:
17 commits
kalixlouiis
Update README.md
c4320d9
verified
29 days ago
.gitattributes
Safe
1.57 kB
Upload benchmark.png
29 days ago
README.md
9.84 kB
Update README.md
29 days ago
benchmark.png
216 kB
xet
Upload benchmark.png
29 days ago
tokenizer.model
4.42 MB
xet
Upload 2 files
2 months ago
tokenizer.vocab
Safe
4.28 MB
Upload 2 files
2 months ago