🤏 quecto mode
appvoid
appvoid
AI & ML interests
singularity through byte-level tokens and small language models
Recent Activity
liked a model about 15 hours ago
LiquidAI/LFM2.5-2.6B repliedto their post about 19 hours ago
If you lack ideas for a cool model, here's one.
Train a model from scratch on wikipedia with one twist: the tokenizer changes the actual token ids used on every sample fed. If somehow still learns English, you have made an astonishing discovery.
You would have answered the question: Can a model learn human languages from structure alone? posted an update about 22 hours ago
If you lack ideas for a cool model, here's one.
Train a model from scratch on wikipedia with one twist: the tokenizer changes the actual token ids used on every sample fed. If somehow still learns English, you have made an astonishing discovery.
You would have answered the question: Can a model learn human languages from structure alone?