flexitok
/

parity-aware-bpe-devset

Model card Files Files and versions

parity-aware-bpe-devset / tokenizer.json

gsaltintas's picture

Upload tokenizer.json with huggingface_hub

5865c46 verified 1 day ago

History Blame Contribute Delete

14.9 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 14732787523ef672833a3c4ecff304b616c3c27ffd9c14170065356efae6863e
Size of remote file:: 14.9 MB
SHA256:: f724118cb1932b1daf3f004541c138e843075f07a5a75e930c6c22ff62d0d49e

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.