Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MCplayer
/
XY_Tokenizer
like
0
PyTorch
xy_tokenizer
custom_code
arxiv:
2506.23325
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
main
XY_Tokenizer
2.14 GB
1 contributor
History:
7 commits
MCplayer
add middle overlap type
f038693
5 months ago
examples
XY_Tokenizer AutoModel version support
7 months ago
.gitattributes
1.56 kB
XY_Tokenizer AutoModel version support
7 months ago
README.md
3.29 kB
pre-release version
6 months ago
config.json
3.31 kB
pre-release version
6 months ago
configuration_xy_tokenizer.py
3.49 kB
XY_Tokenizer AutoModel version support
7 months ago
feature_extraction_xy_tokenizer.py
10.5 kB
add middle overlap type
5 months ago
modeling_xy_tokenizer.py
61.5 kB
add middle overlap type
5 months ago
preprocessor_config.json
293 Bytes
add middle overlap type
5 months ago
pytorch_model.bin
2.14 GB
xet
XY_Tokenizer AutoModel version support
7 months ago