Hugging Face's logo

gsaltintas
/
toksuite-scale-7B-tiktoken-gpt-4

Model card Files
xet
Community
gsaltintas commited on
Commit
36b2ab0
·
verified ·
1 Parent(s): 50c2a4d

Upload tiktoken--gpt-4_info.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. tiktoken--gpt-4_info.json +1 -0
tiktoken--gpt-4_info.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"data": {"tokenizer": {"name": "tiktoken", "path": "gpt-4"}}}