teagrjohnson commited on
Commit
8dca742
·
verified ·
1 Parent(s): 3663bc3

Upload tokenizer/added_tokens.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. tokenizer/added_tokens.json +6 -0
tokenizer/added_tokens.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "[/E1]": 50266,
3
+ "[/E2]": 50268,
4
+ "[E1]": 50265,
5
+ "[E2]": 50267
6
+ }