Matthew Honnibal 2d715451a2 Revert "Convert custom user_data to token extension format for Japanese tokenizer (#5652)" (#5665) ... This reverts commit 1dd38191ec.		2020-06-29 14:34:15 +02:00
..
__init__.py	Revert #4334	2019-09-29 17:32:12 +02:00
test_lemmatization.py	Add Japanese Model (#5544)	2020-06-04 19:15:43 +02:00
test_serialize.py	Update Japanese tokenizer config and add serialization (#5562)	2020-06-08 16:29:05 +02:00
test_tokenizer.py	Revert "Convert custom user_data to token extension format for Japanese tokenizer (#5652)" (#5665)	2020-06-29 14:34:15 +02:00