explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-01-24 00:04:15 +03:00
Code Issues Packages Projects Releases Wiki Activity
1dd38191ec
spaCy/spacy/lang/ja
History
Adriane Boyd 1dd38191ec
Convert custom user_data to token extension format for Japanese tokenizer (#5652) 
* Convert custom user_data to token extension format

Convert the user_data values so that they can be loaded as custom token
extensions for `inflection`, `reading_form`, `sub_tokens`, and `lemma`.

* Reset Underscore state in ja tokenizer tests
2020-06-29 14:20:26 +02:00
..
__init__.py Convert custom user_data to token extension format for Japanese tokenizer (#5652) 2020-06-29 14:20:26 +02:00
examples.py 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
stop_words.py 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
syntax_iterators.py Add Japanese Model (#5544) 2020-06-04 19:15:43 +02:00
tag_bigram_map.py Add Japanese Model (#5544) 2020-06-04 19:15:43 +02:00
tag_map.py Add Japanese Model (#5544) 2020-06-04 19:15:43 +02:00
tag_orth_map.py Add Japanese Model (#5544) 2020-06-04 19:15:43 +02:00