explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-25 01:16:28 +03:00
Code Issues Packages Projects Releases Wiki Activity
8fe525beb5
spaCy/spacy/lang/ko
History
Adriane Boyd c5de9b463a
Update custom tokenizer APIs and pickling (#8972) 
* Fix incorrect pickling of Japanese and Korean pipelines, which led to
the entire pipeline being reset if pickled

* Enable pickling of Vietnamese tokenizer

* Update tokenizer APIs for Chinese, Japanese, Korean, Thai, and
Vietnamese so that only the `Vocab` is required for initialization
2021-08-19 14:37:47 +02:00
..
__init__.py Update custom tokenizer APIs and pickling (#8972) 2021-08-19 14:37:47 +02:00
examples.py Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
lex_attrs.py Drop Python 2.7 and 3.5 (#4828) 2019-12-22 01:53:56 +01:00
stop_words.py Drop Python 2.7 and 3.5 (#4828) 2019-12-22 01:53:56 +01:00
tag_map.py Drop Python 2.7 and 3.5 (#4828) 2019-12-22 01:53:56 +01:00