1
1
mirror of https://github.com/explosion/spaCy.git synced 2025-02-19 13:00:35 +03:00
spaCy/spacy/tests/lang/th
Adriane Boyd c5de9b463a
Update custom tokenizer APIs and pickling ()
* Fix incorrect pickling of Japanese and Korean pipelines, which led to
the entire pipeline being reset if pickled

* Enable pickling of Vietnamese tokenizer

* Update tokenizer APIs for Chinese, Japanese, Korean, Thai, and
Vietnamese so that only the `Vocab` is required for initialization
2021-08-19 14:37:47 +02:00
..
__init__.py Revert 2019-09-29 17:32:12 +02:00
test_serialize.py Update custom tokenizer APIs and pickling () 2021-08-19 14:37:47 +02:00
test_tokenizer.py Drop Python 2.7 and 3.5 () 2019-12-22 01:53:56 +01:00