explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-03-12 07:15:48 +03:00
Code Issues Packages Projects Releases Wiki Activity
daa6e0339f
spaCy/spacy/tests/lang/vi
History
Adriane Boyd c5de9b463a
Update custom tokenizer APIs and pickling () 
* Fix incorrect pickling of Japanese and Korean pipelines, which led to
the entire pipeline being reset if pickled

* Enable pickling of Vietnamese tokenizer

* Update tokenizer APIs for Chinese, Japanese, Korean, Thai, and
Vietnamese so that only the `Vocab` is required for initialization
2021-08-19 14:37:47 +02:00
..
__init__.py Update Vietnamese tokenizer () 2021-05-17 18:16:20 +10:00
test_serialize.py Update custom tokenizer APIs and pickling () 2021-08-19 14:37:47 +02:00
test_tokenizer.py Update Vietnamese tokenizer () 2021-05-17 18:16:20 +10:00