2 Commits

Author	SHA1	Message	Date
Daniël de Kok	e2b70df012	Configure isort to use the Black profile, recursively isort the spacy module (#12721) ... * Use isort with Black profile * isort all the things * Fix import cycles as a result of import sorting * Add DOCBIN_ALL_ATTRS type definition * Add isort to requirements * Remove isort from build dependencies check * Typo	2023-06-14 17:48:41 +02:00
Adriane Boyd	c5de9b463a	Update custom tokenizer APIs and pickling (#8972) ... * Fix incorrect pickling of Japanese and Korean pipelines, which led to the entire pipeline being reset if pickled * Enable pickling of Vietnamese tokenizer * Update tokenizer APIs for Chinese, Japanese, Korean, Thai, and Vietnamese so that only the `Vocab` is required for initialization	2021-08-19 14:37:47 +02:00