2 Commits

Author	SHA1	Message	Date
Daniël de Kok	e2b70df012	Configure isort to use the Black profile, recursively isort the spacy module (#12721) ... * Use isort with Black profile * isort all the things * Fix import cycles as a result of import sorting * Add DOCBIN_ALL_ATTRS type definition * Add isort to requirements * Remove isort from build dependencies check * Typo	2023-06-14 17:48:41 +02:00
Adriane Boyd	1d59fdbd39	Update Vietnamese tokenizer (#8099) ... * Adapt tokenization methods from `pyvi` to preserve text encoding and whitespace * Add serialization support similar to Chinese and Japanese Note: as for Chinese and Japanese, some settings are duplicated in `config.cfg` and `tokenizer/cfg`.	2021-05-17 18:16:20 +10:00