spaCy/lang_data/en/infix.txt

mirror of https://github.com/explosion/spaCy.git synced 2024-09-21 19:39:13 +03:00
\.\.\.
(?<=[a-z])\.(?=[A-Z])
(?<=[a-zA-Z])-(?=[a-zA-z])
(?<=[0-9])-(?=[0-9])
* Fix ... tokenization, and correct orth inconsistencies in specials.json 2015-07-20 13:09:34 +03:00			`\.\.\.`
* Revert bad infix change 2015-07-26 18:32:37 +03:00			`(?<=[a-z])\.(?=[A-Z])`
* Fix ... tokenization, and correct orth inconsistencies in specials.json 2015-07-20 13:09:34 +03:00			`(?<=[a-zA-Z])-(?=[a-zA-z])`
* Add tokenizer rule to fix numeric range tokenization 2015-10-17 07:49:51 +03:00			`(?<=[0-9])-(?=[0-9])`