6 Commits

Author	SHA1	Message	Date
Ines Montani	991669c934	Tidy up and auto-format	2021-01-05 13:41:53 +11:00
Adriane Boyd	724831b066	Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master ... * Update Macedonian for v3 * Update Turkish for v3	2020-11-25 11:49:34 +01:00
Duygu Altinok	0e55f806dd	Turkish tokenization improvements (#6268) ... * added single and paired orth variants * added token match * added long text tokenization test * inverted init * normalized lemmas to lowercase * more abbrevs * tests for ordinals and abbrevs * separated period abbvrevs to another list * fiex typo * added ordinal and abbrev tests * added number tests for dates * minor refinement * added inflected abbrevs regex * added percentage and inflection * cosmetics * added token match * added url inflection tests * excluded url tokens from custom pattern * removed url match import	2020-10-29 09:43:17 +01:00
Ines Montani	539b0c10da	Tidy up and auto-format	2020-10-10 19:14:48 +02:00
Duygu Altinok	80fb1bffc9	Ordinal numbers for Turkish (#6142) ... * minor ordinal number addition * fixed typo * added corresponding lexical test	2020-10-09 10:13:15 +02:00
Duygu Altinok	b95a11dd95	Ordinal numbers for Turkish (#6142) ... * minor ordinal number addition * fixed typo * added corresponding lexical test	2020-10-07 10:25:37 +02:00