adrianeboyd 0061992d95 Update Polish tokenizer for UD_Polish-PDB (#5432) ... Update Polish tokenizer for UD_Polish-PDB, which is a relatively major change from the existing tokenizer. Unused exceptions files and conflicting test cases removed. Co-authored-by: Matthew Honnibal <honnibal+gh@gmail.com>		2020-05-19 15:59:55 +02:00
..
af	💫 Add base Language classes for more languages (#3276)	2019-02-15 01:31:19 +11:00
ar	Add writing_system to ArabicDefaults (experimental)	2019-03-11 14:22:23 +01:00
bg	Update examples and languages.json [ci skip]	2019-09-15 17:56:40 +02:00
bn	Move lookup tables out of the core library (#4346)	2019-10-01 00:01:27 +02:00
ca	Move lookup tables out of the core library (#4346)	2019-10-01 00:01:27 +02:00
cs	💫 Add base Language classes for more languages (#3276)	2019-02-15 01:31:19 +11:00
da	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
de	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
el	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
en	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
es	Limiting noun_chunks for specific languages (#5396)	2020-05-14 12:58:06 +02:00
et	💫 Add base Language classes for more languages (#3276)	2019-02-15 01:31:19 +11:00
eu	Tidy up and auto-format	2020-03-25 12:28:12 +01:00
fa	Fix syntax iterators for Persian (#5437)	2020-05-14 16:51:03 +02:00
fi	add two abbreviations and some additional unit tests (#5040)	2020-02-22 14:12:32 +01:00
fr	Limiting noun_chunks for specific languages (#5396)	2020-05-14 12:58:06 +02:00
ga	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
gu	This PR adds Gujarati Language class along with (#5355)	2020-04-27 11:07:37 +02:00
he	Auto-format [ci skip]	2019-03-11 17:10:50 +01:00
hi	Fix example sentences in Hindi for grammatical errors (#4343)	2019-09-30 23:32:49 +02:00
hr	Move lookup tables out of the core library (#4346)	2019-10-01 00:01:27 +02:00
hu	Improve URL_PATTERN and handling in tokenizer (#4374)	2019-10-05 13:00:09 +02:00
hy	Armenian language support (#5246)	2020-04-03 13:02:18 +02:00
id	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
is	💫 Add base Language classes for more languages (#3276)	2019-02-15 01:31:19 +11:00
it	Tidy up and auto-format	2020-03-25 12:28:12 +01:00
ja	Tidy up and auto-format	2019-12-21 19:04:17 +01:00
kn	Add kannada examples (#5162)	2020-03-29 13:54:42 +02:00
ko	Very minor issues in Korean example sentences (#5446)	2020-05-17 13:43:34 +02:00
lb	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
lij	Tidy up and auto-format	2020-03-25 12:28:12 +01:00
lt	Tidy up and auto-format	2020-03-25 12:28:12 +01:00
lv	💫 Add base Language classes for more languages (#3276)	2019-02-15 01:31:19 +11:00
ml	Gh 5339 language class for malayalam (#5342)	2020-04-27 09:45:08 +02:00
mr	Tidy up [ci skip]	2019-06-12 13:38:23 +02:00
nb	Limiting noun_chunks for specific languages (#5396)	2020-05-14 12:58:06 +02:00
nl	Improve tokenization for UD Dutch corpora (#5259)	2020-04-06 13:18:07 +02:00
pl	Update Polish tokenizer for UD_Polish-PDB (#5432)	2020-05-19 15:59:55 +02:00
pt	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
ro	Improved Romanian tokenization for UD RRT (#5036)	2020-02-19 16:15:59 +01:00
ru	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
si	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
sk	Tidy up and auto-format	2020-03-25 12:28:12 +01:00
sl	💫 Add base Language classes for more languages (#3276)	2019-02-15 01:31:19 +11:00
sq	Update languages and examples (see #1107)	2019-06-26 16:19:17 +02:00
sr	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
sv	Limiting noun_chunks for specific languages (#5396)	2020-05-14 12:58:06 +02:00
ta	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
te	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
th	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
tl	Move lookup tables out of the core library (#4346)	2019-10-01 00:01:27 +02:00
tr	Move lookup tables out of the core library (#4346)	2019-10-01 00:01:27 +02:00
tt	Tidy up and auto-format	2019-08-20 17:36:34 +02:00
uk	Update Ukrainian lemmatizer with new lookups (#4359)	2019-10-02 12:04:06 +02:00
ur	add missing Urdu tags	2020-04-05 20:55:38 +05:00
vi	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
xx	Minor updates to language example sentences (#4608)	2019-11-07 22:34:58 +01:00
yo	Adding support for Yoruba Language (#4614)	2019-12-21 14:11:50 +01:00
zh	Add method to update / reset pkuseg user dict (#5404)	2020-05-08 11:21:46 +02:00
__init__.py	Remove imports in /lang/__init__.py	2017-05-08 23:58:07 +02:00
char_classes.py	Add CJK to character classes (#4884)	2020-01-08 16:50:19 +01:00
lex_attrs.py	Reduce stored lexemes data, move feats to lookups (#5238)	2020-05-19 15:59:14 +02:00
norm_exceptions.py	Update norm_exceptions.py (#3778)	2019-05-27 11:52:52 +02:00
punctuation.py	Allow period as suffix following punctuation (#4248)	2019-09-09 19:19:22 +02:00
tag_map.py	💫 Tidy up and auto-format .py files (#2983)	2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py	Use inline flags in token_match patterns (#5257)	2020-04-06 13:19:04 +02:00