..
af
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
ar
Add writing_system to ArabicDefaults (experimental)
2019-03-11 14:22:23 +01:00
bg
Update examples and languages.json [ci skip]
2019-09-15 17:56:40 +02:00
bn
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
ca
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
cs
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
da
Remove TAG from da/sv tokenizer exceptions ( #5428 )
2020-05-13 10:25:54 +02:00
de
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
el
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
en
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
es
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
et
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
eu
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
fa
Fix syntax iterators for Persian ( #5437 )
2020-05-14 16:51:03 +02:00
fi
add two abbreviations and some additional unit tests ( #5040 )
2020-02-22 14:12:32 +01:00
fr
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
ga
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
gu
This PR adds Gujarati Language class along with ( #5355 )
2020-04-27 11:07:37 +02:00
he
Auto-format [ci skip]
2019-03-11 17:10:50 +01:00
hi
Fix example sentences in Hindi for grammatical errors ( #4343 )
2019-09-30 23:32:49 +02:00
hr
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
hu
Improve URL_PATTERN and handling in tokenizer ( #4374 )
2019-10-05 13:00:09 +02:00
hy
Update v2.2.x for bugfix release ( #6384 )
2020-11-14 16:20:42 +08:00
id
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
is
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
it
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
ja
Tidy up and auto-format
2019-12-21 19:04:17 +01:00
kn
Add kannada examples ( #5162 )
2020-03-29 13:54:42 +02:00
ko
Very minor issues in Korean example sentences ( #5446 )
2020-05-17 13:43:34 +02:00
lb
Update tokenizer_exceptions.py
2020-02-14 12:02:15 +01:00
lij
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
lt
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
lv
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
ml
Gh 5339 language class for malayalam ( #5342 )
2020-04-27 09:45:08 +02:00
mr
Tidy up [ci skip]
2019-06-12 13:38:23 +02:00
nb
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
nl
Improve tokenization for UD Dutch corpora ( #5259 )
2020-04-06 13:18:07 +02:00
pl
Update v2.2.x for bugfix release ( #6384 )
2020-11-14 16:20:42 +08:00
pt
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
ro
Improved Romanian tokenization for UD RRT ( #5036 )
2020-02-19 16:15:59 +01:00
ru
Refactor lemmatizer and data table integration ( #4353 )
2019-10-01 21:36:03 +02:00
si
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
sk
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
sl
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
sq
Update languages and examples (see #1107 )
2019-06-26 16:19:17 +02:00
sr
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
sv
Limiting noun_chunks for specific languages ( #5396 )
2020-05-14 12:58:06 +02:00
ta
Remove stray print statement ( closes #3342 )
2019-02-27 15:35:04 +01:00
te
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
th
fix thai bug ( #3693 )
2019-05-10 14:21:34 +02:00
tl
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
tr
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
tt
Tidy up and auto-format
2019-08-20 17:36:34 +02:00
uk
Update Ukrainian lemmatizer with new lookups ( #4359 )
2019-10-02 12:04:06 +02:00
ur
add missing Urdu tags
2020-04-05 20:55:38 +05:00
vi
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
xx
Minor updates to language example sentences ( #4608 )
2019-11-07 22:34:58 +01:00
yo
Adding support for Yoruba Language ( #4614 )
2019-12-21 14:11:50 +01:00
zh
Update v2.2.x for bugfix release ( #6384 )
2020-11-14 16:20:42 +08:00
__init__.py
Remove imports in /lang/__init__.py
2017-05-08 23:58:07 +02:00
char_classes.py
Add CJK to character classes ( #4884 )
2020-01-08 16:50:19 +01:00
lex_attrs.py
Replacing regex library with re to increase tokenization speed ( #3218 )
2019-02-01 18:05:22 +11:00
norm_exceptions.py
Update norm_exceptions.py ( #3778 )
2019-05-27 11:52:52 +02:00
punctuation.py
Allow period as suffix following punctuation ( #4248 )
2019-09-09 19:19:22 +02:00
tag_map.py
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py
Use inline flags in token_match patterns ( #5257 )
2020-04-06 13:19:04 +02:00