..
af
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
ar
Add writing_system to ArabicDefaults (experimental)
2019-03-11 14:22:23 +01:00
bg
Update examples and languages.json [ci skip]
2019-09-15 17:56:40 +02:00
bn
Update invalid tag maps ( #5796 )
2020-07-22 16:02:51 +02:00
ca
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
cs
Adding support for Czech language ( #5826 )
2020-08-21 16:17:53 +02:00
da
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
de
Rename argument: doc_or_span/obj -> doclike ( #5463 )
2020-05-21 15:17:39 +02:00
el
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
en
English: adds ordinal numbers ( #5830 )
2020-07-29 20:22:47 +02:00
es
Fix span boundary handling in Spanish noun_chunks ( #5860 )
2020-08-03 13:53:15 +02:00
et
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
eu
Update invalid tag maps ( #5796 )
2020-07-22 16:02:51 +02:00
fa
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
fi
add two abbreviations and some additional unit tests ( #5040 )
2020-02-22 14:12:32 +01:00
fr
Remove is_base_form from French lemmatizer ( #5733 )
2020-07-09 22:11:13 +02:00
ga
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
gu
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
he
Auto-format [ci skip]
2019-03-11 17:10:50 +01:00
hi
Update examples.py ( #5820 )
2020-07-29 10:28:56 +02:00
hr
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
hu
Add tokenizer option for token match with affixes
2020-05-05 10:35:33 +02:00
hy
Update invalid tag maps ( #5796 )
2020-07-22 16:02:51 +02:00
id
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
is
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
it
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
ja
Mark Japanese documents as tagged. ( #5803 )
2020-07-23 08:57:01 +02:00
kn
Add kannada examples ( #5162 )
2020-03-29 13:54:42 +02:00
ko
fix bug in Korean language, resulting in 100x speedup by reducing overhead of mecab ( #5701 )
2020-07-06 17:03:33 +02:00
lb
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
lij
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
lt
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
lv
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
ml
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
mr
Tidy up [ci skip]
2019-06-12 13:38:23 +02:00
nb
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
ne
Add Nepali Language ( #5622 )
2020-06-22 10:25:46 +02:00
nl
Improve tokenization for UD Dutch corpora ( #5259 )
2020-04-06 13:18:07 +02:00
pl
Update invalid tag maps ( #5796 )
2020-07-22 16:02:51 +02:00
pt
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
ro
Update invalid tag maps ( #5796 )
2020-07-22 16:02:51 +02:00
ru
Update invalid tag maps ( #5796 )
2020-07-22 16:02:51 +02:00
si
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
sk
Tidy up and auto-format
2020-03-25 12:28:12 +01:00
sl
💫 Add base Language classes for more languages ( #3276 )
2019-02-15 01:31:19 +11:00
sq
Update languages and examples (see #1107 )
2019-06-26 16:19:17 +02:00
sr
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
sv
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
ta
Added Tamil Example Sentences ( #5583 )
2020-06-13 15:56:26 +02:00
te
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
th
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
tl
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
tr
Move lookup tables out of the core library ( #4346 )
2019-10-01 00:01:27 +02:00
tt
Tidy up and auto-format
2019-08-20 17:36:34 +02:00
uk
Update Ukrainian lemmatizer with new lookups ( #4359 )
2019-10-02 12:04:06 +02:00
ur
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
vi
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
xx
Minor updates to language example sentences ( #4608 )
2019-11-07 22:34:58 +01:00
yo
Adding support for Yoruba Language ( #4614 )
2019-12-21 14:11:50 +01:00
zh
Update pkuseg version ( #5774 )
2020-07-19 11:09:49 +02:00
__init__.py
Remove imports in /lang/__init__.py
2017-05-08 23:58:07 +02:00
char_classes.py
Add CJK to character classes ( #4884 )
2020-01-08 16:50:19 +01:00
lex_attrs.py
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
norm_exceptions.py
Update norm_exceptions.py ( #3778 )
2019-05-27 11:52:52 +02:00
punctuation.py
Allow period as suffix following punctuation ( #4248 )
2019-09-09 19:19:22 +02:00
tag_map.py
💫 Tidy up and auto-format .py files ( #2983 )
2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py
Rename to url_match
2020-05-22 12:41:03 +02:00