..
af
ar
bg
bn
ca
cs
da
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
de
Rename argument: doc_or_span/obj -> doclike ( #5463 )
2020-05-21 15:17:39 +02:00
el
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
en
Add "c'mon" token exception ( #5570 )
2020-06-10 21:54:06 +02:00
es
Spanish tokenizer exception and examples improvement ( #5531 )
2020-06-01 18:18:34 +02:00
et
eu
fa
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
fi
fr
corrected issue #5524 changed <U+009C> 'STRING TERMINATOR' for <U+0153> LATIN SMALL LIGATURE OE' ( #5526 )
2020-05-31 22:08:12 +02:00
ga
gu
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
he
hi
hr
hu
Add tokenizer option for token match with affixes
2020-05-05 10:35:33 +02:00
hy
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
id
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
is
it
ja
Expand Japanese requirements warning ( #5572 )
2020-06-11 13:47:37 +02:00
kn
ko
Very minor issues in Korean example sentences ( #5446 )
2020-05-17 13:43:34 +02:00
lb
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
lij
lt
lv
ml
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
mr
nb
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
nl
Improve tokenization for UD Dutch corpora ( #5259 )
2020-04-06 13:18:07 +02:00
pl
Fix Polish lemmatizer for deserialized models
2020-05-26 09:56:12 +02:00
pt
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
ro
ru
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
si
sk
sl
sq
sr
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
sv
span / noun chunk has +1 because end is exclusive
2020-05-21 19:56:56 +02:00
ta
Added Tamil Example Sentences ( #5583 )
2020-06-13 15:56:26 +02:00
te
th
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
tl
tr
tt
uk
ur
Tidy up and auto-format
2020-05-21 14:14:01 +02:00
vi
xx
yo
zh
Map NR to PROPN ( #5512 )
2020-05-26 22:30:53 +02:00
__init__.py
char_classes.py
lex_attrs.py
Reduce stored lexemes data, move feats to lookups ( #5238 )
2020-05-19 15:59:14 +02:00
norm_exceptions.py
punctuation.py
tag_map.py
tokenizer_exceptions.py
Rename to url_match
2020-05-22 12:41:03 +02:00