spaCy/spacy/lang
Sofie 9a478b6db8 Clean up of char classes, few tokenizer fixes and faster default French tokenizer (#3293)
* splitting up latin unicode interval

* removing hyphen as infix for French

* adding failing test for issue 1235

* test for issue #3002 which now works

* partial fix for issue #2070

* keep the hyphen as infix for French (as it was)

* restore french expressions with hyphen as infix (as it was)

* added succeeding unit test for Issue #2656

* Fix issue #2822 with custom Italian exception

* Fix issue #2926 by allowing numbers right before infix /

* splitting up latin unicode interval

* removing hyphen as infix for French

* adding failing test for issue 1235

* test for issue #3002 which now works

* partial fix for issue #2070

* keep the hyphen as infix for French (as it was)

* restore french expressions with hyphen as infix (as it was)

* added succeeding unit test for Issue #2656

* Fix issue #2822 with custom Italian exception

* Fix issue #2926 by allowing numbers right before infix /

* remove duplicate

* remove xfail for Issue #2179 fixed by Matt

* adjust documentation and remove reference to regex lib
2019-02-20 22:10:13 +01:00
..
af 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
ar Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
bg 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
bn Merge branch 'master' into develop 2019-02-18 10:03:32 +01:00
ca Merge branch 'master' into develop 2019-02-17 17:51:17 +01:00
cs 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
da Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
de Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
el Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
en Remove pre-set lemma for "cause" (resolves #2165) 2018-12-14 12:51:18 +01:00
es 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
et 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
fa Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
fi 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
fr Clean up of char classes, few tokenizer fixes and faster default French tokenizer (#3293) 2019-02-20 22:10:13 +01:00
ga 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
he 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
hi 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
hr 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
hu Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
id Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
is 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
it Clean up of char classes, few tokenizer fixes and faster default French tokenizer (#3293) 2019-02-20 22:10:13 +01:00
ja Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
kn Fix typo 2019-02-14 12:26:56 +01:00
lt 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
lv 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
nb Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
nl 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
pl Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
pt 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
ro 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
ru Merge branch 'master' into develop 2019-02-07 21:10:08 +01:00
si 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
sk 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
sl 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
sq 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
sv Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
ta Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
te 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
th Merge branch 'master' into develop 2019-02-07 20:54:07 +01:00
tl Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
tr Merge branch 'master' into develop 2019-02-07 20:54:07 +01:00
tt Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
uk Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00
ur Improve Italian & Urdu tokenization accuracy (#3228) 2019-02-04 22:39:25 +01:00
vi 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
xx 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
zh 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
__init__.py Remove imports in /lang/__init__.py 2017-05-08 23:58:07 +02:00
char_classes.py Clean up of char classes, few tokenizer fixes and faster default French tokenizer (#3293) 2019-02-20 22:10:13 +01:00
lex_attrs.py Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
norm_exceptions.py 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
punctuation.py Clean up of char classes, few tokenizer fixes and faster default French tokenizer (#3293) 2019-02-20 22:10:13 +01:00
tag_map.py 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py Tidy up and fix small bugs and typos 2019-02-08 14:14:49 +01:00