spaCy/spacy/lang
Ines Montani cf65a80f36 Refactor lemmatizer and data table integration (#4353)
* Move test

* Allow default in Lookups.get_table

* Start with blank tables in Lookups.from_bytes

* Refactor lemmatizer to hold instance of Lookups

* Get lookups table within the lemmatization methods to make sure it references the correct table (even if the table was replaced or modified, e.g. when loading a model from disk)
* Deprecate other arguments on Lemmatizer.__init__ and expect Lookups for consistency
* Remove old and unsupported Lemmatizer.load classmethod
* Refactor language-specific lemmatizers to inherit as much as possible from base class and override only what they need

* Update tests and docs

* Fix more tests

* Fix lemmatizer

* Upgrade pytest to try and fix weird CI errors

* Try pytest 4.6.5
2019-10-01 21:36:03 +02:00
..
af 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
ar Add writing_system to ArabicDefaults (experimental) 2019-03-11 14:22:23 +01:00
bg Update examples and languages.json [ci skip] 2019-09-15 17:56:40 +02:00
bn Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ca Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
cs 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
da Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
de Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
el Refactor lemmatizer and data table integration (#4353) 2019-10-01 21:36:03 +02:00
en Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
es Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
et 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
fa Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
fi 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
fr Refactor lemmatizer and data table integration (#4353) 2019-10-01 21:36:03 +02:00
ga 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
he Auto-format [ci skip] 2019-03-11 17:10:50 +01:00
hi Fix example sentences in Hindi for grammatical errors (#4343) 2019-09-30 23:32:49 +02:00
hr Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
hu Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
id Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
is 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
it Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ja Tidy up and auto-format [ci skip] 2019-09-14 12:58:06 +02:00
kn Enhancing Kannada language Resources (#3755) 2019-05-20 12:56:10 +02:00
ko Fix Korean 2019-09-29 17:10:56 +02:00
lt Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
lv 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
mr Tidy up [ci skip] 2019-06-12 13:38:23 +02:00
nb Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
nl Refactor lemmatizer and data table integration (#4353) 2019-10-01 21:36:03 +02:00
pl Tidy up and auto-format 2019-08-20 17:36:34 +02:00
pt Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ro Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ru Refactor lemmatizer and data table integration (#4353) 2019-10-01 21:36:03 +02:00
si 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
sk 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
sl 💫 Add base Language classes for more languages (#3276) 2019-02-15 01:31:19 +11:00
sq Update languages and examples (see #1107) 2019-06-26 16:19:17 +02:00
sr Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
sv Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ta Remove stray print statement (closes #3342) 2019-02-27 15:35:04 +01:00
te 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
th fix thai bug (#3693) 2019-05-10 14:21:34 +02:00
tl Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
tr Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
tt Tidy up and auto-format 2019-08-20 17:36:34 +02:00
uk Also apply hotfix to Ukrainian lemmaitzer 2019-09-27 18:03:26 +02:00
ur Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
vi 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
xx 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
zh Tidy up and auto-format 2019-08-20 17:36:34 +02:00
__init__.py Remove imports in /lang/__init__.py 2017-05-08 23:58:07 +02:00
char_classes.py Tidy up and auto-format 2019-09-18 20:27:03 +02:00
lex_attrs.py Replacing regex library with re to increase tokenization speed (#3218) 2019-02-01 18:05:22 +11:00
norm_exceptions.py Update norm_exceptions.py (#3778) 2019-05-27 11:52:52 +02:00
punctuation.py Allow period as suffix following punctuation (#4248) 2019-09-09 19:19:22 +02:00
tag_map.py 💫 Tidy up and auto-format .py files (#2983) 2018-11-30 17:03:03 +01:00
tokenizer_exceptions.py Make the emoticon list a raw string (#4139) 2019-08-18 15:17:13 +02:00