spaCy/spacy/tests/lang
adrianeboyd 86c43e55fa
Improve Lithuanian tokenization (#5205)
* Improve Lithuanian tokenization

Modify Lithuanian tokenization to improve performance for
UD_Lithuanian-ALKSNIS.

* Update Lithuanian tokenizer tests
2020-03-25 11:28:12 +01:00
..
ar Revert #4334 2019-09-29 17:32:12 +02:00
bn Revert #4334 2019-09-29 17:32:12 +02:00
ca Revert #4334 2019-09-29 17:32:12 +02:00
da Disable failing abbreviation test 2020-03-25 09:39:26 +01:00
de Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
el Revert #4334 2019-09-29 17:32:12 +02:00
en Add tokenizer explain() debugging method (#4596) 2019-11-20 13:07:25 +01:00
es Revert #4334 2019-09-29 17:32:12 +02:00
eu Basque language added and tested. 2020-03-04 11:58:56 +05:00
fi add two abbreviations and some additional unit tests (#5040) 2020-02-22 14:12:32 +01:00
fr Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ga Revert #4334 2019-09-29 17:32:12 +02:00
he Revert #4334 2019-09-29 17:32:12 +02:00
hu Mark most Hungarian tokenizer test cases as slow (#4883) 2020-01-08 12:34:06 +01:00
id Revert #4334 2019-09-29 17:32:12 +02:00
it Revert #4334 2019-09-29 17:32:12 +02:00
ja Revert #4334 2019-09-29 17:32:12 +02:00
ko Revert #4334 2019-09-29 17:32:12 +02:00
lb Tidy up and auto-format 2019-12-21 19:04:17 +01:00
lt Improve Lithuanian tokenization (#5205) 2020-03-25 11:28:12 +01:00
nb Revert #4334 2019-09-29 17:32:12 +02:00
nl Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
pl Revert #4334 2019-09-29 17:32:12 +02:00
pt Revert #4334 2019-09-29 17:32:12 +02:00
ro Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
ru Revert #4334 2019-09-29 17:32:12 +02:00
sr Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
sv Tidy up and auto-format [ci skip] 2019-10-24 16:20:48 +02:00
th Revert #4334 2019-09-29 17:32:12 +02:00
tr Move lookup tables out of the core library (#4346) 2019-10-01 00:01:27 +02:00
tt Add trailing whitespace to multiline test text (#4877) 2020-01-06 14:58:59 +01:00
uk Revert #4334 2019-09-29 17:32:12 +02:00
ur Revert #4334 2019-09-29 17:32:12 +02:00
yo Adding support for Yoruba Language (#4614) 2019-12-21 14:11:50 +01:00
zh Rework Chinese language initialization and tokenization (#4619) 2019-11-11 14:23:21 +01:00
__init__.py Revert #4334 2019-09-29 17:32:12 +02:00
test_attrs.py Tidy up and auto-format 2019-12-21 19:04:17 +01:00
test_initialize.py Adding support for Yoruba Language (#4614) 2019-12-21 14:11:50 +01:00