explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-04-03 16:54:12 +03:00
Code Issues Packages Projects Releases Wiki Activity
4d337eedf2
spaCy/spacy/tests/lang
History
Duygu Altinok 0e55f806dd
Turkish tokenization improvements () 
* added single and paired orth variants

* added token match

* added long text tokenization test

* inverted init

* normalized lemmas to lowercase

* more abbrevs

* tests for ordinals and abbrevs

* separated period abbvrevs to another list

* fiex typo

* added ordinal and abbrev tests

* added number tests for dates

* minor refinement

* added inflected abbrevs regex

* added percentage and inflection

* cosmetics

* added token match

* added url inflection tests

* excluded url tokens from custom pattern

* removed url match import
2020-10-29 09:43:17 +01:00
..
ar Revert 2019-09-29 17:32:12 +02:00
bn Revert 2019-09-29 17:32:12 +02:00
ca Revert 2019-09-29 17:32:12 +02:00
cs Adding num_like test for Czech () 2020-08-21 17:06:33 +02:00
da Reduce stored lexemes data, move feats to lookups () 2020-05-19 15:59:14 +02:00
de Tidy up and auto-format 2020-05-21 14:14:01 +02:00
el Tidy up and auto-format 2020-05-21 14:14:01 +02:00
en English: adds ordinal numbers () 2020-07-29 20:22:47 +02:00
es Tidy up and auto-format 2020-05-21 14:14:01 +02:00
eu Add __init__.py to eu and hy tests () 2020-04-08 20:03:06 +02:00
fa Fix syntax iterators for Persian () 2020-05-14 16:51:03 +02:00
fi add two abbreviations and some additional unit tests () 2020-02-22 14:12:32 +01:00
fr Tidy up and auto-format 2020-05-21 14:14:01 +02:00
ga Revert 2019-09-29 17:32:12 +02:00
gu Tidy up and auto-format 2020-05-21 14:14:01 +02:00
he Hebrew like num () 2020-08-24 14:30:05 +02:00
hi Hindi: Adds tests for lexical attributes (norm and like_num) () 2020-10-07 10:23:32 +02:00
hu Tidy up and auto-format 2020-03-25 12:28:12 +01:00
hy Add missing declaration 2020-05-21 17:30:05 +02:00
id Tidy up and auto-format 2020-05-21 14:14:01 +02:00
it Revert 2019-09-29 17:32:12 +02:00
ja Revert "Convert custom user_data to token extension format for Japanese tokenizer ()" () 2020-06-29 14:34:15 +02:00
ko Revert 2019-09-29 17:32:12 +02:00
lb Reduce stored lexemes data, move feats to lookups () 2020-05-19 15:59:14 +02:00
lt Improve Lithuanian tokenization () 2020-03-25 11:28:12 +01:00
mk Include Macedonian language () 2020-10-15 15:55:01 +02:00
ml Tidy up and auto-format 2020-05-21 14:14:01 +02:00
nb Tidy up and auto-format 2020-05-21 14:14:01 +02:00
ne Add Nepali Language () 2020-06-22 10:25:46 +02:00
nl Move lookup tables out of the core library () 2019-10-01 00:01:27 +02:00
pl Update Polish tokenizer for UD_Polish-PDB () 2020-05-19 15:59:55 +02:00
pt Revert 2019-09-29 17:32:12 +02:00
ro Move lookup tables out of the core library () 2019-10-01 00:01:27 +02:00
ru Revert 2019-09-29 17:32:12 +02:00
sa Added support for Sanskrit language () 2020-08-25 10:56:29 +02:00
sr Move lookup tables out of the core library () 2019-10-01 00:01:27 +02:00
sv Tidy up and auto-format 2020-05-21 14:14:01 +02:00
th Revert 2019-09-29 17:32:12 +02:00
tr Turkish tokenization improvements () 2020-10-29 09:43:17 +01:00
tt Add trailing whitespace to multiline test text () 2020-01-06 14:58:59 +01:00
uk Revert 2019-09-29 17:32:12 +02:00
ur Revert 2019-09-29 17:32:12 +02:00
yo Adding support for Yoruba Language () 2019-12-21 14:11:50 +01:00
zh Tidy up and auto-format 2020-05-21 14:14:01 +02:00
__init__.py Revert 2019-09-29 17:32:12 +02:00
test_attrs.py Tidy up and auto-format 2019-12-21 19:04:17 +01:00
test_initialize.py Adding support for Yoruba Language () 2019-12-21 14:11:50 +01:00