spaCy/spacy/lang/lb
Christoph Purschke a7ee4b6f17 new tests & tokenization fixes (#4734)
- added some tests for tokenization issues
- fixed some issues with tokenization of words with hyphen infix
- rewrote the "tokenizer_exceptions.py" file (stemming from the German version)
2019-12-01 23:08:21 +01:00
..
__init__.py Fix basic language support for Luxembourgish (by adding punctuation.py) (#4648) 2019-11-15 16:16:47 +01:00
examples.py Tidy up and auto-format 2019-10-18 11:27:38 +02:00
lex_attrs.py Tidy up and auto-format 2019-10-18 11:27:38 +02:00
norm_exceptions.py new tests & tokenization fixes (#4734) 2019-12-01 23:08:21 +01:00
punctuation.py new tests & tokenization fixes (#4734) 2019-12-01 23:08:21 +01:00
stop_words.py Tidy up and auto-format 2019-10-18 11:27:38 +02:00
tag_map.py Tidy up and auto-format 2019-10-18 11:27:38 +02:00
tokenizer_exceptions.py new tests & tokenization fixes (#4734) 2019-12-01 23:08:21 +01:00