ines 84189c1cab Add 'xx' language ID for multi-language support ... Allows models to specify their language ID as 'xx'.		2017-05-28 00:58:59 +02:00
..
bn	Add symbols class to punctuation rules to handle emoji (see #1088)	2017-05-27 17:57:10 +02:00
da	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
de	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
en	Remove unused export	2017-05-28 00:57:59 +02:00
es	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
fi	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
fr	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
he	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
hu	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
it	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
ja
nb	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
nl	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
pl	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
pt	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
sv	Move Defaults subclass to module scope (necessary for pickling)	2017-05-20 19:02:27 +02:00
xx	Add 'xx' language ID for multi-language support	2017-05-28 00:58:59 +02:00
zh
__init__.py
char_classes.py	Add symbols class to punctuation rules to handle emoji (see #1088)	2017-05-27 17:57:10 +02:00
entity_rules.py
lex_attrs.py	Make sure like_email returns bool	2017-05-09 11:37:29 +02:00
punctuation.py	Add symbols class to punctuation rules to handle emoji (see #1088)	2017-05-27 17:57:10 +02:00
tag_map.py
tokenizer_exceptions.py