Andrew Ongko 81564cc4e8 Update Indonesian model (#2752) ... * adding e-KTP in tokenizer exceptions list * add exception token * removing lines with containing space as it won't matter since we use .split() method in the end, added new tokens in exception * add tokenizer exceptions list * combining base_norms with norm_exceptions * adding norm_exception * fix double key in lemmatizer * remove unused import on punctuation.py * reformat stop_words to reduce number of lines, improve readibility * updating tokenizer exception * implement is_currency for lang/id * adding orth_first_upper in tokenizer_exceptions * update the norm_exception list * remove bunch of abbreviations * adding contributors file		2018-09-14 12:30:32 +02:00
..
ar	Additions to Arabic stop words. (#2422)	2018-06-08 02:33:23 +02:00
bn	update bengali token rules for hyphen and digits (#2731)	2018-09-05 21:49:00 +02:00
da	Add Danish lemmatizer (#2184)	2018-04-07 19:07:28 +02:00
de	lemmatizer: correct lemma for Rang (#2537)	2018-07-10 13:11:19 +02:00
el	Optimize Greek language support (#2658)	2018-08-14 02:31:32 +02:00
en	quick typo fix	2018-03-24 17:26:35 +01:00
es	Fix Spanish noun_chunks (resolves #2210)	2018-04-18 18:44:01 -04:00
fa	add persian language	2018-01-27 13:27:26 +03:30
fi	Enhancement/lang fi examples (#2547)	2018-07-15 09:50:27 +02:00
fr	Update French stop words (resolves #2540)	2018-07-24 23:41:51 +02:00
ga	Remove comma that caused list to wrap in tuple!	2017-10-31 20:13:16 +01:00
he	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
hi	Added numbers to ../lang/hi/lex_attrs.py (#2629)	2018-08-08 16:06:11 +02:00
hr	Update stop_words.py	2018-03-24 17:31:24 +01:00
hu	Don't copy exception dicts if not necessary and tidy up	2017-10-31 21:05:29 +01:00
id	Update Indonesian model (#2752)	2018-09-14 12:30:32 +02:00
it	Fix syntax error in italian lemmatizer	2018-04-03 23:13:22 +02:00
ja	Add Japanese stop words. (#2549)	2018-07-17 10:12:48 +02:00
nb	changed tag_map, morph_rules, lemmatizer for Norwegian (#2565)	2018-07-19 19:38:24 +02:00
nl	Fix typo [ci skip]	2018-07-24 18:45:40 +02:00
pl	Lex _attrs for polish language (#2750)	2018-09-10 11:53:57 +02:00
pt	Add words to portuguese language _num_words (#2759)	2018-09-14 12:30:16 +02:00
ro	Updates to Romanian support (#2354)	2018-05-24 11:40:00 +02:00
ru	Update examples.py (#2597)	2018-07-25 22:20:24 +02:00
sv	Add abbreviations from UD_Swedish-Talbanken (#2613)	2018-08-07 13:53:17 +02:00
te	Basic support for Telugu language (#2751)	2018-09-10 11:53:18 +02:00
th	Don't copy exception dicts if not necessary and tidy up	2017-10-31 21:05:29 +01:00
tr	Port over Turkish changes	2018-03-24 17:31:07 +01:00
tt	Add Tatar Language Support (#2444)	2018-06-19 10:17:53 +02:00
ur	Add Urdu Language Support (#2430)	2018-06-22 11:14:03 +02:00
vi	Add support for Vietnamese in spaCy by leveraging Pyvi, an external Vietnamese tokenizer (#2155)	2018-03-29 12:19:51 +02:00
xx	Tidy up language data	2017-10-11 02:22:49 +02:00
zh	Fix Chinese language related bugs (#2634)	2018-08-07 11:26:31 +02:00
__init__.py	Remove imports in /lang/__init__.py	2017-05-08 23:58:07 +02:00
char_classes.py	Greek language optimizations (#2558)	2018-07-18 18:51:38 +02:00
entity_rules.py	Reorganise entity rules	2017-05-09 01:37:10 +02:00
lex_attrs.py	Merge pull request #1891 from fucking-signup/master	2018-02-18 13:47:47 +01:00
norm_exceptions.py	Update base norm exceptions with more unicode characters	2017-10-14 14:58:52 +02:00
punctuation.py	Add symbols class to punctuation rules to handle emoji (see #1088)	2017-05-27 17:57:10 +02:00
tag_map.py	Fix formatting	2017-05-09 11:08:14 +02:00
tokenizer_exceptions.py	Tidy up tokenizer exceptions	2017-11-01 23:02:45 +01:00