5 Commits

Author	SHA1	Message	Date
Adriane Boyd	2f981d5af1	Remove corpus-specific tag maps ... Remove corpus-specific tag maps from the language data for languages without custom tokenizers. For languages with custom word segmenters that also provide tags (Japanese and Korean), the tag maps for the custom tokenizers are kept as the default. The default tag maps for languages without custom tokenizers are now the default tag map from `lang/tag_map/py`, UPOS -> UPOS.	2020-07-15 15:58:29 +02:00
Ines Montani	40bb918a4c	Remove unicode declarations and tidy up	2020-06-21 22:34:10 +02:00
Marat M. Yavrumyan	8120b641cc	Update lex_attrs.py (#5608)	2020-06-19 20:00:34 +02:00
Ines Montani	d8f3190c0a	Tidy up and auto-format	2020-05-21 14:14:01 +02:00
YohannesDatasci	beef184e53	Armenian language support (#5246) ... * add Armenian language and test cases * agreement submission	2020-04-03 13:02:18 +02:00