3 Commits

Author	SHA1	Message	Date
Adriane Boyd	2f981d5af1	Remove corpus-specific tag maps ... Remove corpus-specific tag maps from the language data for languages without custom tokenizers. For languages with custom word segmenters that also provide tags (Japanese and Korean), the tag maps for the custom tokenizers are kept as the default. The default tag maps for languages without custom tokenizers are now the default tag map from `lang/tag_map/py`, UPOS -> UPOS.	2020-07-15 15:58:29 +02:00
Ines Montani	f12a46472c	Remove unicode declarations	2020-03-26 15:18:32 +01:00
Muhammad Irfan	03376c9d9b	Basque language added and tested.	2020-03-04 11:58:56 +05:00