spaCy/spacy/lang/am/tokenizer_exceptions.py

from ...symbols import NORM, ORTH

_exc = {}


for exc_data in [
    {ORTH: "ት/ቤት"},
    {ORTH: "ወ/ሮ", NORM: "ወይዘሮ"},
]:
    _exc[exc_data[ORTH]] = [exc_data]


for orth in [
    "ዓ.ም.",
    "ኪ.ሜ.",
]:
    _exc[orth] = [{ORTH: orth}]


TOKENIZER_EXCEPTIONS = _exc
isort all the things 2023-06-26 12:41:03 +03:00			`from ...symbols import NORM, ORTH`
Add Amharic አማርኛ Language support (#6583) * Add Amharic to space * clean up * Add some PRON_LEMMA * add Tigrinya support * remove text_noun_chunks * Tigrinya Support * added some more details for ti * fix unit test * add amharic char range * changes from review * amharic and tigrinya share same unicode block * get rid of _amharic/_tigrinya in char_classes Co-authored-by: Josiah Solomon <jsolomon@meteorcomm.com> 2020-12-22 18:50:34 +03:00
			`_exc = {}`


			`for exc_data in [`
Tidy up and auto-format 2021-01-15 03:57:36 +03:00			`{ORTH: "ት/ቤት"},`
Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master-rc3 2021-01-14 12:49:30 +03:00			`{ORTH: "ወ/ሮ", NORM: "ወይዘሮ"},`
Add Amharic አማርኛ Language support (#6583) * Add Amharic to space * clean up * Add some PRON_LEMMA * add Tigrinya support * remove text_noun_chunks * Tigrinya Support * added some more details for ti * fix unit test * add amharic char range * changes from review * amharic and tigrinya share same unicode block * get rid of _amharic/_tigrinya in char_classes Co-authored-by: Josiah Solomon <jsolomon@meteorcomm.com> 2020-12-22 18:50:34 +03:00			`]:`
			`_exc[exc_data[ORTH]] = [exc_data]`


			`for orth in [`
			`"ዓ.ም.",`
			`"ኪ.ሜ.",`
			`]:`
			`_exc[orth] = [{ORTH: orth}]`


			`TOKENIZER_EXCEPTIONS = _exc`