spaCy/spacy/tests/lang/grc
Jacobo Myerston 3e8bc1272f
add punctuation to grc (#11426)
* add punctuation to grc

Add support for special editorial punctuation that is common in ancient Greek texts.  Ancient Greek texts, as found in digital and print form, have been largely edited by scholars. Restorations and improvements are normally marked with special characters that need to be handled properly by the tokenizer.

* add unit tests

* simplify regex

* move generic quotes to char classes

* rename unit test

* fix regex

Co-authored-by: Adriane Boyd <adrianeboyd@gmail.com>

Co-authored-by: svlandeg <svlandeg@github.com>
Co-authored-by: Sofie Van Landeghem <svlandeg@users.noreply.github.com>
Co-authored-by: Adriane Boyd <adrianeboyd@gmail.com>
2022-09-27 11:38:56 +02:00
..
__init__.py Added ancient Greek language support (#8606) 2021-07-15 10:27:17 +02:00
test_text.py Added ancient Greek language support (#8606) 2021-07-15 10:27:17 +02:00
test_tokenizer.py add punctuation to grc (#11426) 2022-09-27 11:38:56 +02:00