explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-02-04 21:50:35 +03:00
Code Issues Packages Projects Releases Wiki Activity

Add Chinese punctuation

Browse Source 
Add Chinese punctuation.
This commit is contained in:
Yu-chun Huang 2017-09-19 16:57:24 +08:00 committed by GitHub
parent 7692b8c071
commit 1f1f35dcd0
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/language_data/punctuation.py
View File

@ -19,11 +19,13 @@ _CURRENCY = r"""
_QUOTES = r""" _QUOTES = r"""
' '' " ” “ `` ` ‘ ´ ‚ , „ » « ' '' " ” “ `` ` ‘ ´ ‚ , „ » «
「 」 『 』 （ ） 〔 〕 【 】 《 》 〈 〉
""" """
_PUNCT = r""" _PUNCT = r"""
… , : ; \! \? ¿ ¡ \( \) \[ \] \{ \} < > _ # \* & … , : ; \! \? ¿ ¡ \( \) \[ \] \{ \} < > _ # \* &
。？ ！ ， 、 ； ： ～
""" """