explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-01-28 18:24:08 +03:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1333 from galaxyh/master

Browse Source 
Add Chinese punctuation
This commit is contained in:
Matthew Honnibal 2017-09-19 15:09:30 +02:00 committed by GitHub
commit aa728b33ca
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
spacy/language_data/punctuation.py
View File

@ -19,11 +19,13 @@ _CURRENCY = r"""
_QUOTES = r""" _QUOTES = r"""
' '' " ” “ `` ` ‘ ´ ‚ , „ » « ' '' " ” “ `` ` ‘ ´ ‚ , „ » «
「 」 『 』 （ ） 〔 〕 【 】 《 》 〈 〉
""" """
_PUNCT = r""" _PUNCT = r"""
… , : ; \! \? ¿ ¡ \( \) \[ \] \{ \} < > _ # \* & … , : ; \! \? ¿ ¡ \( \) \[ \] \{ \} < > _ # \* &
。 ？ ！ ， 、 ； ： ～
""" """