Merge pull request #1333 from galaxyh/master

Add Chinese punctuation
This commit is contained in:
Matthew Honnibal 2017-09-19 15:09:30 +02:00 committed by GitHub
commit aa728b33ca

View File

@ -19,11 +19,13 @@ _CURRENCY = r"""
_QUOTES = r"""
' '' " ” “ `` ` ´ , „ » «
"""
_PUNCT = r"""
, : ; \! \? ¿ ¡ \( \) \[ \] \{ \} < > _ # \* &
"""