explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-11-13 05:07:03 +03:00
Code Issues Packages Projects Releases Wiki Activity

* Add rule to ensure ordinals are preserved as single tokens

Browse Source
This commit is contained in:
Matthew Honnibal 2015-09-22 12:26:05 +10:00
parent 596fde8daa
commit 528e26a506
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
spacy/de/data/tokenizer/suffix.txt
View File

@ -22,5 +22,6 @@
\.\. \.\.
\.\.\. \.\.\.
\.\.\.\. \.\.\.\.
^\d+\.$
(?<=[a-z0-9)\]"'%\)])\. (?<=[a-z0-9)\]"'%\)])\.
(?<=[0-9])km (?<=[0-9])km