* Add rule to ensure ordinals are preserved as single tokens

This commit is contained in:
Matthew Honnibal 2015-09-22 12:26:05 +10:00
parent 596fde8daa
commit 528e26a506

View File

@ -22,5 +22,6 @@
\.\.
\.\.\.
\.\.\.\.
^\d+\.$
(?<=[a-z0-9)\]"'%\)])\.
(?<=[0-9])km