3 Commits

Author	SHA1	Message	Date
Matthew Honnibal	35a18250cc	* Upd tests, avoiding unnecessary processing to make testing faster	2015-01-30 10:41:55 +11:00
Matthew Honnibal	73f200436f	* Tests passing except for morphology/lemmatization stuff	2014-12-23 11:40:32 +11:00
Matthew Honnibal	0152831c89	* Refactor tokenization, enable cache, and ensure we look up specials correctly even when there's confusing punctuation surrounding the token.	2014-09-16 18:01:46 +02:00