5 Commits

Author	SHA1	Message	Date
Matthew Honnibal	fd4e61e58b	* Fixed contraction tests. Need to correct problem with the way case stats and tag stats are supposed to work.	2014-08-27 20:22:33 +02:00
Matthew Honnibal	9815c7649e	* Refactor around Word objects, adapting tests. Tests passing, except for string views.	2014-08-23 19:55:06 +02:00
Matthew Honnibal	01469b0888	* Refactor spacy so that chunks return arrays of lexemes, so that there is properly one lexeme per word.	2014-08-18 19:14:00 +02:00
Matthew Honnibal	25849fc926	* Generalize tokenization rules to capitals	2014-07-07 05:07:21 +02:00
Matthew Honnibal	e4263a241a	* Tests passing for reorganized version	2014-07-07 04:23:46 +02:00