Commit Graph

2 Commits

Author SHA1 Message Date
Matthew Honnibal
6f83dca218 * Fix import for ptb tokenization test 2014-08-22 17:05:44 +02:00
Matthew Honnibal
e60b958b7d * Add test to check how well we match ptb tokenizer. Needs more text. 2014-07-07 05:11:31 +02:00