Matthew Honnibal 677e111ee7 * Revise tokenization rules to match PTB. Rules are pretty messy around periods, need better support for these.		2014-12-07 22:04:47 +11:00
..
case	* Reorganized, moving language-independent stuff to spacy. The functions in spacy ask for the dictionaries and split function on input, but the language-specific modules are curried versions that use the globals	2014-07-07 04:21:06 +02:00
clusters	* Reorganized, moving language-independent stuff to spacy. The functions in spacy ask for the dictionaries and split function on input, but the language-specific modules are curried versions that use the globals	2014-07-07 04:21:06 +02:00
infix	* Update tokenization rules	2014-11-04 01:06:00 +11:00
prefix	* Revise tokenization rules to match PTB. Rules are pretty messy around periods, need better support for these.	2014-12-07 22:04:47 +11:00
suffix	* Add '' double quote to suffixes file	2014-11-03 00:12:59 +11:00
tokenization	* Revise tokenization rules to match PTB. Rules are pretty messy around periods, need better support for these.	2014-12-07 22:04:47 +11:00