Matthew Honnibal 0f6bf2a2ee * Fix niggling memory error, which was caused by bug in the way tokens resized their internal vector.		2014-09-15 02:08:39 +02:00
..
__init__.py	* Basic punct tests updated and passing	2014-08-27 19:38:57 +02:00
_hashing.pxd	* Improve interface for PointerHash	2014-09-13 17:29:58 +02:00
_hashing.pyx	* Remove short-circuiting of initial_size argument for PointerHash	2014-09-15 01:30:49 +02:00
en.pxd	* Move EnglishTokens stuff to Tokens	2014-09-15 01:31:44 +02:00
en.pyx	* Move EnglishTokens stuff to Tokens	2014-09-15 01:31:44 +02:00
lang.pxd	* Move EnglishTokens stuff to Tokens	2014-09-15 01:31:44 +02:00
lang.pyx	* Move EnglishTokens stuff to Tokens	2014-09-15 01:31:44 +02:00
lexeme.pxd	* Restoring Lexeme-as-struct	2014-09-10 20:41:37 +02:00
lexeme.pyx	* Move EnglishTokens stuff to Tokens	2014-09-15 01:31:44 +02:00
orth.py	* Refactor to use tokens class.	2014-09-10 18:27:44 +02:00
ptb3.pxd	* Adding PTB3 tokenizer back in, so can understand how much boilerplate is in the docs for multiple tokenizers	2014-08-29 02:30:27 +02:00
ptb3.pyx	* Adding PTB3 tokenizer back in, so can understand how much boilerplate is in the docs for multiple tokenizers	2014-08-29 02:30:27 +02:00
tokens.pxd	* Move EnglishTokens stuff to Tokens	2014-09-15 01:31:44 +02:00
tokens.pyx	* Fix niggling memory error, which was caused by bug in the way tokens resized their internal vector.	2014-09-15 02:08:39 +02:00
word.pxd	* Moving back to lexeme structs	2014-09-10 20:41:47 +02:00
word.pyx	* Only store LexemeC structs in the vocabulary, transforming them to Lexeme objects for output. Moving away from Lexeme objects for Tokens soon.	2014-09-11 12:28:38 +02:00