spaCy/spacy/en.pxd

from spacy.spacy cimport Language
from spacy.word cimport Lexeme
cimport cython


cpdef size_t ALPHA
cpdef size_t DIGIT 
cpdef size_t PUNCT
cpdef size_t SPACE
cpdef size_t LOWER
cpdef size_t UPPER
cpdef size_t TITLE
cpdef size_t ASCII

cpdef size_t OFT_LOWER
cpdef size_t OFT_TITLE
cpdef size_t OFT_UPPER

cpdef size_t PUNCT
cpdef size_t CONJ
cpdef size_t NUM
cpdef size_t N
cpdef size_t DET
cpdef size_t ADP
cpdef size_t ADJ
cpdef size_t ADV
cpdef size_t VERB
cpdef size_t NOUN
cpdef size_t PDT
cpdef size_t POS
cpdef size_t PRON
cpdef size_t PRT

cdef class English(spacy.Language):
    cdef int find_split(self, unicode word)


cdef English EN


cpdef Word lookup(unicode word)
cpdef list tokenize(unicode string)
* Reorganized code to accomodate Tokens class. Need string views before group_by and count_by can be done well. 2014-07-07 14:47:21 +04:00			`from spacy.spacy cimport Language`
* More refactoring 2014-08-25 18:42:22 +04:00			`from spacy.word cimport Lexeme`
* Struggling with arbitrary attr access... 2014-08-22 01:49:14 +04:00			`cimport cython`


* More refactoring 2014-08-25 18:42:22 +04:00			`cpdef size_t ALPHA`
			`cpdef size_t DIGIT`
			`cpdef size_t PUNCT`
			`cpdef size_t SPACE`
			`cpdef size_t LOWER`
			`cpdef size_t UPPER`
			`cpdef size_t TITLE`
			`cpdef size_t ASCII`

			`cpdef size_t OFT_LOWER`
			`cpdef size_t OFT_TITLE`
			`cpdef size_t OFT_UPPER`

			`cpdef size_t PUNCT`
			`cpdef size_t CONJ`
			`cpdef size_t NUM`
			`cpdef size_t N`
			`cpdef size_t DET`
			`cpdef size_t ADP`
			`cpdef size_t ADJ`
			`cpdef size_t ADV`
			`cpdef size_t VERB`
			`cpdef size_t NOUN`
			`cpdef size_t PDT`
			`cpdef size_t POS`
			`cpdef size_t PRON`
			`cpdef size_t PRT`

* Reorganized code to accomodate Tokens class. Need string views before group_by and count_by can be done well. 2014-07-07 14:47:21 +04:00			`cdef class English(spacy.Language):`
* Refactor spacy so that chunks return arrays of lexemes, so that there is properly one lexeme per word. 2014-08-18 21:14:00 +04:00			`cdef int find_split(self, unicode word)`
* Fixed group_by, removed idea of general attr_of function. 2014-08-22 02:02:37 +04:00
* Reorganized code to accomodate Tokens class. Need string views before group_by and count_by can be done well. 2014-07-07 14:47:21 +04:00
			`cdef English EN`
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 22:51:42 +04:00
* Fixed group_by, removed idea of general attr_of function. 2014-08-22 02:02:37 +04:00
* Moving to Word objects in place of the Lexeme struct. 2014-08-22 19:28:23 +04:00			`cpdef Word lookup(unicode word)`
			`cpdef list tokenize(unicode string)`