spaCy/spacy/typedefs.pxd

from libc.stdint cimport uint16_t, uint32_t, uint64_t, uintptr_t, int32_t
from libc.stdint cimport uint8_t

from libc.stdint cimport UINT64_MAX as err_hash_t
from libc.stdint cimport UINT64_MAX as err_flags_t
from libc.stdint cimport UINT64_MAX as err_len_t
from libc.stdint cimport UINT64_MAX as err_tag_t

ctypedef uint64_t hash_t
ctypedef char* utf8_t
ctypedef int32_t attr_t
ctypedef uint64_t flags_t
ctypedef uint16_t len_t
ctypedef uint16_t tag_t
* Tests passing on round-trip pack/unpack on basic example 2015-07-17 22:20:48 +03:00			`from libc.stdint cimport uint16_t, uint32_t, uint64_t, uintptr_t, int32_t`
* Working morphology and lemmatisation. POS tagging quite fast. 2014-12-10 00:09:32 +03:00			`from libc.stdint cimport uint8_t`
* Add typedefs file 2014-09-18 01:10:32 +04:00
Work on Issue #285: intern strings into document-specific pools, to address streaming data memory growth. StringStore.__getitem__ now raises KeyError when it can't find the string. Use StringStore.intern() to get the old behaviour. Still need to hunt down all uses of StringStore.__getitem__ in library and do testing, but logic looks good. 2016-09-30 11:14:47 +03:00			`from libc.stdint cimport UINT64_MAX as err_hash_t`
			`from libc.stdint cimport UINT64_MAX as err_flags_t`
			`from libc.stdint cimport UINT64_MAX as err_len_t`
			`from libc.stdint cimport UINT64_MAX as err_tag_t`
* Tmp 2014-12-20 21:36:29 +03:00
* Add typedefs file 2014-09-18 01:10:32 +04:00			`ctypedef uint64_t hash_t`
			`ctypedef char* utf8_t`
* Tests passing on round-trip pack/unpack on basic example 2015-07-17 22:20:48 +03:00			`ctypedef int32_t attr_t`
* Add typedef for attr_t. Change flag_t to flags_t 2014-12-03 03:06:31 +03:00			`ctypedef uint64_t flags_t`
* Fiddle with data types on Lexeme, to compress them to a much smaller size. 2014-10-30 07:42:15 +03:00			`ctypedef uint16_t len_t`
			`ctypedef uint16_t tag_t`