spaCy/spacy/utf8string.pxd

from preshed.maps cimport PreshMap
from cymem.cymem cimport Pool

from .typedefs cimport utf8_t, id_t, hash_t


cdef struct Utf8Str:
    id_t i
    hash_t key
    utf8_t chars
    int length


cdef class StringStore:
    cdef Pool mem
    cdef PreshMap _map
    cdef Utf8Str* strings
    cdef int size
    cdef int _resize_at
    
    cdef Utf8Str* intern(self, char* chars, int length) except NULL
* Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags. 2014-10-23 19:23:42 +04:00			`from preshed.maps cimport PreshMap`
			`from cymem.cymem cimport Pool`

			`from .typedefs cimport utf8_t, id_t, hash_t`


			`cdef struct Utf8Str:`
			`id_t i`
			`hash_t key`
			`utf8_t chars`
			`int length`


			`cdef class StringStore:`
			`cdef Pool mem`
* Make StringStore.__getitem__ accept unicode-typed keys. 2014-12-02 17:33:20 +03:00			`cdef PreshMap _map`
* Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags. 2014-10-23 19:23:42 +04:00			`cdef Utf8Str* strings`
			`cdef int size`
			`cdef int _resize_at`

			`cdef Utf8Str* intern(self, char* chars, int length) except NULL`