spaCy/spacy/structs.pxd

from libc.stdint cimport uint8_t, uint32_t, int32_t, uint64_t

from .typedefs cimport flags_t, attr_t, hash_t
from .parts_of_speech cimport univ_pos_t


cdef struct LexemeC:
    float* vector

    flags_t flags

    attr_t lang

    attr_t id
    attr_t length

    attr_t orth
    attr_t lower
    attr_t norm
    attr_t shape
    attr_t prefix
    attr_t suffix

    attr_t cluster

    float prob
    float sentiment
    float l2_norm


cdef struct Entity:
    int start
    int end
    int label


cdef struct TokenC:
    const LexemeC* lex
    uint64_t morph
    univ_pos_t pos
    bint spacy
    int tag
    int idx
    int lemma
    int sense
    int head
    int dep
    bint sent_start

    uint32_t l_kids
    uint32_t r_kids
    uint32_t l_edge
    uint32_t r_edge

    int ent_iob
    int ent_type
* Hack on morphology structs 2015-08-26 20:18:36 +03:00			`from libc.stdint cimport uint8_t, uint32_t, int32_t, uint64_t`
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00
* Fix type declarations for attr_t. Remove unused id_t. 2015-07-18 23:39:57 +03:00			`from .typedefs cimport flags_t, attr_t, hash_t`
* Move POS tag definitions to parts_of_speech.pxd 2015-01-25 08:31:07 +03:00			`from .parts_of_speech cimport univ_pos_t`
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00

* Tmp commit. Refactoring to create a Python Lexeme class. 2015-01-12 02:26:22 +03:00			`cdef struct LexemeC:`
* Rename .repvec to .vector in C API 2015-11-03 15:47:59 +03:00			`float* vector`
* Tmp commit. Refactoring to create a Python Lexeme class. 2015-01-12 02:26:22 +03:00
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`flags_t flags`
Remove trailing whitespace 2015-04-19 11:31:31 +03:00
introduce lang field for LexemeC to hold language id put noun_chunk logic into iterators.py for each language separately 2016-03-10 15:01:34 +03:00			`attr_t lang`

* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`attr_t id`
* Tmp. Refactoring, introducing a Lexeme PyObject. 2015-01-12 03:23:44 +03:00			`attr_t length`

* Rename sic to orth 2015-01-22 18:08:25 +03:00			`attr_t orth`
* Rename NORM1 and NORM2 attrs to lower and norm 2015-01-23 22:17:03 +03:00			`attr_t lower`
			`attr_t norm`
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`attr_t shape`
			`attr_t prefix`
			`attr_t suffix`
Remove trailing whitespace 2015-04-19 11:31:31 +03:00
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`attr_t cluster`

			`float prob`
			`float sentiment`
* Add L2 norm field to LexemeC struct 2015-02-07 16:43:17 +03:00			`float l2_norm`
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00

* Tmp 2015-03-09 08:46:22 +03:00			`cdef struct Entity:`
			`int start`
			`int end`
			`int label`
* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring. 2015-03-10 20:00:23 +03:00
* Tmp 2015-03-09 08:46:22 +03:00
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`cdef struct TokenC:`
* Tmp commit. Refactoring to create a Python Lexeme class. 2015-01-12 02:26:22 +03:00			`const LexemeC* lex`
* More work on language-generic parsing 2015-08-28 03:02:33 +03:00			`uint64_t morph`
* Move POS tag definitions to parts_of_speech.pxd 2015-01-25 08:31:07 +03:00			`univ_pos_t pos`
* Add TokenC.spacy attr 2015-07-13 20:48:07 +03:00			`bint spacy`
* Work on word vectors, and other stuff 2015-01-17 08:21:17 +03:00			`int tag`
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`int idx`
			`int lemma`
			`int sense`
			`int head`
* Work on word vectors, and other stuff 2015-01-17 08:21:17 +03:00			`int dep`
* Rename sent_start to sent_end, to reflect its new usage in the Break transition 2015-06-23 06:39:23 +03:00			`bint sent_start`
* Add l_edge and r_edge props in TokenC for tracking the parse-yield of the token 2015-04-29 20:14:20 +03:00
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00			`uint32_t l_kids`
			`uint32_t r_kids`
* Add l_edge and r_edge props in TokenC for tracking the parse-yield of the token 2015-04-29 20:14:20 +03:00			`uint32_t l_edge`
			`uint32_t r_edge`
* Move all struct definitions to structs.pxd, to avoid circular dependencies 2014-12-19 22:51:33 +03:00
* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring. 2015-03-10 20:00:23 +03:00			`int ent_iob`
			`int ent_type`