spaCy/spacy/syntax/transition_system.pxd

from cymem.cymem cimport Pool
from thinc.typedefs cimport weight_t

from ..structs cimport TokenC
from ..gold cimport GoldParse
from ..gold cimport GoldParseC
from ..strings cimport StringStore

from .stateclass cimport StateClass
from ._state cimport StateC


cdef struct Transition:
    int clas
    int move
    int label

    weight_t score

    bint (*is_valid)(const StateC* state, int label) nogil
    weight_t (*get_cost)(StateClass state, const GoldParseC* gold, int label) nogil
    int (*do)(StateC* state, int label) nogil


ctypedef weight_t (*get_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil
ctypedef weight_t (*move_cost_func_t)(StateClass state, const GoldParseC* gold) nogil
ctypedef weight_t (*label_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil

ctypedef int (*do_func_t)(StateC* state, int label) nogil

ctypedef void* (*init_state_t)(Pool mem, int length, void* tokens) except NULL

cdef class TransitionSystem:
    cdef Pool mem
    cdef StringStore strings
    cdef Transition* c
    cdef readonly int n_moves
    cdef int _size
    cdef public int root_label
    cdef public freqs
    cdef init_state_t init_beam_state

    cdef int initialize_state(self, StateC* state) nogil
    cdef int finalize_state(self, StateC* state) nogil

    cdef int preprocess_gold(self, GoldParse gold) except -1

    cdef Transition lookup_transition(self, object name) except *

    cdef Transition init_transition(self, int clas, int move, int label) except *

    cdef int set_valid(self, int* output, const StateC* st) nogil

    cdef int set_costs(self, int* is_valid, weight_t* costs,
                       StateClass state, GoldParse gold) except -1
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00			`from cymem.cymem cimport Pool`
			`from thinc.typedefs cimport weight_t`

			`from ..structs cimport TokenC`
* Move spacy.syntax.conll to spacy.gold 2015-05-24 22:35:02 +03:00			`from ..gold cimport GoldParse`
* Have oracle functions take a struct instead of a Python object 2015-06-02 21:01:06 +03:00			`from ..gold cimport GoldParseC`
* Use StringStore to encode label names, instead of label_ids 2015-03-14 18:06:35 +03:00			`from ..strings cimport StringStore`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00
* Move StateClass into the interface for is_valid 2015-06-10 00:23:28 +03:00			`from .stateclass cimport StateClass`
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 04:58:14 +03:00			`from ._state cimport StateC`
* Move StateClass into the interface for is_valid 2015-06-10 00:23:28 +03:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00
			`cdef struct Transition:`
			`int clas`
			`int move`
			`int label`

			`weight_t score`

* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 04:58:14 +03:00			`bint (is_valid)(const StateC state, int label) nogil`
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser 2016-01-30 16:31:12 +03:00			`weight_t (get_cost)(StateClass state, const GoldParseC gold, int label) nogil`
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 04:58:14 +03:00			`int (do)(StateC state, int label) nogil`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00

* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser 2016-01-30 16:31:12 +03:00			`ctypedef weight_t (get_cost_func_t)(StateClass state, const GoldParseC gold, int label) nogil`
			`ctypedef weight_t (move_cost_func_t)(StateClass state, const GoldParseC gold) nogil`
			`ctypedef weight_t (label_cost_func_t)(StateClass state, const GoldParseC gold, int label) nogil`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 04:58:14 +03:00			`ctypedef int (do_func_t)(StateC state, int label) nogil`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00
Allow beam parsing for NER 2017-03-11 20:12:01 +03:00			`ctypedef void* (init_state_t)(Pool mem, int length, void tokens) except NULL`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00
			`cdef class TransitionSystem:`
			`cdef Pool mem`
* Use StringStore to encode label names, instead of label_ids 2015-03-14 18:06:35 +03:00			`cdef StringStore strings`
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model 2016-01-19 21:09:33 +03:00			`cdef Transition* c`
* Tmp commit 2015-02-23 22:04:53 +03:00			`cdef readonly int n_moves`
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model 2016-01-19 21:09:33 +03:00			`cdef int _size`
* Remove gil from parser.call 2015-07-15 00:47:03 +03:00			`cdef public int root_label`
* Serialization round trip now working with decent API, but with rough spots in the organisation and requiring vocabulary to be fixed ahead of time. 2015-07-19 16:18:17 +03:00			`cdef public freqs`
Allow beam parsing for NER 2017-03-11 20:12:01 +03:00			`cdef init_state_t init_beam_state`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00
* Add a parse_batch method to Parser, that releases the GIL around a batch of documents. 2016-02-01 10:34:55 +03:00			`cdef int initialize_state(self, StateC* state) nogil`
			`cdef int finalize_state(self, StateC* state) nogil`
* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring. 2015-03-10 20:00:23 +03:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc. 2015-03-09 14:06:01 +03:00			`cdef int preprocess_gold(self, GoldParse gold) except -1`
Remove trailing whitespace 2015-04-19 11:31:31 +03:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc. 2015-03-09 14:06:01 +03:00			`cdef Transition lookup_transition(self, object name) except *`
Remove trailing whitespace 2015-04-19 11:31:31 +03:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 18:38:18 +03:00			`cdef Transition init_transition(self, int clas, int move, int label) except *`

* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 05:00:15 +03:00			`cdef int set_valid(self, int* output, const StateC* st) nogil`
* Whitespace 2015-08-09 00:35:59 +03:00
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser 2016-01-30 16:31:12 +03:00			`cdef int set_costs(self, int* is_valid, weight_t* costs,`
* Rejig parser interface to use new thinc.api.Example class, in prep of theano model. Comment out beam search 2015-06-26 07:25:36 +03:00			`StateClass state, GoldParse gold) except -1`