explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-11-11 12:18:04 +03:00
Code Issues Packages Projects Releases Wiki Activity
e619aba8df
spaCy/spacy/syntax/transition_system.pxd

54 lines
1.6 KiB
Cython
Raw Normal View History

* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
from cymem.cymem cimport Pool
from thinc.typedefs cimport weight_t
from ..structs cimport TokenC
* Move spacy.syntax.conll to spacy.gold
2015-05-24 22:35:02 +03:00
from ..gold cimport GoldParse
* Have oracle functions take a struct instead of a Python object
2015-06-02 21:01:06 +03:00
from ..gold cimport GoldParseC
* Use StringStore to encode label names, instead of label_ids
2015-03-14 18:06:35 +03:00
from ..strings cimport StringStore
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
* Move StateClass into the interface for is_valid
2015-06-10 00:23:28 +03:00
from .stateclass cimport StateClass
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 04:58:14 +03:00
from ._state cimport StateC
* Move StateClass into the interface for is_valid
2015-06-10 00:23:28 +03:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
cdef struct Transition:
int clas
int move
int label
weight_t score
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 04:58:14 +03:00
bint (*is_valid)(const StateC* state, int label) nogil
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser
2016-01-30 16:31:12 +03:00
weight_t (*get_cost)(StateClass state, const GoldParseC* gold, int label) nogil
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 04:58:14 +03:00
int (*do)(StateC* state, int label) nogil
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser
2016-01-30 16:31:12 +03:00
ctypedef weight_t (*get_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil
ctypedef weight_t (*move_cost_func_t)(StateClass state, const GoldParseC* gold) nogil
ctypedef weight_t (*label_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 04:58:14 +03:00
ctypedef int (*do_func_t)(StateC* state, int label) nogil
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
cdef class TransitionSystem:
cdef Pool mem
* Use StringStore to encode label names, instead of label_ids
2015-03-14 18:06:35 +03:00
cdef StringStore strings
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model
2016-01-19 21:09:33 +03:00
cdef Transition* c
* Tmp commit
2015-02-23 22:04:53 +03:00
cdef readonly int n_moves
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model
2016-01-19 21:09:33 +03:00
cdef int _size
* Remove gil from parser.call
2015-07-15 00:47:03 +03:00
cdef public int root_label
* Serialization round trip now working with decent API, but with rough spots in the organisation and requiring vocabulary to be fixed ahead of time.
2015-07-19 16:18:17 +03:00
cdef public freqs
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
* Add a parse_batch method to Parser, that releases the GIL around a batch of documents.
2016-02-01 10:34:55 +03:00
cdef int initialize_state(self, StateC* state) nogil
cdef int finalize_state(self, StateC* state) nogil
* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring.
2015-03-10 20:00:23 +03:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc.
2015-03-09 14:06:01 +03:00
cdef int preprocess_gold(self, GoldParse gold) except -1
Remove trailing whitespace
2015-04-19 11:31:31 +03:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc.
2015-03-09 14:06:01 +03:00
cdef Transition lookup_transition(self, object name) except *
Remove trailing whitespace
2015-04-19 11:31:31 +03:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 18:38:18 +03:00
cdef Transition init_transition(self, int clas, int move, int label) except *
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 05:00:15 +03:00
cdef int set_valid(self, int* output, const StateC* st) nogil
* Whitespace
2015-08-09 00:35:59 +03:00
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser
2016-01-30 16:31:12 +03:00
cdef int set_costs(self, int* is_valid, weight_t* costs,
* Rejig parser interface to use new thinc.api.Example class, in prep of theano model. Comment out beam search
2015-06-26 07:25:36 +03:00
StateClass state, GoldParse gold) except -1
Reference in New Issue Copy Permalink