177 Commits

Author	SHA1	Message	Date
Matthew Honnibal	75289b4761	* Don't refuse to parse single token sentences, incase some transition system needs them, e.g. single word entity. Instead fix error in _init_state.	2015-06-13 22:55:55 +02:00
Matthew Honnibal	15e177d7a1	* Fixes to unshift/fast-forward strategy. Getting 91.55 greedy on NW dev, gold preproc	2015-06-12 01:50:23 +02:00
Matthew Honnibal	afd77a529b	* Prepare for break transition, with fast-forwarding. 86.5 on 1k nw gold preproc	2015-06-10 14:08:30 +02:00
Matthew Honnibal	495f528709	* Add support for sentence breaks in stateclass	2015-06-10 12:34:28 +02:00
Matthew Honnibal	b7b18c279d	* Fix Reduce oracle. Getting 86.35	2015-06-10 11:33:39 +02:00
Matthew Honnibal	bb09b5d91a	* Fix shifted bit vector in stateclass --- should reflect whether the word has been *unshifted*.	2015-06-10 11:33:09 +02:00
Matthew Honnibal	aa9625f688	* Do non-monotonic Unshift. Every word can be shifted at most 1 time. When the Reduce move is used, if S0 has no head, we put the word back on the buffer. Gets 86.4 on nw 1k with gold pre-proc. Break transition not yet implemented for this.	2015-06-10 10:15:56 +02:00
Matthew Honnibal	7bf6b7de3e	* Add unshift action to StateClass, and track which moves have been shifted	2015-06-10 10:13:03 +02:00
Matthew Honnibal	f7c8069e65	* Fix bug in distance feature	2015-06-10 10:12:17 +02:00
Matthew Honnibal	abd07c067a	* Inline B and S methods on stateclass	2015-06-10 07:22:33 +02:00
Matthew Honnibal	e2f9a80713	* Remove old _state imports	2015-06-10 07:09:17 +02:00
Matthew Honnibal	e9aaecc619	* Remove from_struct method from StateClass	2015-06-10 06:58:27 +02:00
Matthew Honnibal	18cc326dc0	* Bug fixes to ner.pyx	2015-06-10 06:57:41 +02:00
Matthew Honnibal	e5570c9700	* Set nogil for oracle functions	2015-06-10 06:56:56 +02:00
Matthew Honnibal	4575e7a60f	* Fix beam search with new StateClass	2015-06-10 06:33:39 +02:00
Matthew Honnibal	04b1cd9b8c	* Greedy parsing working with new StateClass. Beam parsing broken	2015-06-10 04:20:23 +02:00
Matthew Honnibal	6a94b64eca	* Remove State* from parser.pyx entirely, switching over to StateClass. Beam parsing still untested.	2015-06-10 02:03:38 +02:00
Matthew Honnibal	f14a1526aa	* Remove version of fill_context that takes State*	2015-06-10 01:39:07 +02:00
Matthew Honnibal	d68c686ec1	* Move StateClass into interface of transition functions	2015-06-10 01:35:28 +02:00
Matthew Honnibal	4b98b3e9c8	* Cost functions now take StateClass argument, instead of State*.	2015-06-10 00:40:43 +02:00
Matthew Honnibal	e0cf61f591	* Move StateClass into the interface for is_valid	2015-06-09 23:23:28 +02:00
Matthew Honnibal	0895d454fb	* Prepare to switch to using state class, instead of state struct	2015-06-09 21:20:14 +02:00
Matthew Honnibal	2b9629ed62	* Begin adding stateclass to ArcEager	2015-06-09 01:41:09 +02:00
Matthew Honnibal	ba10fd8af5	* Add StateClass, to replace/refactor the mess in _state	2015-06-09 01:39:54 +02:00
Matthew Honnibal	c7e3dfc1dc	* Don't automatically push words when stack is empty, as it messes up beam parsing. Add hash method to beam state.	2015-06-08 14:49:04 +02:00
Matthew Honnibal	6e2564239d	* Bug fixes to beam parser. Search still broken on non-gold sentences	2015-06-07 19:12:59 +02:00
Matthew Honnibal	731e5f1e46	* Add get() function in spacy/syntax/Config	2015-06-07 19:09:15 +02:00
Matthew Honnibal	8f142c1838	* Refactor transition system oracles, to split out move and label cost. Preparing to add Unshift move. Will exclude non-monotonic.	2015-06-07 03:21:29 +02:00
Matthew Honnibal	1fee7ade61	* Tweak to ner	2015-06-05 23:48:43 +02:00
Matthew Honnibal	33e70b167f	* Remove dead code from ner.pyx	2015-06-05 17:12:47 +02:00
Matthew Honnibal	88ac5c6e98	* Send beam_width < 0 to greedy parser	2015-06-05 17:12:06 +02:00
Matthew Honnibal	0114e7600d	* Fix NER oracle	2015-06-05 17:11:26 +02:00
Matthew Honnibal	6bf35cecc3	* Refactor transition system to use classes with staticmethods.	2015-06-05 02:27:17 +02:00
Matthew Honnibal	36a34d544b	* Refactoring arc_eager, grouping oracle functions into transitions	2015-06-04 22:43:03 +02:00
Matthew Honnibal	4433396005	* Impove efficiency of dynamic oracle, making beam training faster	2015-06-04 21:15:14 +02:00
Matthew Honnibal	079dad28a7	* Update for faster beam training	2015-06-04 19:32:32 +02:00
Matthew Honnibal	a2627b6102	* Fix bug in refactored init_transition	2015-06-03 06:01:26 +02:00
Matthew Honnibal	dd0867645d	* Remove stray const from State header	2015-06-03 00:10:04 +02:00
Matthew Honnibal	6c47b10a6e	* Make optimization to children_in_buffer: stop searching when we would cross a bracket.	2015-06-02 21:05:24 +02:00
Matthew Honnibal	a513ec500f	* Have oracle functions take a struct instead of a Python object	2015-06-02 20:01:06 +02:00
Matthew Honnibal	d1b55310a1	* Refactor _advance_beam function	2015-06-02 18:38:41 +02:00
Matthew Honnibal	0786d9b3c7	* Refactor TransitionSystem, adding set_valid method	2015-06-02 18:38:07 +02:00
Matthew Honnibal	a3964957f6	* Add profiling for _state.pyx	2015-06-02 18:36:27 +02:00
Matthew Honnibal	e822df0867	* Fix bugs in new greedy/beam parser	2015-06-02 02:01:33 +02:00
Matthew Honnibal	66dfa95847	* Revise greedy_parse/beam_parse ownership goof	2015-06-02 01:34:19 +02:00
Matthew Honnibal	75658b2ed3	* Remove use of new beam.loss property, to maintain compatibility with older versions of thinc for now.	2015-06-02 00:57:09 +02:00
Matthew Honnibal	7c29362d60	* Rename parser class in parser.pxd, now that beam parsing is supported	2015-06-02 00:53:49 +02:00
Matthew Honnibal	58d5ac0944	* Add beam search capabilities to Parser. Rename GreedyParser to Parser.	2015-06-02 00:28:02 +02:00
Matthew Honnibal	e09a08bd00	* Add copy_state function	2015-06-01 23:06:30 +02:00
Matthew Honnibal	c7876aa8b6	* Add get_valid method	2015-06-01 23:06:00 +02:00