Commit Graph

10 Commits

Author SHA1 Message Date
Matthew Honnibal
5b2440a1fd Try to use real histories, not oracle 2021-01-25 18:59:52 +11:00
Matthew Honnibal
38ad6c7b6a Fix parser oracle 2021-01-25 15:26:43 +11:00
Matthew Honnibal
19747d98d1 Fix 2021-01-25 14:51:46 +11:00
Matthew Honnibal
456c881ae3 Try to fix parser training 2021-01-25 14:40:05 +11:00
Matthew Honnibal
cef93d3ae7 Handle final states in get_oracle_sequence 2021-01-25 13:28:57 +11:00
Matthew Honnibal
be155ead9b Fix set_annotations during parser update 2021-01-25 11:56:36 +11:00
Matthew Honnibal
c631c355d1 Revert "Fix set_annotations in parser.update"
This reverts commit c6df0eafd0.
2021-01-25 11:22:57 +11:00
Matthew Honnibal
c6df0eafd0 Fix set_annotations in parser.update 2021-01-25 09:50:48 +11:00
Matthew Honnibal
8656a08777
Add beam_parser and beam_ner components for v3 (#6369)
* Get basic beam tests working

* Get basic beam tests working

* Compile _beam_utils

* Remove prints

* Test beam density

* Beam parser seems to train

* Draft beam NER

* Upd beam

* Add hypothesis as dev dependency

* Implement missing is-gold-parse method

* Implement early update

* Fix state hashing

* Fix test

* Fix test

* Default to non-beam in parser constructor

* Improve oracle for beam

* Start refactoring beam

* Update test

* Refactor beam

* Update nn

* Refactor beam and weight by cost

* Update ner beam settings

* Update test

* Add __init__.pxd

* Upd test

* Fix test

* Upd test

* Fix test

* Remove ring buffer history from StateC

* WIP change arc-eager transitions

* Add state tests

* Support ternary sent start values

* Fix arc eager

* Fix NER

* Pass oracle cut size for beam

* Fix ner test

* Fix beam

* Improve StateC.clone

* Improve StateClass.borrow

* Work directly with StateC, not StateClass

* Remove print statements

* Fix state copy

* Improve state class

* Refactor parser oracles

* Fix arc eager oracle

* Fix arc eager oracle

* Use a vector to implement the stack

* Refactor state data structure

* Fix alignment of sent start

* Add get_aligned_sent_starts method

* Add test for ae oracle when bad sentence starts

* Fix sentence segment handling

* Avoid Reduce that inserts illegal sentence

* Update preset SBD test

* Fix test

* Remove prints

* Fix sent starts in Example

* Improve python API of StateClass

* Tweak comments and debug output of arc eager

* Upd test

* Fix state test

* Fix state test
2020-12-13 09:08:32 +08:00
Sofie Van Landeghem
ca491722ad
The Parser is now a Pipe (2) (#5844)
* moving syntax folder to _parser_internals

* moving nn_parser and transition_system

* move nn_parser and transition_system out of internals folder

* moving nn_parser code into transition_system file

* rename transition_system to transition_parser

* moving parser_model and _state to ml

* move _state back to internals

* The Parser now inherits from Pipe!

* small code fixes

* removing unnecessary imports

* remove link_vectors_to_models

* transition_system to internals folder

* little bit more cleanup

* newlines
2020-07-30 23:30:54 +02:00