Commit Graph

1793 Commits

Author SHA1 Message Date
Matthew Honnibal
b643cb3d5c * Allow training documents to be filtered in gold.pyx 2015-06-12 02:42:08 +02:00
Matthew Honnibal
15e177d7a1 * Fixes to unshift/fast-forward strategy. Getting 91.55 greedy on NW dev, gold preproc 2015-06-12 01:50:23 +02:00
Matthew Honnibal
afd77a529b * Prepare for break transition, with fast-forwarding. 86.5 on 1k nw gold preproc 2015-06-10 14:08:30 +02:00
Matthew Honnibal
495f528709 * Add support for sentence breaks in stateclass 2015-06-10 12:34:28 +02:00
Matthew Honnibal
b7b18c279d * Fix Reduce oracle. Getting 86.35 2015-06-10 11:33:39 +02:00
Matthew Honnibal
bb09b5d91a * Fix shifted bit vector in stateclass --- should reflect whether the word has been *unshifted*. 2015-06-10 11:33:09 +02:00
Matthew Honnibal
aa9625f688 * Do non-monotonic Unshift. Every word can be shifted at most 1 time. When the Reduce move is used, if S0 has no head, we put the word back on the buffer. Gets 86.4 on nw 1k with gold pre-proc. Break transition not yet implemented for this. 2015-06-10 10:15:56 +02:00
Matthew Honnibal
7bf6b7de3e * Add unshift action to StateClass, and track which moves have been shifted 2015-06-10 10:13:03 +02:00
Matthew Honnibal
f7c8069e65 * Fix bug in distance feature 2015-06-10 10:12:17 +02:00
Matthew Honnibal
abd07c067a * Inline B and S methods on stateclass 2015-06-10 07:22:33 +02:00
Matthew Honnibal
e2f9a80713 * Remove old _state imports 2015-06-10 07:09:17 +02:00
Matthew Honnibal
e9aaecc619 * Remove from_struct method from StateClass 2015-06-10 06:58:27 +02:00
Matthew Honnibal
18cc326dc0 * Bug fixes to ner.pyx 2015-06-10 06:57:41 +02:00
Matthew Honnibal
90a3add8d7 * Require thinc 2.0 2015-06-10 06:57:13 +02:00
Matthew Honnibal
e5570c9700 * Set nogil for oracle functions 2015-06-10 06:56:56 +02:00
Matthew Honnibal
4575e7a60f * Fix beam search with new StateClass 2015-06-10 06:33:39 +02:00
Matthew Honnibal
d70304b7dd * Require newer thinc 2015-06-10 04:20:42 +02:00
Matthew Honnibal
04b1cd9b8c * Greedy parsing working with new StateClass. Beam parsing broken 2015-06-10 04:20:23 +02:00
Matthew Honnibal
6a94b64eca * Remove State* from parser.pyx entirely, switching over to StateClass. Beam parsing still untested. 2015-06-10 02:03:38 +02:00
Matthew Honnibal
f14a1526aa * Remove version of fill_context that takes State* 2015-06-10 01:39:07 +02:00
Matthew Honnibal
d68c686ec1 * Move StateClass into interface of transition functions 2015-06-10 01:35:28 +02:00
Matthew Honnibal
4b98b3e9c8 * Cost functions now take StateClass argument, instead of State*. 2015-06-10 00:40:43 +02:00
Matthew Honnibal
e0cf61f591 * Move StateClass into the interface for is_valid 2015-06-09 23:23:28 +02:00
Matthew Honnibal
09617a4638 * Whitespace 2015-06-09 21:20:33 +02:00
Matthew Honnibal
0895d454fb * Prepare to switch to using state class, instead of state struct 2015-06-09 21:20:14 +02:00
Matthew Honnibal
2b9629ed62 * Begin adding stateclass to ArcEager 2015-06-09 01:41:09 +02:00
Matthew Honnibal
ba10fd8af5 * Add StateClass, to replace/refactor the mess in _state 2015-06-09 01:39:54 +02:00
Matthew Honnibal
bd4f5f89cb * Add note about failed tokenization 2015-06-08 16:17:07 +02:00
Matthew Honnibal
c7e3dfc1dc * Don't automatically push words when stack is empty, as it messes up beam parsing. Add hash method to beam state. 2015-06-08 14:49:04 +02:00
Matthew Honnibal
d51a86478e * Upd contact information on license page 2015-06-08 02:20:31 +02:00
Matthew Honnibal
be9ccdac6d * Upd docs 2015-06-08 02:17:52 +02:00
Matthew Honnibal
e46cef634f * Update docs 2015-06-08 02:01:44 +02:00
Matthew Honnibal
2aadb687c3 * Note new release in docs 2015-06-08 01:47:06 +02:00
Matthew Honnibal
d318cf1497 * Have travis use pip again... 2015-06-08 01:27:08 +02:00
Matthew Honnibal
7cd0697e64 * Avoid downloading data in travis.yml --- just test the non-parser, non-vectors modules. 2015-06-08 00:57:19 +02:00
Matthew Honnibal
00a0dfcb59 * Avoid shipping the spacy.munge package 2015-06-08 00:54:13 +02:00
Matthew Honnibal
7d265a9c62 * Revert to wget in spacy.en.download 2015-06-08 00:48:56 +02:00
Matthew Honnibal
a8fc5f1285 * Fix munge/read_ner 2015-06-08 00:35:04 +02:00
Matthew Honnibal
1515862861 * Fix download.py 2015-06-08 00:08:05 +02:00
Matthew Honnibal
7e9e8f654a * Use urllib in spacy.en.download 2015-06-07 23:51:38 +02:00
Matthew Honnibal
514d6b8e22 * Upd travis.yml 2015-06-07 23:26:41 +02:00
Matthew Honnibal
1d26f77412 * Upd travis.yml 2015-06-07 23:19:42 +02:00
Matthew Honnibal
dcdf566ce3 * Fix fab test 2015-06-07 22:59:05 +02:00
Matthew Honnibal
68be03d66b * Fiddle with travis.yml 2015-06-07 22:57:48 +02:00
Matthew Honnibal
22f1ad012e * Add spacy.munge to list of packages 2015-06-07 22:28:13 +02:00
Matthew Honnibal
ce8e524825 * Fix requirements in setup.py 2015-06-07 22:24:21 +02:00
Matthew Honnibal
7195c07897 * Add explicit tokenizer test 2015-06-07 21:29:17 +02:00
Matthew Honnibal
957e6eaa8a * Fixes to prag_sbd tests 2015-06-07 21:19:17 +02:00
Matthew Honnibal
7a9e9ab9b2 * Update prag_sbd challenge set 2015-06-07 21:13:55 +02:00
Matthew Honnibal
993128032f * Fiddle with travis.yml 2015-06-07 20:57:18 +02:00