Matthew Honnibal
|
c4a89d56bd
|
* Automatically register any entity types pre-set on the tokens, so that the NER works with user-given entity types.
|
2016-01-19 20:09:26 +01:00 |
|
Matthew Honnibal
|
f0f92793f6
|
* Add test for user NER classes in matcher blocking the NER model. Re Issue #178 and Issue #217
|
2016-01-19 19:23:16 +01:00 |
|
Matthew Honnibal
|
65c5bc4988
|
* Add add_label method, to allow users to register new entity types and dependency labels.
|
2016-01-19 19:11:02 +01:00 |
|
Matthew Honnibal
|
151aa0b0e2
|
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model
|
2016-01-19 19:09:33 +01:00 |
|
Matthew Honnibal
|
c8e0011ebc
|
* Add iterators to the NER and parser transition systems, to get the action types
|
2016-01-19 19:07:43 +01:00 |
|
Matthew Honnibal
|
515493c675
|
* Add xfail test for Issue #225: tokenization with non-whitespace delimiters
|
2016-01-19 13:20:14 +01:00 |
|
Matthew Honnibal
|
7abe653223
|
* Fix imports
|
2016-01-19 03:36:51 +01:00 |
|
Matthew Honnibal
|
590f38bdb2
|
* Add hacky solution to Issue #220. Currently specials.json only supports literal patterns, which doesn't allow us to pre-tag whitespace with the correct token, SP, as a rule. The data-driven approach should be easy but for some reason fails here. Adding a hard code in Morphology isn't a good solution, but we do want to fix the behaviour right away, and don't want to wait for an architecturally better solution.
|
2016-01-19 03:35:20 +01:00 |
|
Matthew Honnibal
|
445164d5b4
|
* Restore the LOCAL_DATA_DIR global in spacy/en/__init__.py, although this is now deprecated
|
2016-01-19 02:54:56 +01:00 |
|
Matthew Honnibal
|
04177debd0
|
* Unwind limit to sentence boundary detection that prevents it from inserting boundaries on whitespace. Replace it with a check for whitespace in StateClass.fast_forward, so that whitespace is LeftArced when it's on the stack. This should prevent the previous problem of whitespace-only sentences. Should fix Issue #184, but may cause further problems. Needs testing.
|
2016-01-19 02:54:15 +01:00 |
|
Matthew Honnibal
|
7893de3203
|
* Add test for Issue #184: Whitespace at sentence boundary causes sentence boundary error.
|
2016-01-18 23:04:38 +01:00 |
|
Matthew Honnibal
|
bba0a5e078
|
* Handle string paths in default_vocab, default_parser, default_entity in Language class
|
2016-01-18 22:37:24 +01:00 |
|
Matthew Honnibal
|
e825fd9554
|
* Make some of the website tests work without models
|
2016-01-18 18:14:44 +01:00 |
|
Matthew Honnibal
|
334c4b2b57
|
* Disprefer punctuation and spaces as heads of spans
|
2016-01-18 18:14:09 +01:00 |
|
Matthew Honnibal
|
bed36ab0ff
|
* Fix import of HEAD attribute
|
2016-01-18 17:34:43 +01:00 |
|
Matthew Honnibal
|
28c659c1fe
|
* Fix import for numpy
|
2016-01-18 17:25:04 +01:00 |
|
Matthew Honnibal
|
fc36bcf458
|
* Fix import for English
|
2016-01-18 17:14:40 +01:00 |
|
Matthew Honnibal
|
cc4c335e14
|
* Set heads for test_merge_tokens, to make the test run without models
|
2016-01-18 17:00:11 +01:00 |
|
Matthew Honnibal
|
c107da9738
|
* Bug fix to _count_words_to_root
|
2016-01-18 16:59:38 +01:00 |
|
Matthew Honnibal
|
f24833d607
|
* Fix merge for coordinations
|
2016-01-18 16:03:19 +01:00 |
|
Matthew Honnibal
|
14534958a9
|
* Fix bug in Span.root
|
2016-01-18 15:40:28 +01:00 |
|
Matthew Honnibal
|
714cbc03d5
|
* Add test for Issue #203: nested noun chunks.
|
2016-01-16 18:02:30 +01:00 |
|
Matthew Honnibal
|
4e2253170c
|
* Move test for doc.merge to tokens_api file, to avoid name conflicts which upset pytest
|
2016-01-16 18:01:36 +01:00 |
|
Matthew Honnibal
|
34a157511f
|
* Move test_merge_hang to test_tokens_api
|
2016-01-16 18:00:26 +01:00 |
|
Matthew Honnibal
|
fc8f26584a
|
* Don't consider NPs connected to parse via conj relation as noun chunks. Change motivated by the nested noun chunks identified in Issue #203, but might be problematic. Also allow root NPs to be considered noun chunks.
|
2016-01-16 17:52:40 +01:00 |
|
Matthew Honnibal
|
4a16dbfeca
|
* Add test for Issue #203: noun chunks should be flat, but sometimes are nested
|
2016-01-16 17:41:25 +01:00 |
|
Matthew Honnibal
|
995b2d18fd
|
* Route token.string via token.txt_with_ws, to deprecate token.string in future
|
2016-01-16 17:14:34 +01:00 |
|
Matthew Honnibal
|
54a98eaf19
|
* Fix typo text_wth_ws --> text_with_ws. Reroute .string attribute to text_with_ws, to deprecate .string in future
|
2016-01-16 17:13:50 +01:00 |
|
Matthew Honnibal
|
3e9961d2c4
|
* If final token is whitespace, don't mark it as owning a trailing space. Fixes Issue #154
|
2016-01-16 17:08:59 +01:00 |
|
Matthew Honnibal
|
223d2b3484
|
* Add test for Issue #154: Additional whitespace introduced when string ends with a whitespace token.
|
2016-01-16 17:08:07 +01:00 |
|
Matthew Honnibal
|
3dc398b727
|
* Fix merge conflict in requirements.txt
|
2016-01-16 16:20:49 +01:00 |
|
Matthew Honnibal
|
fc5962a77d
|
* Improve test for root token in Span
|
2016-01-16 16:19:09 +01:00 |
|
Matthew Honnibal
|
c025a0c64b
|
* Check for KeyboardInerrupt in parser.__call__
|
2016-01-16 16:18:44 +01:00 |
|
Matthew Honnibal
|
03e8a4293d
|
* Add loop guard to Token.lefts and Token.rights properties
|
2016-01-16 16:18:17 +01:00 |
|
Matthew Honnibal
|
304339985e
|
* Add a linear scan to Span.root method, to help with long sentences
|
2016-01-16 16:17:28 +01:00 |
|
Matthew Honnibal
|
65c5b03b9b
|
Merge pull request #223 from henningpeters/revise_packaging
refactored data_dir->via, add zip_safe, add spacy.load()
|
2016-01-17 02:12:48 +11:00 |
|
Matthew Honnibal
|
ca0a603fde
|
* Fix pin of Sputnik
|
2016-01-16 16:04:41 +01:00 |
|
Matthew Honnibal
|
aa0dd79f52
|
* Delete test_token_references, which checked a flakey strategy for preventing orphan tokens from a while ago. Now orphan tokens simply hold a reference to Pool, preventing the memory from being freed underneath them. This means that we don't need to run this slow test.
|
2016-01-16 16:03:35 +01:00 |
|
Matthew Honnibal
|
bd3efdbe22
|
* Require recent sputnik
|
2016-01-16 15:55:42 +01:00 |
|
Matthew Honnibal
|
8cbcc3a799
|
* Fix calculation of root token in Span. Now take root to be word with shortest tree path. Avoids parse trees ending up in inconsistent state, as had occurred in Issue #214.
|
2016-01-16 15:38:50 +01:00 |
|
Matthew Honnibal
|
c1039fa4b4
|
* Add test for Issue #214. Resolved in change to Span.root
|
2016-01-16 15:37:47 +01:00 |
|
Henning Peters
|
41ea14a56f
|
fix pickling
|
2016-01-16 13:23:11 +01:00 |
|
Henning Peters
|
5551052840
|
fix py2/3 issue
|
2016-01-16 12:44:53 +01:00 |
|
Henning Peters
|
235f094534
|
untangle data_path/via
|
2016-01-16 12:23:45 +01:00 |
|
Matthew Honnibal
|
42a9f29b40
|
* Add loop guard in Span.root, to raise errors if there is a cycle in the dependency parse, instead of entering an infinite loop. Re Issue #214
|
2016-01-16 11:53:37 +01:00 |
|
Henning Peters
|
6d1a3af343
|
cleanup unused
|
2016-01-16 10:05:04 +01:00 |
|
Henning Peters
|
846fa49b2a
|
distinct load() and from_package() methods
|
2016-01-16 10:00:57 +01:00 |
|
Henning Peters
|
634ea57876
|
adapt travis/appveyor to latest sputnik
|
2016-01-16 09:56:12 +01:00 |
|
Henning Peters
|
211913d689
|
add about.py, adapt setup.py
|
2016-01-15 18:57:01 +01:00 |
|
Henning Peters
|
f8a8f97d25
|
cleanup
|
2016-01-15 18:13:37 +01:00 |
|