Daniël de Kok 28299644fc Speed up the StateC::L feature function (#10019) ... * Speed up the StateC::L feature function This function gets the n-th most-recent left-arc with a particular head. Before this change, StateC::L would construct a vector of all left-arcs with the given head and then pick the n-th most recent from that vector. Since the number of left-arcs strongly correlates with the doc length and the feature is constructed for every transition, this can make transition-parsing quadratic. With this change StateC::L: - Searches left-arcs backwards. - Stops early when the n-th matching transition is found. - Does not construct a vector (reducing memory pressure). This change doesn't avoid the linear search when the transition that is queried does not occur in the left-arcs. Regardless, performance is improved quite a bit with very long docs: Before: N Time 400 3.3 800 5.4 1600 11.6 3200 30.7 After: N Time 400 3.2 800 5.0 1600 9.5 3200 23.2 We can probably do better with more tailored data structures, but I first wanted to make a low-impact PR. Found while investigating #9858. * StateC::L: simplify loop		2022-01-13 09:03:55 +01:00
..
cli	Check for assets with size of 0 bytes (#10026)	2022-01-12 10:34:23 +01:00
displacy	Displacy serve entity linking support without manual=True support. (#9748)	2021-11-29 17:13:26 +01:00
lang	Format (#9630)	2021-11-05 09:56:26 +01:00
matcher	Entity ruler remove pattern (#9685)	2021-12-06 15:32:49 +01:00
ml	MultiHashEmbed vector docs correction (#9918)	2021-12-27 11:18:08 +01:00
pipeline	Speed up the StateC::L feature function (#10019)	2022-01-13 09:03:55 +01:00
tests	Entity ruler remove pattern (#9685)	2021-12-06 15:32:49 +01:00
tokens	Added sents property to Span for Spans spanning over several sentences (#9699)	2021-12-06 09:58:01 +01:00
training	Exclude strings from v3.2+ source vector checks (#9697)	2021-11-19 08:51:19 +01:00
__init__.pxd	* Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags.	2014-10-24 02:23:42 +11:00
__init__.py	Tidy up and auto-format	2021-07-18 15:44:56 +10:00
__main__.py	Tidy up	2020-06-22 00:45:40 +02:00
about.py	Set version to v3.2.1 (#9823)	2021-12-07 10:51:45 +01:00
attrs.pxd	Merge branch 'develop' into master-tmp	2020-05-21 18:39:06 +02:00
attrs.pyx	Update Cython string types (#9143)	2021-09-13 17:02:17 +02:00
compat.py	Custom component types in spacy.ty (#9469)	2021-10-21 15:31:06 +02:00
default_config_pretraining.cfg	Add new parameter for saving every n epoch in pretraining (#8912)	2021-08-12 11:14:48 +02:00
default_config.cfg	Add a few docs to the default_config.cfg (#9981)	2022-01-05 09:16:40 +01:00
errors.py	Fix references to config file in the docs & UX (#9961)	2022-01-04 14:31:26 +01:00
glossary.py	Add glossary entry for _SP (#8983)	2021-08-20 12:04:02 +02:00
kb.pxd	Replace cpdef variables with cdef (#7834)	2021-04-26 16:54:02 +02:00
kb.pyx	Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master-v3.2-1	2021-10-26 11:53:50 +02:00
language.py	Use Language.pipe in evaluate (#9800)	2021-12-06 20:39:15 +01:00
lexeme.pxd	Fix Lexeme.from_ptr	2020-08-10 16:43:37 +02:00
lexeme.pyi	fix type of lexeme.rank (#9979)	2022-01-04 13:15:25 +01:00
lexeme.pyx	Update Cython string types (#9143)	2021-09-13 17:02:17 +02:00
lookups.py	🏷 Add Mypy check to CI and ignore all existing Mypy errors (#9167)	2021-10-14 15:21:40 +02:00
morphology.pxd	Clean up Morphology imports and definitions (#7441)	2021-04-26 16:54:23 +02:00
morphology.pyx	Clean up Morphology imports and definitions (#7441)	2021-04-26 16:54:23 +02:00
parts_of_speech.pxd	Add support for Universal Dependencies v2.0	2017-03-03 13:17:34 +01:00
parts_of_speech.pyx	Drop Python 2.7 and 3.5 (#4828)	2019-12-22 01:53:56 +01:00
pipe_analysis.py	🏷 Add Mypy check to CI and ignore all existing Mypy errors (#9167)	2021-10-14 15:21:40 +02:00
py.typed	Add py.typed	2021-03-16 09:48:31 +01:00
schemas.py	Allow Matcher to match on ENT_ID and ENT_KB_ID (#9688)	2021-11-24 10:37:10 +01:00
scorer.py	Allow Scorer.score_spans to handle pred docs with missing annotation (#9701)	2021-11-23 15:17:19 +01:00
strings.pxd	Update Cython string types (#9143)	2021-09-13 17:02:17 +02:00
strings.pyi	🏷 Add Mypy check to CI and ignore all existing Mypy errors (#9167)	2021-10-14 15:21:40 +02:00
strings.pyx	Update Cython string types (#9143)	2021-09-13 17:02:17 +02:00
structs.pxd	Add SpanGroup and Graph container types to represent arbitrary annotations (#6696)	2021-01-14 17:30:41 +11:00
symbols.pxd	introduce token.has_head and refer to MISSING_DEP_ (WIP)	2021-01-12 17:17:06 +01:00
symbols.pyx	introduce token.has_head and refer to MISSING_DEP_ (WIP)	2021-01-12 17:17:06 +01:00
tokenizer.pxd	Remove two attributes marked for removal in 3.1 (#9150)	2021-09-15 23:07:21 +02:00
tokenizer.pyx	Update Tokenizer documentation to reflect token_match and url_match signatures (#9859)	2021-12-15 09:34:33 +01:00
ty.py	Custom component types in spacy.ty (#9469)	2021-10-21 15:31:06 +02:00
typedefs.pxd	Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master	2020-11-25 11:49:34 +01:00
typedefs.pyx	Tidy up rest	2017-10-27 21:07:59 +02:00
util.py	Fix references to config file in the docs & UX (#9961)	2022-01-04 14:31:26 +01:00
vectors.pyx	Make floret murmurhash endian-neutral (#9735)	2021-12-20 17:11:31 +01:00
vocab.pxd	Add support for floret vectors (#8909)	2021-10-27 14:08:31 +02:00
vocab.pyi	Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master-v3.2-1	2021-10-26 11:53:50 +02:00
vocab.pyx	Add support for floret vectors (#8909)	2021-10-27 14:08:31 +02:00