Ines Montani
|
342cb41782
|
Add apply_transition_sequence util function to utils
|
2017-01-11 21:30:14 +01:00 |
|
Ines Montani
|
09807addff
|
Add en_parser fixture
|
2017-01-11 21:29:59 +01:00 |
|
Ines Montani
|
55d151aa61
|
Modernise Doc parse tree navigation tests and don't depend on models
|
2017-01-11 21:14:15 +01:00 |
|
Ines Montani
|
7262421bb2
|
Use consistent test names
|
2017-01-11 19:00:52 +01:00 |
|
Ines Montani
|
33800c9367
|
Rename "tokens" tests to "doc"
|
2017-01-11 18:59:01 +01:00 |
|
Ines Montani
|
3a9c6a9563
|
Remove old unused files
|
2017-01-11 18:58:38 +01:00 |
|
Ines Montani
|
8e962de39f
|
Remove old word vector tests
|
2017-01-11 18:55:08 +01:00 |
|
Ines Montani
|
e027936920
|
Modernise Doc noun chunks tests
|
2017-01-11 18:54:56 +01:00 |
|
Ines Montani
|
439f396acd
|
Modernise Doc array tests and don't depend on models
|
2017-01-11 18:54:46 +01:00 |
|
Ines Montani
|
05447be884
|
Modernise test for adding entities
|
2017-01-11 18:54:24 +01:00 |
|
Ines Montani
|
6e883f4c00
|
Modernise Doc API tests and don't depend on models
|
2017-01-11 18:05:36 +01:00 |
|
Ines Montani
|
8bf3bb5c44
|
Make words optional for get_doc
|
2017-01-11 18:05:10 +01:00 |
|
Ines Montani
|
928db7e419
|
Fix StringIO import for Python 3
|
2017-01-11 14:07:48 +01:00 |
|
Ines Montani
|
69998f216b
|
Rename test_tokens_api.py to test_doc_api.py
|
2017-01-11 13:58:56 +01:00 |
|
Ines Montani
|
d94dea1b18
|
Merge token tests into token API tests
|
2017-01-11 13:57:02 +01:00 |
|
Ines Montani
|
eb23424ab0
|
Modernise token API tests and don't depend on loading models
|
2017-01-11 13:56:54 +01:00 |
|
Ines Montani
|
c682b8ca90
|
Merge conftests into one cohesive file
|
2017-01-11 13:56:32 +01:00 |
|
Ines Montani
|
909f24d7df
|
Add test utils and get_doc helper function
Create Doc object from given vocab, words and annotations to allow
tests not to depend on loading the models.
|
2017-01-11 13:55:33 +01:00 |
|
Matthew Honnibal
|
e12c90e03f
|
Merge branch 'master' of ssh://github.com/explosion/spaCy
|
2017-01-11 13:03:51 +01:00 |
|
Matthew Honnibal
|
12cd27b821
|
Amend 8ae8b443f: Handle comparison with None tokens.
|
2017-01-11 13:03:32 +01:00 |
|
Daniel Hershcovich
|
8e603cc917
|
Avoid "True if ... else False"
|
2017-01-11 11:18:22 +02:00 |
|
Matthew Honnibal
|
44e2b0100d
|
Support TAG attribute in doc.from_array
|
2017-01-10 22:47:07 +01:00 |
|
Ines Montani
|
3e6e1f0251
|
Tidy up regression tests
|
2017-01-10 19:24:10 +01:00 |
|
Ines Montani
|
869963c3c4
|
Mark extensive prefix/suffix tests as slow
|
2017-01-10 15:57:35 +01:00 |
|
Ines Montani
|
487e020ebe
|
Add simple test for surrounding brackets
|
2017-01-10 15:57:26 +01:00 |
|
Ines Montani
|
0ba5cf51d2
|
Assert length first
|
2017-01-10 15:57:00 +01:00 |
|
Ines Montani
|
2185d31907
|
Adjust names and formatting
|
2017-01-10 15:56:35 +01:00 |
|
Ines Montani
|
e10d4ca964
|
Remove semi-redundant URLs and punctuation for faster testing
|
2017-01-10 15:54:25 +01:00 |
|
Ines Montani
|
3a3cb2c90c
|
Add unicode declaration
|
2017-01-10 15:53:15 +01:00 |
|
Matthew Honnibal
|
0f9b8a00a5
|
Unbreak data download
|
2017-01-09 23:40:26 +01:00 |
|
Matthew Honnibal
|
8ae8b443f1
|
Add richcmp method to Token. Closes #631
|
2017-01-09 19:30:31 +01:00 |
|
Matthew Honnibal
|
64f747cb65
|
Token comparison test
|
2017-01-09 19:12:00 +01:00 |
|
Matthew Honnibal
|
18c3c2d05c
|
Add tests for token comparison, re Issue #631
|
2017-01-09 19:09:59 +01:00 |
|
Matthew Honnibal
|
97a1286129
|
Revert changes to tagger and parser for thinc 6
|
2017-01-09 10:08:34 -06:00 |
|
Matthew Honnibal
|
95a52005df
|
Revert "Fix Issue #683: Add 'SP' to tag_map, if it's not there already, within the Morphology class."
This reverts commit 40e71586d6.
|
2017-01-09 09:55:55 -06:00 |
|
Ines Montani
|
363f09e68c
|
Merge pull request #726 from magnusburton/master
Added Swedish abbreviations as token exceptions
|
2017-01-09 14:58:15 +01:00 |
|
Matthew Honnibal
|
42cd598f57
|
Use correct fixtures in URL tokenizer
|
2017-01-09 14:10:40 +01:00 |
|
Matthew Honnibal
|
d9a77ddf14
|
Return None for data path if it doesn't exist
|
2017-01-09 14:10:05 +01:00 |
|
Matthew Honnibal
|
e4862d1dab
|
Merge branch 'develop'
|
2017-01-09 13:36:01 +01:00 |
|
Ines Montani
|
aa876884f0
|
Revert "Revert "Merge remote-tracking branch 'origin/master'""
This reverts commit fb9d3bb022.
|
2017-01-09 13:28:13 +01:00 |
|
Ines Montani
|
d5c72c40eb
|
Remove old tests for old website example code
|
2017-01-08 22:28:53 +01:00 |
|
Ines Montani
|
eef94e3ee2
|
Split off period after two or more uppercase letters (fixes #483)
|
2017-01-08 22:28:25 +01:00 |
|
Ines Montani
|
a89a6000e5
|
Remove unused import
|
2017-01-08 22:17:37 +01:00 |
|
Ines Montani
|
5d28664fc5
|
Don't test Hungarian for numbers and hyphens for now
Reinvestigate behaviour of case affixes given reorganised tokenizer
patterns.
|
2017-01-08 20:45:40 +01:00 |
|
Ines Montani
|
53362b6b93
|
Reorganise Hungarian prefixes/suffixes/infixes
Use global prefixes and suffixes for non-language-specific rules,
import list of alpha unicode characters and adjust regexes.
|
2017-01-08 20:40:33 +01:00 |
|
Ines Montani
|
347c4a2d06
|
Reorganise and reformat global tokenizer prefixes, suffixes and infixes
|
2017-01-08 20:37:39 +01:00 |
|
Ines Montani
|
0dec90e9f7
|
Use global abbreviation data languages and remove duplicates
|
2017-01-08 20:36:00 +01:00 |
|
Ines Montani
|
7c3cb2a652
|
Add global abbreviations data
|
2017-01-08 20:34:03 +01:00 |
|
Ines Montani
|
de5aa92bc2
|
Handle deprecated tokenizer prefix data
|
2017-01-08 20:33:28 +01:00 |
|
Ines Montani
|
abb09782f9
|
Move sun.txt to original location and fix path to not break parser tests
|
2017-01-08 20:32:54 +01:00 |
|
Ines Montani
|
cab39c59c5
|
Add missing contractions to English tokenizer exceptions
Inspired by
https://github.com/kootenpv/contractions/blob/master/contractions/__init
__.py
|
2017-01-05 19:59:06 +01:00 |
|
Ines Montani
|
a23504fe07
|
Move abbreviations below other exceptions
|
2017-01-05 19:58:07 +01:00 |
|
Ines Montani
|
7d2cf934b9
|
Generate he/she/it correctly with 's instead of 've
|
2017-01-05 19:57:00 +01:00 |
|
Ines Montani
|
8328925e1f
|
Add newlines to long German text
|
2017-01-05 18:13:30 +01:00 |
|
Ines Montani
|
55b46d7cf6
|
Add tokenizer tests for German
|
2017-01-05 18:11:25 +01:00 |
|
Ines Montani
|
5bb4081f52
|
Remove redundant test_tokenizer.py for English
|
2017-01-05 18:11:11 +01:00 |
|
Ines Montani
|
8216ba599b
|
Add tests for longer and mixed English texts
|
2017-01-05 18:11:04 +01:00 |
|
Ines Montani
|
65f937d5c6
|
Move basic contraction tests to test_contractions.py
|
2017-01-05 18:09:53 +01:00 |
|
Ines Montani
|
bbe7cab3a1
|
Move non-English-specific tests back to general tokenizer tests
|
2017-01-05 18:09:29 +01:00 |
|
Ines Montani
|
038002d616
|
Reformat HU tokenizer tests and adapt to general style
Improve readability of test cases and add conftest.py with fixture
|
2017-01-05 18:06:44 +01:00 |
|
Ines Montani
|
bc911322b3
|
Move ") to emoticons (see Tweebo challenge test)
|
2017-01-05 18:05:38 +01:00 |
|
Ines Montani
|
637f785036
|
Add general sanity tests for all tokenizers
|
2017-01-05 16:25:38 +01:00 |
|
Ines Montani
|
c5f2dc15de
|
Move English tokenizer tests to directory /en
|
2017-01-05 16:25:04 +01:00 |
|
Ines Montani
|
8b45363b4d
|
Modernize and merge general tokenizer tests
|
2017-01-05 13:17:05 +01:00 |
|
Ines Montani
|
02cfda48c9
|
Modernize and merge tokenizer tests for string loading
|
2017-01-05 13:16:55 +01:00 |
|
Ines Montani
|
a11f684822
|
Modernize and merge tokenizer tests for whitespace
|
2017-01-05 13:16:33 +01:00 |
|
Ines Montani
|
8b284fc6f1
|
Modernize and merge tokenizer tests for text from file
|
2017-01-05 13:15:52 +01:00 |
|
Ines Montani
|
2c2e878653
|
Modernize and merge tokenizer tests for punctuation
|
2017-01-05 13:14:16 +01:00 |
|
Ines Montani
|
8a74129cdf
|
Modernize and merge tokenizer tests for prefixes/suffixes/infixes
|
2017-01-05 13:13:12 +01:00 |
|
Ines Montani
|
0e65dca9a5
|
Modernize and merge tokenizer tests for exception and emoticons
|
2017-01-05 13:11:31 +01:00 |
|
Ines Montani
|
34c47bb20d
|
Fix formatting
|
2017-01-05 13:10:51 +01:00 |
|
Ines Montani
|
2e72683baa
|
Add missing docstrings
|
2017-01-05 13:10:21 +01:00 |
|
Ines Montani
|
da10a049a6
|
Add unicode declarations
|
2017-01-05 13:09:48 +01:00 |
|
Ines Montani
|
58adae8774
|
Remove unused file
|
2017-01-05 13:09:22 +01:00 |
|
Ines Montani
|
c6e5a5349d
|
Move regression test for #360 into own file
|
2017-01-04 00:49:31 +01:00 |
|
Ines Montani
|
8279993a6f
|
Modernize and merge tokenizer tests for punctuation
|
2017-01-04 00:49:20 +01:00 |
|
Ines Montani
|
550630df73
|
Update tokenizer tests for contractions
|
2017-01-04 00:48:42 +01:00 |
|
Ines Montani
|
109f202e8f
|
Update conftest fixture
|
2017-01-04 00:48:21 +01:00 |
|
Ines Montani
|
ee6b49b293
|
Modernize tokenizer tests for emoticons
|
2017-01-04 00:47:59 +01:00 |
|
Ines Montani
|
f09b5a5dfd
|
Modernize tokenizer tests for infixes
|
2017-01-04 00:47:42 +01:00 |
|
Ines Montani
|
59059fed27
|
Move regression test for #351 to own file
|
2017-01-04 00:47:11 +01:00 |
|
Ines Montani
|
667051375d
|
Modernize tokenizer tests for whitespace
|
2017-01-04 00:46:35 +01:00 |
|
Ines Montani
|
aafc894285
|
Modernize tokenizer tests for contractions
Use @pytest.mark.parametrize.
|
2017-01-03 23:02:21 +01:00 |
|
Ines Montani
|
1d237664af
|
Add lowercase lemma to tokenizer exceptions
|
2017-01-03 23:02:21 +01:00 |
|
Ines Montani
|
84a87951eb
|
Fix typos
|
2017-01-03 18:27:43 +01:00 |
|
Ines Montani
|
35b39f53c3
|
Reorganise English tokenizer exceptions (as discussed in #718)
Add logic to generate exceptions that follow a consistent pattern (like
verbs and pronouns) and allow certain tokens to be excluded explicitly.
|
2017-01-03 18:26:09 +01:00 |
|
Ines Montani
|
fb9d3bb022
|
Revert "Merge remote-tracking branch 'origin/master'"
This reverts commit d3b181cdf1, reversing
changes made to b19cfcc144.
|
2017-01-03 18:21:36 +01:00 |
|
Ines Montani
|
461cbb99d8
|
Revert "Reorganise English tokenizer exceptions (as discussed in #718)"
This reverts commit b19cfcc144.
|
2017-01-03 18:21:29 +01:00 |
|
Ines Montani
|
d3b181cdf1
|
Merge remote-tracking branch 'origin/master'
# Conflicts:
# spacy/en/tokenizer_exceptions.py
|
2017-01-03 18:20:01 +01:00 |
|
Ines Montani
|
b19cfcc144
|
Reorganise English tokenizer exceptions (as discussed in #718)
Add logic to generate exceptions that follow a consistent pattern (like
verbs and pronouns) and allow certain tokens to be excluded explicitly.
|
2017-01-03 18:17:57 +01:00 |
|
Ines Montani
|
1bd53bbf89
|
Fix typos (resolves #718)
|
2017-01-03 11:26:21 +01:00 |
|
Matthew Honnibal
|
fde53be3b4
|
Move whole token mach inside _split_affixes.
|
2016-12-30 17:11:50 -06:00 |
|
Matthew Honnibal
|
3ba7c167a8
|
Fix URL tests
|
2016-12-30 17:10:08 -06:00 |
|
Matthew Honnibal
|
9936a1b9b5
|
Merge branch 'tokenization_w_exception_patterns' of https://github.com/oroszgy/spaCy.hu into oroszgy-tokenization_w_exception_patterns
|
2016-12-30 14:53:40 -06:00 |
|
Magnus Burton
|
56e2219b65
|
Added Swedish city abbreviations
|
2016-12-30 21:17:34 +01:00 |
|
Magnus Burton
|
e935c950d8
|
Added months and days as abbreviations for Swedish
|
2016-12-30 21:08:44 +01:00 |
|
Matthew Honnibal
|
3e8d9c772e
|
Test interaction of token_match and punctuation
Check that the new token_match function applies after punctuation is split off.
|
2016-12-31 00:52:17 +11:00 |
|
Matthew Honnibal
|
74b921f394
|
Merge branch 'master' of ssh://github.com/explosion/spaCy into develop
|
2016-12-30 14:38:27 +01:00 |
|
Matthew Honnibal
|
623d94e14f
|
Whitespace
|
2016-12-31 00:30:28 +11:00 |
|
Matthew Honnibal
|
af81ac8bb0
|
Use thinc 6.0
|
2016-12-29 11:58:42 +01:00 |
|