Commit Graph

1977 Commits

Author SHA1 Message Date
Matthew Honnibal
46caf15bca Merge pull request #101 from henningpeters/master
basic german rules
2015-09-22 21:50:26 +10:00
Henning Peters
911de2ae49 add overseen (?) char 2015-09-22 12:29:47 +02:00
Henning Peters
9ecb98f30e basic german rules 2015-09-22 11:56:29 +02:00
Matthew Honnibal
d4a013ccab * Add a simple example POS tagger script 2015-09-22 15:56:14 +10:00
Matthew Honnibal
f5c256745b Merge branch 'master' of ssh://github.com/honnibal/spaCy 2015-09-22 12:26:24 +10:00
Matthew Honnibal
528e26a506 * Add rule to ensure ordinals are preserved as single tokens 2015-09-22 12:26:05 +10:00
Matthew Honnibal
9431441544 * Update the publish command, so that it creates a git tag 2015-09-22 02:26:10 +02:00
Robert
8711b64860 Force SSL for downloading English language data.
It would also be nice to have a checksum for this.
2015-09-21 17:26:01 -07:00
Matthew Honnibal
5fa18e4f9d * Update mark on test_vec 2015-09-22 02:23:11 +02:00
Matthew Honnibal
361f6fdd74 * Inc version 2015-09-22 02:22:27 +02:00
Matthew Honnibal
d9c29de3af * Add vectors tests for token API 2015-09-22 02:11:31 +02:00
Matthew Honnibal
f7283a5067 * Fix vectors bugs for OOV words 2015-09-22 02:10:25 +02:00
Matthew Honnibal
44aecba701 * Fix Token.has_vector and Lexeme.has_vector 2015-09-22 01:43:16 +02:00
Matthew Honnibal
596fde8daa * Add has_vector attribute to Token and Lexeme 2015-09-21 19:52:43 +10:00
Matthew Honnibal
c0a63ac157 * Mark SBD tests as requiring models 2015-09-21 19:23:38 +10:00
Matthew Honnibal
1b5f8b888f Merge branch 'master' of https://github.com/honnibal/spaCy 2015-09-21 11:07:06 +02:00
Matthew Honnibal
f0b9f0ff3e * Add wordnet 2015-09-21 19:06:48 +10:00
Matthew Honnibal
c3dea8bc8b * Inc version 2015-09-21 10:58:11 +02:00
Matthew Honnibal
f32927efbf * Raise exceptions if attempt to access parse, but data is not installed. This partly but not fully addresses Issue #97. Still need exceptions on the various Token attributes that access the parse tree, e.g. token.head, token.lefts, token.rights, etc. Exceptions should be centralized, too. 2015-09-21 18:35:40 +10:00
Matthew Honnibal
388062ae01 * Fix repvec_length problem 2015-09-21 18:10:51 +10:00
Matthew Honnibal
ac459278d1 * Fix vector length error reporting, and ensure vec_len is returned 2015-09-21 18:08:32 +10:00
Matthew Honnibal
ba4e563701 * Ensure vectors are same length, and return vector length in load_vectors_bz2 2015-09-21 18:03:08 +10:00
Matthew Honnibal
d00fe2bbc6 * Don't allow Span objects to be written to, as it introduces subtle bugs because they're created afresh from Doc.sents, Doc.ents etc. 2015-09-21 17:59:39 +10:00
Matthew Honnibal
d6945bf880 * Add way to load vectors from bz2 file to vocab 2015-09-17 12:58:23 +10:00
Matthew Honnibal
77856c4fcd * Try giving Doc and Span objects vector and vector_norm attributes, and .similarity functions. Turns out to be bad idea. 2015-09-17 11:50:11 +10:00
Matthew Honnibal
191d593e03 * Fix vectors bug in lexeme 2015-09-15 19:05:11 +10:00
Matthew Honnibal
22a1ad8a55 * Upd test_merge 2015-09-15 14:55:23 +10:00
Matthew Honnibal
3d87519f64 * Remove vectors argument from Vocab object 2015-09-15 14:47:14 +10:00
Matthew Honnibal
362526b592 * Rename vectors_length attribute 2015-09-15 14:43:31 +10:00
Matthew Honnibal
60c26b2dfa * Fix slicing when start or stop is None 2015-09-15 14:43:10 +10:00
Matthew Honnibal
7ac6cacc26 * Remove const qualifier on LexemeC.repvec 2015-09-15 14:42:51 +10:00
Matthew Honnibal
dd4d64b235 * Support setting of word vectors on Lexeme object. 2015-09-15 14:42:27 +10:00
Matthew Honnibal
27f988b167 * Remove the vectors option to Vocab, preferring to either load vectors from disk, or set them on the Lexeme objects. 2015-09-15 14:41:48 +10:00
Matthew Honnibal
893542afae Merge branch 'master' of ssh://github.com/honnibal/spaCy 2015-09-15 13:06:54 +10:00
Matthew Honnibal
193f127f81 * Fix ugly py_check_flag and py_set_flag functions in Lexeme 2015-09-15 13:06:18 +10:00
Matthew Honnibal
6865f0b5fd Merge branch 'master' of https://github.com/honnibal/spaCy 2015-09-14 10:25:57 +02:00
Matthew Honnibal
9561d88529 * Add is_stop to Python API 2015-09-14 18:25:40 +10:00
Matthew Honnibal
50a7c41429 Merge branch 'master' of https://github.com/honnibal/spaCy 2015-09-14 09:53:33 +02:00
Matthew Honnibal
5dcdc29ecf * Fix test_base_nps 2015-09-14 09:53:26 +02:00
Matthew Honnibal
65dc0d1dfb * Extend word vectors support, with .similarity() function, vector_norm property, and rename repvec to vector. Keep repvec name as well for now for backwards compatibility. 2015-09-14 17:49:58 +10:00
Matthew Honnibal
e13e47e9e5 * Add English stop words 2015-09-14 17:48:51 +10:00
Matthew Honnibal
4ec89788ca * Add tests for new vectors functionality 2015-09-14 17:48:13 +10:00
Matthew Honnibal
c26b4b4650 * Fix test_base_nps 2015-09-14 09:01:19 +10:00
Matthew Honnibal
2ef449f9d7 * Comment out german test 2015-09-13 10:57:47 +10:00
Matthew Honnibal
24ed3fc25c * Check file existance before opening in lemmatizer 2015-09-13 10:45:21 +10:00
Matthew Honnibal
73d7ece34d * Add tests for german 2015-09-13 10:32:20 +10:00
Matthew Honnibal
dbb48ce49e * Delete extra wordnets 2015-09-13 10:31:37 +10:00
Matthew Honnibal
a1292adb82 * Test new text and text_with_ws attributes in Token 2015-09-13 10:30:37 +10:00
Matthew Honnibal
e9c59693ea * Remove assertion from vocab.pyx 2015-09-13 10:30:08 +10:00
Matthew Honnibal
c08f10083c * Add test and test_with_ws attributes. 2015-09-13 10:27:42 +10:00