Commit Graph

5103 Commits

Author SHA1 Message Date
Henning Peters
5701686272 cleanup 2016-03-12 13:47:10 +01:00
Wolfgang Seeker
46e3f979f1 add function for setting head and label to token
change PseudoProjectivity.deprojectivize to use these functions
2016-03-11 17:31:06 +01:00
Matthew Honnibal
b37571063a Merge pull request #286 from gushecht/patch-2
added batch_size as keyword argument
2016-03-11 09:46:36 +11:00
Gus Hecht
feefe64ab2 added batch_size as keyword argument
There's probably a better default value....
2016-03-10 14:16:34 -08:00
Wolfgang Seeker
03fb498dbe introduce lang field for LexemeC to hold language id
put noun_chunk logic into iterators.py for each language separately
2016-03-10 13:01:34 +01:00
Oleg Zdornyy
a774131671 Added reloadable English() example for inv. count 2016-03-09 19:35:55 -08:00
Wolfgang Seeker
bc9c62e279 replace Language functions with corresponding orth functions
implement punctuation functions in orth
2016-03-09 18:07:37 +01:00
Wolfgang Seeker
d9312bc9ea add new files npchunks.{pyx,pxd} to hold noun phrase chunk generators 2016-03-09 16:18:48 +01:00
Matthew Honnibal
1508528c8c * Increment version 2016-03-08 15:58:45 +00:00
Matthew Honnibal
963fe5258e * Add missing __contains__ method to vocab 2016-03-08 15:49:10 +00:00
Matthew Honnibal
478aa21cb0 * Remove broken __reduce__ method on vocab 2016-03-08 15:48:21 +00:00
Matthew Honnibal
20235bde00 Merge pull request #282 from henningpeters/switch_vectors
initial proposal for ability to switch vectors
2016-03-09 01:39:41 +11:00
Henning Peters
5b3b3ebc8e upgrade to latest sputnik 2016-03-08 15:30:17 +01:00
Henning Peters
eb7ae61b1c cleanup api 2016-03-08 12:59:18 +01:00
Henning Peters
b740f20191 hash_string() should not depend on python's internal unicode representation, also fixes https://github.com/spacy-io/sense2vec/issues/5 for py2 2016-03-06 09:19:27 +01:00
Henning Peters
aa4d964c14 cleanup api 2016-03-05 17:51:32 +01:00
Henning Peters
931c07a609 initial proposal for separate vector package 2016-03-04 11:09:06 +01:00
Wolfgang Seeker
7adbd7a785 replace Counter with normal dict 2016-03-03 21:36:27 +01:00
Wolfgang Seeker
1ae487a4f6 add backwards compatibility with python 2.6 2016-03-03 21:18:12 +01:00
Wolfgang Seeker
9d1e6de4a0 make a proper list from zip iterator 2016-03-03 19:51:01 +01:00
Wolfgang Seeker
49f9d1c085 change test_nonproj.py to not use zip inside numpy.asarray 2016-03-03 19:42:09 +01:00
Wolfgang Seeker
72b8df0684 turned PseudoProjectivity into a normal python class 2016-03-03 19:05:08 +01:00
Matthew Honnibal
fcaa0ad7ce Merge pull request #280 from wbwseeker/german_parser
German parser
2016-03-04 03:27:42 +11:00
Wolfgang Seeker
690c5acabf adjust train.py to train both english and german models 2016-03-03 15:21:00 +01:00
Matthew Honnibal
9d51e4d13c Delete gather_freqs.py
This script was in a broken state, and should be unnecessary. The functionality is subsumed by `get_freqs.py`
2016-03-02 00:42:55 +11:00
Matthew Honnibal
ae2b479312 Merge pull request #278 from elyase/patch-1
replace codecs.open with io.open
2016-03-02 00:41:23 +11:00
Yaser Martinez Palenzuela
1a93d7f725 replace codecs.open with io.open 2016-03-01 14:10:11 +01:00
Wolfgang Seeker
3448cb40a4 integrated pseudo-projective parsing into parser
- nonproj.pyx holds a class PseudoProjectivity which currently holds
  all functionality to implement Nivre & Nilsson 2005's pseudo-projective
  parsing using the HEAD decoration scheme
- changed lefts/rights in Token to account for possible non-projective
  structures
2016-03-01 10:09:08 +01:00
Henning Peters
ee4c4f6a77 add run section to buildbot.json 2016-02-26 23:04:33 +01:00
Henning Peters
d3a65ef261 fix wheel build/test 2016-02-26 20:47:35 +01:00
Matthew Honnibal
fca5367aac * Switch beam_sgd to best_first_sgd 2016-02-26 02:29:23 +00:00
Wolfgang Seeker
56b7210e82 moved nonproj.py to syntax/nonproj.pyx 2016-02-25 15:08:49 +01:00
Matthew Honnibal
afed99b3c8 * Fix command line arguments for tagger 2016-02-25 03:00:54 +01:00
Matthew Honnibal
a76316ae7e * Try beam search for SGD 2016-02-25 03:00:35 +01:00
Henning Peters
304e27624f run tests for wheels 2016-02-24 20:21:40 +01:00
Henning Peters
4d375afb91 run tests for wheels 2016-02-24 19:59:08 +01:00
Henning Peters
f3df736e0a remove unidecode-related test 2016-02-24 18:22:22 +01:00
Matthew Honnibal
db87db87ea * Update tagger.pxd for CharacterTagger model 2016-02-24 18:20:47 +01:00
Matthew Honnibal
77f2b218f9 * Update conll_train script 2016-02-24 18:19:38 +01:00
Matthew Honnibal
fab538672e * Refactor CharacterTagger 2016-02-24 18:17:16 +01:00
Matthew Honnibal
1ba31f6229 Merge pull request #275 from henningpeters/unidecode
remove text-unidecode dependency
2016-02-25 04:10:45 +11:00
Wolfgang Seeker
4b2297d5d4 add class PseudoProjective for pseudo-projective parsing
PseudoProjective() implements the algorithm from Nivre & Nilsson 2005
using their HEAD decoration scheme.
2016-02-24 11:26:25 +01:00
Henning Peters
12d58a7099 remove text-unidecode dependency 2016-02-24 08:01:59 +01:00
Henning Peters
63deae47fe Update buildbot.json 2016-02-23 13:36:04 +01:00
Matthew Honnibal
92e9134603 * Try new CoNLL tagger method 2016-02-22 22:57:06 +01:00
Matthew Honnibal
3f12fb4191 * Change defaults for character tagger 2016-02-22 22:56:33 +01:00
Matthew Honnibal
422b33838e * Add note explaining parse features 2016-02-22 22:55:52 +01:00
Wolfgang Seeker
8d531c958b replace tests for non-projectivity
- add functions to find non-projective edges
- add test file for non-projectivity functions
2016-02-22 14:40:40 +01:00
Henning Peters
dfd1a1d3a2 Update buildbot.json 2016-02-22 06:13:09 +01:00
Matthew Honnibal
141639ea3a * Fix bug in tokenizer that caused new tokens to be added for affixes 2016-02-21 23:17:47 +00:00