explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-11-18 23:57:05 +03:00
Code Issues Packages Projects Releases Wiki Activity
14,893 Commits 68 Branches 175 Tags 279 MiB
d8e8ffdc5c
Commit Graph

14893 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Matthew Honnibal
478aa21cb0 * Remove broken __reduce__ method on vocab 2016-03-08 15:48:21 +00:00
Matthew Honnibal
20235bde00 Merge pull request #282 from henningpeters/switch_vectors 
initial proposal for ability to switch vectors
 2016-03-09 01:39:41 +11:00
Henning Peters
5b3b3ebc8e upgrade to latest sputnik 2016-03-08 15:30:17 +01:00
Henning Peters
eb7ae61b1c cleanup api 2016-03-08 12:59:18 +01:00
Henning Peters
b740f20191 hash_string() should not depend on python's internal unicode representation, also fixes https://github.com/spacy-io/sense2vec/issues/5 for py2 2016-03-06 09:19:27 +01:00
Henning Peters
aa4d964c14 cleanup api 2016-03-05 17:51:32 +01:00
Henning Peters
931c07a609 initial proposal for separate vector package 2016-03-04 11:09:06 +01:00
Wolfgang Seeker
7adbd7a785 replace Counter with normal dict 2016-03-03 21:36:27 +01:00
Wolfgang Seeker
1ae487a4f6 add backwards compatibility with python 2.6 2016-03-03 21:18:12 +01:00
Wolfgang Seeker
9d1e6de4a0 make a proper list from zip iterator 2016-03-03 19:51:01 +01:00
Wolfgang Seeker
49f9d1c085 change test_nonproj.py to not use zip inside numpy.asarray 2016-03-03 19:42:09 +01:00
Wolfgang Seeker
72b8df0684 turned PseudoProjectivity into a normal python class 2016-03-03 19:05:08 +01:00
Matthew Honnibal
fcaa0ad7ce Merge pull request #280 from wbwseeker/german_parser 
German parser
 2016-03-04 03:27:42 +11:00
Wolfgang Seeker
690c5acabf adjust train.py to train both english and german models 2016-03-03 15:21:00 +01:00
Matthew Honnibal
9d51e4d13c Delete gather_freqs.py 
This script was in a broken state, and should be unnecessary. The functionality is subsumed by `get_freqs.py`
 2016-03-02 00:42:55 +11:00
Matthew Honnibal
ae2b479312 Merge pull request #278 from elyase/patch-1 
replace codecs.open with io.open
 2016-03-02 00:41:23 +11:00
Yaser Martinez Palenzuela
1a93d7f725 replace codecs.open with io.open 2016-03-01 14:10:11 +01:00
Wolfgang Seeker
3448cb40a4 integrated pseudo-projective parsing into parser 
- nonproj.pyx holds a class PseudoProjectivity which currently holds
  all functionality to implement Nivre & Nilsson 2005's pseudo-projective
  parsing using the HEAD decoration scheme
- changed lefts/rights in Token to account for possible non-projective
  structures
 2016-03-01 10:09:08 +01:00
Henning Peters
ee4c4f6a77 add run section to buildbot.json 2016-02-26 23:04:33 +01:00
Henning Peters
d3a65ef261 fix wheel build/test 2016-02-26 20:47:35 +01:00
Matthew Honnibal
fca5367aac * Switch beam_sgd to best_first_sgd 2016-02-26 02:29:23 +00:00
Wolfgang Seeker
56b7210e82 moved nonproj.py to syntax/nonproj.pyx 2016-02-25 15:08:49 +01:00
Matthew Honnibal
afed99b3c8 * Fix command line arguments for tagger 2016-02-25 03:00:54 +01:00
Matthew Honnibal
a76316ae7e * Try beam search for SGD 2016-02-25 03:00:35 +01:00
Henning Peters
304e27624f run tests for wheels 2016-02-24 20:21:40 +01:00
Henning Peters
4d375afb91 run tests for wheels 2016-02-24 19:59:08 +01:00
Henning Peters
f3df736e0a remove unidecode-related test 2016-02-24 18:22:22 +01:00
Matthew Honnibal
db87db87ea * Update tagger.pxd for CharacterTagger model 2016-02-24 18:20:47 +01:00
Matthew Honnibal
77f2b218f9 * Update conll_train script 2016-02-24 18:19:38 +01:00
Matthew Honnibal
fab538672e * Refactor CharacterTagger 2016-02-24 18:17:16 +01:00
Matthew Honnibal
1ba31f6229 Merge pull request #275 from henningpeters/unidecode 
remove text-unidecode dependency
 2016-02-25 04:10:45 +11:00
Wolfgang Seeker
4b2297d5d4 add class PseudoProjective for pseudo-projective parsing 
PseudoProjective() implements the algorithm from Nivre & Nilsson 2005
using their HEAD decoration scheme.
 2016-02-24 11:26:25 +01:00
Henning Peters
12d58a7099 remove text-unidecode dependency 2016-02-24 08:01:59 +01:00
Henning Peters
63deae47fe Update buildbot.json 2016-02-23 13:36:04 +01:00
Matthew Honnibal
92e9134603 * Try new CoNLL tagger method 2016-02-22 22:57:06 +01:00
Matthew Honnibal
3f12fb4191 * Change defaults for character tagger 2016-02-22 22:56:33 +01:00
Matthew Honnibal
422b33838e * Add note explaining parse features 2016-02-22 22:55:52 +01:00
Wolfgang Seeker
8d531c958b replace tests for non-projectivity 
- add functions to find non-projective edges
- add test file for non-projectivity functions
 2016-02-22 14:40:40 +01:00
Henning Peters
dfd1a1d3a2 Update buildbot.json 2016-02-22 06:13:09 +01:00
Matthew Honnibal
141639ea3a * Fix bug in tokenizer that caused new tokens to be added for affixes 2016-02-21 23:17:47 +00:00
Matthew Honnibal
5f53ef1a43 * Update conll_train for tagger, to use neural network tagger 2016-02-22 00:16:40 +01:00
Matthew Honnibal
c3f334cef1 * Work on character tagger 2016-02-22 00:15:25 +01:00
Matthew Honnibal
7a519ea5af * Add cautionary note to vocab about encoding 2016-02-22 00:13:20 +01:00
Henning Peters
1501ef58e0 Update README.md 2016-02-19 19:36:47 +01:00
Henning Peters
85f94fd314 get rid of pip-clear.py 2016-02-19 18:48:02 +01:00
Henning Peters
37a7020904 move displacy to its own subdomain 2016-02-19 14:03:52 +01:00
Henning Peters
59339d45e5 remove displacy 2016-02-19 13:30:49 +01:00
Henning Peters
0bb05ec7e1 Merge branch 'master' of github.com:spacy-io/spaCy 2016-02-19 13:30:14 +01:00
Henning Peters
d86a2a7a78 Update _installation.jade 
with ```pip install -e .``` we don't need to set the PYTHONPATH anymore
also sync build instructions with travis script
 2016-02-18 22:54:20 +01:00
Wolfgang Seeker
eae35e9b27 add tokenizer files for German, add/change code to train German pos tagger 
- add files to specify rules for German tokenization
- change generate_specials.py to generate from an external file (abbrev.de.tab)
- copy gazetteer.json from lang_data/en/

- init_model.py
	- change doc freq threshold to 0
- add train_german_tagger.py
	- expects conll09-formatted input
 2016-02-18 13:24:20 +01:00