explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-26 18:06:29 +03:00
Code Issues Packages Projects Releases Wiki Activity

* Shuffle docs before doing jackknife partition --- otherwise we'll not get the right genre mixes...

Browse Source
This commit is contained in:
Matthew Honnibal 2015-05-31 01:25:02 +02:00
parent 4d8d490547
commit d42dda0372
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
bin/parser/train.py
View File

@ -81,6 +81,7 @@ def get_train_tags(Language, model_dir, docs, gold_preproc):
return taggings return taggings
def get_partitions(docs, n_parts): def get_partitions(docs, n_parts):
random.shuffle(docs)
n_test = len(docs) / n_parts n_test = len(docs) / n_parts
n_train = len(docs) - n_test n_train = len(docs) - n_test
for part in range(n_parts): for part in range(n_parts):