Wolfgang Seeker eae35e9b27 add tokenizer files for German, add/change code to train German pos tagger ... - add files to specify rules for German tokenization - change generate_specials.py to generate from an external file (abbrev.de.tab) - copy gazetteer.json from lang_data/en/ - init_model.py - change doc freq threshold to 0 - add train_german_tagger.py - expects conll09-formatted input		2016-02-18 13:24:20 +01:00
..
data	add data dir	2015-11-18 11:48:55 +01:00
de	access model via sputnik	2015-12-07 06:01:28 +01:00
en	* Restore the LOCAL_DATA_DIR global in spacy/en/__init__.py, although this is now deprecated	2016-01-19 02:54:56 +01:00
fi	access model via sputnik	2015-12-07 06:01:28 +01:00
it	access model via sputnik	2015-12-07 06:01:28 +01:00
munge	* Fix Python3 problem in align_raw	2015-07-28 16:06:53 +02:00
serialize	* Whitespace	2016-01-29 03:59:22 +01:00
syntax	* Fix Issue #251: Incorrect right edge calculation on left-clobber low in the tree	2016-02-07 00:00:42 +01:00
tests	Update test_tokenizer.py	2016-02-10 19:24:37 +01:00
tokens	* Refine the way the is_parsed attribute is set by from_array	2016-02-06 14:44:35 +01:00
__init__.pxd	* Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags.	2014-10-24 02:23:42 +11:00
__init__.py	distinct load() and from_package() methods	2016-01-16 10:00:57 +01:00
about.py	* Increment version	2016-02-07 13:48:58 +01:00
attrs.pxd	* Add placeholders for the new flags in attrs and symbols	2016-02-04 15:49:45 +01:00
attrs.pyx	* Add placeholders for the new flags in attrs and symbols	2016-02-04 15:49:45 +01:00
cfile.pxd	* Add cfile.pyx	2015-07-23 01:10:36 +02:00
cfile.pyx	* Fix CFile for Python2	2015-07-25 22:55:53 +02:00
gold.pxd	* Remove unused import	2015-07-25 18:11:16 +02:00
gold.pyx	* Use io module insteads of deprecated codecs module	2015-10-10 14:13:01 +11:00
language.py	* Fix oov probability	2016-02-06 15:13:55 +01:00
lemmatizer.py	distinct load() and from_package() methods	2016-01-16 10:00:57 +01:00
lexeme.pxd	* Fix ugly py_check_flag and py_set_flag functions in Lexeme	2015-09-15 13:06:18 +10:00
lexeme.pyx	* Use generic flags for the new attributes until they're added	2016-02-04 15:50:54 +01:00
matcher.pyx	* Fix Matcher.pipe	2016-02-05 19:46:02 +01:00
morphology.pxd	* Ensure Morphology can be pickled, to address Issue #125.	2015-10-13 13:44:41 +11:00
morphology.pyx	* Fix imports	2016-01-19 03:36:51 +01:00
multi_words.py	* Fix Issue #50: Python 3 compatibility of v0.80	2015-04-13 05:59:43 +02:00
orth.pxd	* Host IS_ flags in attrs.pxd, and add properties for them on Token and Lexeme objects	2015-07-26 16:37:16 +02:00
orth.pyx	* Add stubs for is_bracket/is_quote/is_left_punct/is_right_punct functions	2016-02-04 13:03:04 +01:00
parts_of_speech.pxd	* Fix parts_of_speech now that symbols list has been reformed	2015-10-13 13:44:40 +11:00
parts_of_speech.pyx	* Fix NAMES list in spacy/parts_of_speech.pyx	2015-10-13 14:18:45 +11:00
scorer.py	* Accept punct_labels as an argument to the scorer	2016-02-02 22:59:06 +01:00
strings.pxd	* Use unicode in StringStore.intern, instead of unreliably casting to bytes.	2015-11-05 11:32:19 +00:00
strings.pyx	* Refactor away from the _ml module, to use thinc 4.0. Still some work needs to be done, e.g. to add __reduce__ to the models, more testing, etc.	2015-11-07 03:24:30 +11:00
structs.pxd	* Clean up unused Constituent struct.	2015-11-03 23:48:21 +11:00
symbols.pxd	* Add placeholders for the new flags in attrs and symbols	2016-02-04 15:49:45 +01:00
symbols.pyx	* Add placeholders for the new flags in attrs and symbols	2016-02-04 15:49:45 +01:00
tagger.pxd	* Move to thinc 5.0	2016-01-29 03:58:55 +01:00
tagger.pyx	add tokenizer files for German, add/change code to train German pos tagger	2016-02-18 13:24:20 +01:00
tokenizer.pxd	Add __reduce__ to Tokenizer so that English pickles.	2015-10-23 22:24:03 -07:00
tokenizer.pyx	* Add pipe() method to tokenizer	2016-02-03 02:32:37 +01:00
typedefs.pxd	* Fix type declarations for attr_t. Remove unused id_t.	2015-07-18 22:39:57 +02:00
typedefs.pyx	* Move POS tag definitions to parts_of_speech.pxd	2015-01-25 16:31:07 +11:00
util.py	untangle data_path/via	2016-01-16 12:23:45 +01:00
vocab.pxd	* Start trying to pickle Vocab	2015-10-13 13:44:41 +11:00
vocab.pyx	* Fix oov probability	2016-02-06 15:13:55 +01:00