spaCy/spacy/__init__.py

import pathlib

from .util import set_lang_class, get_lang_class
from .about import __version__

from . import en
from . import de
from . import zh
from . import es
from . import it
from . import hu
from . import fr
from . import pt
from . import nl
from . import sv
from . import fi
from . import bn

try:
    basestring
except NameError:
    basestring = str


set_lang_class(en.English.lang, en.English)
set_lang_class(de.German.lang, de.German)
set_lang_class(es.Spanish.lang, es.Spanish)
set_lang_class(pt.Portuguese.lang, pt.Portuguese)
set_lang_class(fr.French.lang, fr.French)
set_lang_class(it.Italian.lang, it.Italian)
set_lang_class(hu.Hungarian.lang, hu.Hungarian)
set_lang_class(zh.Chinese.lang, zh.Chinese)
set_lang_class(nl.Dutch.lang, nl.Dutch)
set_lang_class(sv.Swedish.lang, sv.Swedish)
set_lang_class(fi.Finnish.lang, fi.Finnish)
set_lang_class(bn.Bengali.lang, bn.Bengali)


def load(name, **overrides):
    target_name, target_version = util.split_data_name(name)
    data_path = overrides.get('path', util.get_data_path())
    path = util.match_best_version(target_name, target_version, data_path)
    cls = get_lang_class(target_name)
    overrides['path'] = path
    return cls(**overrides)
Mostly finished loading refactoring. Design is in place, but doesn't work yet. 2016-09-24 16:42:01 +03:00			`import pathlib`

			`from .util import set_lang_class, get_lang_class`
Fix #608 -- __version__ should be available at the base of the package. 2016-11-04 23:21:02 +03:00			`from .about import __version__`
refactored data_dir->via, add zip_safe, add spacy.load() 2016-01-15 20:01:02 +03:00
avoid polluting spacy namespace with lang classes 2016-04-12 17:31:16 +03:00			`from . import en`
			`from . import de`
* Register Chinese language in spacy/__init__.py 2016-04-24 19:45:16 +03:00			`from . import zh`
Link languages in __init__.py 2016-11-02 22:05:14 +03:00			`from . import es`
			`from . import it`
Hungarian module is exposed in spacy. 2016-12-21 22:45:36 +03:00			`from . import hu`
Add import fr 2016-11-02 22:48:29 +03:00			`from . import fr`
Link languages in __init__.py 2016-11-02 22:05:14 +03:00			`from . import pt`
Added nl module for dutch 2016-11-24 18:39:49 +03:00			`from . import nl`
Initial commit for Swedish 2016-12-20 13:05:06 +03:00			`from . import sv`
Add preliminary support for Finnish 2017-02-01 01:27:29 +03:00			`from . import fi`
add basic Bengali support 2017-02-28 04:48:37 +03:00			`from . import bn`
first idea for supporting multiple langs in download script 2016-03-24 13:19:43 +03:00
Python 3 compatible basestring 2016-09-24 23:09:21 +03:00			`try:`
Whitespace 2016-09-24 23:17:01 +03:00			`basestring`
Python 3 compatible basestring 2016-09-24 23:09:21 +03:00			`except NameError:`
Whitespace 2016-09-24 23:17:01 +03:00			`basestring = str`
Python 3 compatible basestring 2016-09-24 23:09:21 +03:00

avoid polluting spacy namespace with lang classes 2016-04-12 17:31:16 +03:00			`set_lang_class(en.English.lang, en.English)`
			`set_lang_class(de.German.lang, de.German)`
Link languages in __init__.py 2016-11-02 22:05:14 +03:00			`set_lang_class(es.Spanish.lang, es.Spanish)`
			`set_lang_class(pt.Portuguese.lang, pt.Portuguese)`
			`set_lang_class(fr.French.lang, fr.French)`
			`set_lang_class(it.Italian.lang, it.Italian)`
First steps towards the Hungarian tokenizer code. 2016-12-08 01:07:43 +03:00			`set_lang_class(hu.Hungarian.lang, hu.Hungarian)`
* Register Chinese language in spacy/__init__.py 2016-04-24 19:45:16 +03:00			`set_lang_class(zh.Chinese.lang, zh.Chinese)`
Added language Dutch to init file 2016-11-29 18:42:05 +03:00			`set_lang_class(nl.Dutch.lang, nl.Dutch)`
Initial commit for Swedish 2016-12-20 13:05:06 +03:00			`set_lang_class(sv.Swedish.lang, sv.Swedish)`
Add preliminary support for Finnish 2017-02-01 01:27:29 +03:00			`set_lang_class(fi.Finnish.lang, fi.Finnish)`
add basic Bengali support 2017-02-28 04:48:37 +03:00			`set_lang_class(bn.Bengali.lang, bn.Bengali)`
Add preliminary support for Finnish 2017-02-01 01:27:29 +03:00
add lang registration facility 2016-03-25 20:54:45 +03:00

Fix spacy.load 2016-10-18 20:23:31 +03:00			`def load(name, **overrides):`
Add spacy.blank() method, that doesn't load data. Don't try to load data if path is falsey 2016-09-26 12:07:46 +03:00			`target_name, target_version = util.split_data_name(name)`
Fix loading of GloVe vectors, to address Issue #541 2016-10-20 19:27:48 +03:00			`data_path = overrides.get('path', util.get_data_path())`
			`path = util.match_best_version(target_name, target_version, data_path)`
Finish refactoring data loading 2016-09-24 21:26:17 +03:00			`cls = get_lang_class(target_name)`
Fix path-override bug in spacy.load 2016-12-19 00:15:29 +03:00			`overrides['path'] = path`
			`return cls(**overrides)`