spaCy/spacy/fr/language_data.py

# encoding: utf8
from __future__ import unicode_literals

from .stop_words import STOP_WORDS
from .tokenizer_exceptions import get_tokenizer_exceptions, TOKEN_MATCH


STOP_WORDS = set(STOP_WORDS)


__all__ = ["STOP_WORDS", "get_tokenizer_exceptions", "TOKEN_MATCH"]
Stub out support for French, Spanish, Italian and Portuguese 2016-11-02 22:02:41 +03:00			`# encoding: utf8`
			`from __future__ import unicode_literals`

Reorganise language data 2016-12-18 18:54:19 +03:00			`from .stop_words import STOP_WORDS`
Avoid loading all French exceptions on import Move exceptions loading behind a get_tokenizer_exceptions() function for French, instead of loading into the top-level namespace. This cuts import times from 0.6s to 0.2s, at the expense of making the French data a little different from the others (there's no top-level TOKENIZER_EXCEPTIONS variable.) The current solution feels somewhat unsatisfying. 2017-02-25 13:55:00 +03:00			`from .tokenizer_exceptions import get_tokenizer_exceptions, TOKEN_MATCH`
Stub out support for French, Spanish, Italian and Portuguese 2016-11-02 22:02:41 +03:00

Reorganise language data 2016-12-18 18:54:19 +03:00			`STOP_WORDS = set(STOP_WORDS)`
Fix formatting 2016-12-17 14:33:09 +03:00
Stub out support for French, Spanish, Italian and Portuguese 2016-11-02 22:02:41 +03:00
Avoid loading all French exceptions on import Move exceptions loading behind a get_tokenizer_exceptions() function for French, instead of loading into the top-level namespace. This cuts import times from 0.6s to 0.2s, at the expense of making the French data a little different from the others (there's no top-level TOKENIZER_EXCEPTIONS variable.) The current solution feels somewhat unsatisfying. 2017-02-25 13:55:00 +03:00			`__all__ = ["STOP_WORDS", "get_tokenizer_exceptions", "TOKEN_MATCH"]`