explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-04-25 11:23:40 +03:00
Code Issues Packages Projects Releases Wiki Activity

Update adding languages example

Browse Source
This commit is contained in:
ines 2017-11-04 15:12:39 +01:00
parent c83fe54f0c
commit d9fa3c6054
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
website/usage/_adding-languages/_language-data.jade
View File

@ -139,7 +139,7 @@ p
# merge base exceptions and custom tokenizer exceptions # merge base exceptions and custom tokenizer exceptions
tokenizer_exceptions = update_exc(BASE_EXCEPTIONS, TOKENIZER_EXCEPTIONS) tokenizer_exceptions = update_exc(BASE_EXCEPTIONS, TOKENIZER_EXCEPTIONS)
stop_words = set(STOP_WORDS) stop_words = STOP_WORDS
# create actual Language class # create actual Language class
class Xxxxx(Language): class Xxxxx(Language):
@ -248,7 +248,7 @@ p
{ORTH: period, LEMMA: "p.m."}] {ORTH: period, LEMMA: "p.m."}]
# only declare this at the bottom # only declare this at the bottom
TOKENIZER_EXCEPTIONS = dict(_exc) TOKENIZER_EXCEPTIONS = _exc
+aside("Generating tokenizer exceptions") +aside("Generating tokenizer exceptions")
| Keep in mind that generating exceptions only makes sense if there's a | Keep in mind that generating exceptions only makes sense if there's a