spaCy/website/docs/api/language-models.jade

50 lines
1.6 KiB
Plaintext
Raw Normal View History

2016-11-02 13:25:09 +03:00
//- 💫 DOCS > API > LANGUAGE MODELS
include ../../_includes/_mixins
2016-12-21 02:54:52 +03:00
p spaCy currently supports the following languages and capabilities:
+aside-code("Download language models", "bash").
python -m spacy.en.download all
python -m spacy.de.download all
+table([ "Language", "Token", "SBD", "Lemma", "POS", "NER", "Dep", "Vector", "Sentiment"])
+row
+cell English #[code en]
each icon in [ "pro", "pro", "pro", "pro", "pro", "pro", "pro", "con" ]
+cell.u-text-center #[+procon(icon)]
+row
+cell German #[code de]
each icon in [ "pro", "pro", "con", "pro", "pro", "pro", "pro", "con" ]
+cell.u-text-center #[+procon(icon)]
2016-11-05 04:50:52 +03:00
+row
+cell Chinese #[code zh]
each icon in [ "pro", "con", "con", "con", "con", "con", "con", "con" ]
+cell.u-text-center #[+procon(icon)]
2016-12-21 02:54:52 +03:00
+row
+cell Spanish #[code es]
each icon in [ "pro", "con", "con", "con", "con", "con", "con", "con" ]
+cell.u-text-center #[+procon(icon)]
2016-11-03 03:52:31 +03:00
p
2016-11-05 04:50:52 +03:00
| Chinese tokenization requires the
| #[+a("https://github.com/fxsjy/jieba") Jieba] library. Statistical
2016-12-21 02:54:52 +03:00
| models are coming soon.
+h(2, "alpha-support") Alpha support
p
| Work has started on the following languages. You can help by improving
| the existing language data and extending the tokenization patterns.
+table([ "Language", "Source" ])
each language, code in { it: "Italian", fr: "French", pt: "Portuguese", nl: "Dutch", sv: "Swedish", hu: "Hungarian" }
2016-12-21 02:54:52 +03:00
+row
+cell #{language} #[code=code]
+cell
+src(gh("spaCy", "spacy/" + code)) spacy/#{code}