diff --git a/website/docs/usage/_benchmarks-models.md b/website/docs/usage/_benchmarks-models.md index a722c894f..1e755e39d 100644 --- a/website/docs/usage/_benchmarks-models.md +++ b/website/docs/usage/_benchmarks-models.md @@ -1,14 +1,12 @@ import { Help } from 'components/typography'; import Link from 'components/link' - -
-| Pipeline | Parser | Tagger | NER | WPS
CPU words per second on CPU, higher is better | WPS
GPU words per second on GPU, higher is better | -| ---------------------------------------------------------- | -----: | -----: | ---: | ------------------------------------------------------------------: | -----------------------------------------------------------------: | -| [`en_core_web_trf`](/models/en#en_core_web_trf) (spaCy v3) | 95.5 | 98.3 | 89.4 | 1k | 8k | -| [`en_core_web_lg`](/models/en#en_core_web_lg) (spaCy v3) | 92.2 | 97.4 | 85.4 | 7k | | -| `en_core_web_lg` (spaCy v2) | 91.9 | 97.2 | 85.7 | 10k | | +| Pipeline | Parser | Tagger | NER | +| ---------------------------------------------------------- | -----: | -----: | ---: | +| [`en_core_web_trf`](/models/en#en_core_web_trf) (spaCy v3) | 95.5 | 98.3 | 89.4 | +| [`en_core_web_lg`](/models/en#en_core_web_lg) (spaCy v3) | 92.2 | 97.4 | 85.4 | +| `en_core_web_lg` (spaCy v2) | 91.9 | 97.2 | 85.5 |
@@ -22,13 +20,11 @@ the development set).
-| Named Entity Recognition System | OntoNotes | CoNLL '03 | -| ------------------------------------------------------------------------------ | --------: | --------: | -| spaCy RoBERTa (2020) | 89.7 | 91.6 | -| spaCy CNN (2020) | 84.5 | 87.4 | -| [Stanza](https://stanfordnlp.github.io/stanza/) (StanfordNLP)1 | 88.8 | 92.1 | -| Flair2 | 89.7 | 93.1 | -| BERT Base3 | - | 92.4 | +| Named Entity Recognition System | OntoNotes | CoNLL '03 | +| -------------------------------- | --------: | --------: | +| spaCy RoBERTa (2020) | 89.7 | 91.6 | +| Stanza (StanfordNLP)1 | 88.8 | 92.1 | +| Flair2 | 89.7 | 93.1 |
@@ -39,8 +35,7 @@ the development set). more results. Project template: [`benchmarks/ner_conll03`](%%GITHUB_PROJECTS/benchmarks/ner_conll03). **1. ** [Qi et al. (2020)](https://arxiv.org/pdf/2003.07082.pdf). **2. ** -[Akbik et al. (2018)](https://www.aclweb.org/anthology/C18-1139/). **3. ** -[Devlin et al. (2018)](https://arxiv.org/abs/1810.04805). +[Akbik et al. (2018)](https://www.aclweb.org/anthology/C18-1139/).
diff --git a/website/docs/usage/facts-figures.md b/website/docs/usage/facts-figures.md index 52696b7dc..269ac5e17 100644 --- a/website/docs/usage/facts-figures.md +++ b/website/docs/usage/facts-figures.md @@ -78,7 +78,6 @@ import Benchmarks from 'usage/\_benchmarks-models.md' | Dependency Parsing System | UAS | LAS | | ------------------------------------------------------------------------------ | ---: | ---: | | spaCy RoBERTa (2020) | 95.5 | 94.3 | -| spaCy CNN (2020) | | | | [Mrini et al.](https://khalilmrini.github.io/Label_Attention_Layer.pdf) (2019) | 97.4 | 96.3 | | [Zhou and Zhao](https://www.aclweb.org/anthology/P19-1230/) (2019) | 97.2 | 95.7 | @@ -93,30 +92,6 @@ results. Project template:
-### Speed comparison {#benchmarks-speed} - - - -
- -| Library | Pipeline | WPS CPU words per second on CPU, higher is better | WPS GPU words per second on GPU, higher is better | -| ------- | ----------------------------------------------- | -------------------------------------------------------------: | -------------------------------------------------------------: | -| spaCy | [`en_core_web_md`](/models/en#en_core_web_md) | -| spaCy | [`en_core_web_trf`](/models/en#en_core_web_trf) | -| Stanza | `en_ewt` | | -| Flair | `pos-fast_ner-fast` | -| Flair | `pos_ner` | -| UDPipe | `english-ewt-ud-2.5` | - -
- -**End-to-end processing speed** on raw unannotated text. Project template: -[`benchmarks/speed`](%%GITHUB_PROJECTS/benchmarks/speed). - -
- -
-