mirror of
https://github.com/explosion/spaCy.git
synced 2025-07-12 01:02:23 +03:00
set appropriate model example configs
This commit is contained in:
parent
30b6e7d802
commit
8a44f7bc9b
|
@ -659,6 +659,15 @@ These models all take the same parameters:
|
||||||
| `max_request_time` | Max. time (in seconds) to wait for request to terminate before raising an exception. Defaults to `30.0`. ~~float~~ |
|
| `max_request_time` | Max. time (in seconds) to wait for request to terminate before raising an exception. Defaults to `30.0`. ~~float~~ |
|
||||||
| `interval` | Time interval (in seconds) for API retries in seconds. Defaults to `1.0`. ~~float~~ |
|
| `interval` | Time interval (in seconds) for API retries in seconds. Defaults to `1.0`. ~~float~~ |
|
||||||
|
|
||||||
|
> #### Example config:
|
||||||
|
>
|
||||||
|
> ```ini
|
||||||
|
> [components.llm.model]
|
||||||
|
> @llm_models = "spacy.GPT-4.v1"
|
||||||
|
> name = "gpt-4"
|
||||||
|
> config = {"temperature": 0.0}
|
||||||
|
> ```
|
||||||
|
|
||||||
| Model | Provider | Supported names | Default name |
|
| Model | Provider | Supported names | Default name |
|
||||||
| ----------------------------- | --------- | ---------------------------------------------------------------------------------------- | ---------------------- |
|
| ----------------------------- | --------- | ---------------------------------------------------------------------------------------- | ---------------------- |
|
||||||
| `spacy.GPT-4.v1` | OpenAI | `["gpt-4", "gpt-4-0314", "gpt-4-32k", "gpt-4-32k-0314"]` | `"gpt-4"` |
|
| `spacy.GPT-4.v1` | OpenAI | `["gpt-4", "gpt-4-0314", "gpt-4-32k", "gpt-4-32k-0314"]` | `"gpt-4"` |
|
||||||
|
@ -684,15 +693,6 @@ These models all take the same parameters:
|
||||||
To use these models, make sure that you've [set the relevant API](#api-keys)
|
To use these models, make sure that you've [set the relevant API](#api-keys)
|
||||||
keys as environment variables.
|
keys as environment variables.
|
||||||
|
|
||||||
> #### Example config:
|
|
||||||
>
|
|
||||||
> ```ini
|
|
||||||
> [components.llm.model]
|
|
||||||
> @llm_models = "spacy.GPT-4.v1"
|
|
||||||
> name = "gpt-4"
|
|
||||||
> config = {"temperature": 0.0}
|
|
||||||
> ```
|
|
||||||
|
|
||||||
#### API Keys {id="api-keys"}
|
#### API Keys {id="api-keys"}
|
||||||
|
|
||||||
Note that when using hosted services, you have to ensure that the proper API
|
Note that when using hosted services, you have to ensure that the proper API
|
||||||
|
@ -729,6 +729,14 @@ These models all take the same parameters:
|
||||||
| `config_init` | Further configuration passed on to the construction of the model with `transformers.pipeline()`. Defaults to `{}`. ~~Dict[str, Any]~~ |
|
| `config_init` | Further configuration passed on to the construction of the model with `transformers.pipeline()`. Defaults to `{}`. ~~Dict[str, Any]~~ |
|
||||||
| `config_run` | Further configuration used during model inference. Defaults to `{}`. ~~Dict[str, Any]~~ |
|
| `config_run` | Further configuration used during model inference. Defaults to `{}`. ~~Dict[str, Any]~~ |
|
||||||
|
|
||||||
|
> #### Example config
|
||||||
|
>
|
||||||
|
> ```ini
|
||||||
|
> [components.llm.model]
|
||||||
|
> @llm_models = "spacy.Llama2.v1"
|
||||||
|
> name = "llama2-7b-hf"
|
||||||
|
> ```
|
||||||
|
|
||||||
| Model | Provider | Supported names | HF directory |
|
| Model | Provider | Supported names | HF directory |
|
||||||
| -------------------- | --------------- | ------------------------------------------------------------------------------------------------------------ | -------------------------------------- |
|
| -------------------- | --------------- | ------------------------------------------------------------------------------------------------------------ | -------------------------------------- |
|
||||||
| `spacy.Dolly.v1` | Databricks | `["dolly-v2-3b", "dolly-v2-7b", "dolly-v2-12b"]` | https://huggingface.co/databricks |
|
| `spacy.Dolly.v1` | Databricks | `["dolly-v2-3b", "dolly-v2-7b", "dolly-v2-12b"]` | https://huggingface.co/databricks |
|
||||||
|
|
Loading…
Reference in New Issue
Block a user