diff --git a/website/docs/api/large-language-models.mdx b/website/docs/api/large-language-models.mdx index f9efd6e2e..4bddbd44c 100644 --- a/website/docs/api/large-language-models.mdx +++ b/website/docs/api/large-language-models.mdx @@ -659,6 +659,15 @@ These models all take the same parameters: | `max_request_time` | Max. time (in seconds) to wait for request to terminate before raising an exception. Defaults to `30.0`. ~~float~~ | | `interval` | Time interval (in seconds) for API retries in seconds. Defaults to `1.0`. ~~float~~ | +> #### Example config: +> +> ```ini +> [components.llm.model] +> @llm_models = "spacy.GPT-4.v1" +> name = "gpt-4" +> config = {"temperature": 0.0} +> ``` + | Model | Provider | Supported names | Default name | | ----------------------------- | --------- | ---------------------------------------------------------------------------------------- | ---------------------- | | `spacy.GPT-4.v1` | OpenAI | `["gpt-4", "gpt-4-0314", "gpt-4-32k", "gpt-4-32k-0314"]` | `"gpt-4"` | @@ -684,15 +693,6 @@ These models all take the same parameters: To use these models, make sure that you've [set the relevant API](#api-keys) keys as environment variables. -> #### Example config: -> -> ```ini -> [components.llm.model] -> @llm_models = "spacy.GPT-4.v1" -> name = "gpt-4" -> config = {"temperature": 0.0} -> ``` - #### API Keys {id="api-keys"} Note that when using hosted services, you have to ensure that the proper API @@ -729,6 +729,14 @@ These models all take the same parameters: | `config_init` | Further configuration passed on to the construction of the model with `transformers.pipeline()`. Defaults to `{}`. ~~Dict[str, Any]~~ | | `config_run` | Further configuration used during model inference. Defaults to `{}`. ~~Dict[str, Any]~~ | +> #### Example config +> +> ```ini +> [components.llm.model] +> @llm_models = "spacy.Llama2.v1" +> name = "llama2-7b-hf" +> ``` + | Model | Provider | Supported names | HF directory | | -------------------- | --------------- | ------------------------------------------------------------------------------------------------------------ | -------------------------------------- | | `spacy.Dolly.v1` | Databricks | `["dolly-v2-3b", "dolly-v2-7b", "dolly-v2-12b"]` | https://huggingface.co/databricks |