From abf4c89c9579ae8f77b440bcd095bff32e0048a0 Mon Sep 17 00:00:00 2001 From: svlandeg Date: Fri, 26 Jan 2024 10:36:28 +0100 Subject: [PATCH] add that the vocab may be empty --- website/docs/api/vocab.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/api/vocab.mdx b/website/docs/api/vocab.mdx index 3b0e83d9f..57618397d 100644 --- a/website/docs/api/vocab.mdx +++ b/website/docs/api/vocab.mdx @@ -13,7 +13,7 @@ between `Doc` objects. Note that a `Vocab` instance is not static. It increases in size as texts with -new tokens are processed. +new tokens are processed. Some models may have an empty vocab at initialization.