explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-11-10 19:57:17 +03:00
Code Issues Packages Projects Releases Wiki Activity

DOC: Update tokenizer docs to include default value for batch_size in pipe (#3492)

Browse Source
This commit is contained in:
Bharat Raghunathan 2019-03-28 17:18:02 +05:30 committed by Ines Montani
parent 9e14b2b69f
commit 1db3e47509
2 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
spacy/tokenizer.pyx
View File

@ -131,6 +131,7 @@ cdef class Tokenizer:
texts: A sequence of unicode texts.
batch_size (int): Number of texts to accumulate in an internal buffer.
Defaults to 1000.
YIELDS (Doc): A sequence of Doc objects, in order.
DOCS: https://spacy.io/api/tokenizer#pipe

2
website/docs/api/tokenizer.md
View File

@ -64,7 +64,7 @@ Tokenize a stream of texts.
| Name | Type | Description |
| ------------ | ----- | -------------------------------------------------------- |
| `texts` | - | A sequence of unicode texts. |
| `batch_size` | int | The number of texts to accumulate in an internal buffer. |
| `batch_size` | int | The number of texts to accumulate in an internal buffer. Defaults to `1000`.|
| **YIELDS** | `Doc` | A sequence of Doc objects, in order. |
## Tokenizer.find_infix {#find_infix tag="method"}