explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-10-28 06:31:12 +03:00
Code Issues Packages Projects Releases Wiki Activity

Auto-format [ci skip]

Browse Source
This commit is contained in:
Ines Montani 2019-06-16 14:33:20 +02:00
parent 9041a72d7f
commit 81c12640ab
1 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
website/docs/api/tokenizer.md
View File

@ -64,11 +64,11 @@ Tokenize a stream of texts.
> pass
> ```
| Name | Type | Description |
| ------------ | ----- | -------------------------------------------------------- |
| `texts` | - | A sequence of unicode texts. |
| `batch_size` | int | The number of texts to accumulate in an internal buffer. Defaults to `1000`.|
| **YIELDS** | `Doc` | A sequence of Doc objects, in order. |
| Name | Type | Description |
| ------------ | ----- | ---------------------------------------------------------------------------- |
| `texts` | - | A sequence of unicode texts. |
| `batch_size` | int | The number of texts to accumulate in an internal buffer. Defaults to `1000`. |
| **YIELDS** | `Doc` | A sequence of Doc objects, in order. |
## Tokenizer.find_infix {#find_infix tag="method"}