explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2024-12-25 17:36:30 +03:00
Code Issues Packages Projects Releases Wiki Activity

* Move string description further down for token, and highlght that it includes trailing whitespace

Browse Source
This commit is contained in:
Matthew Honnibal 2015-07-28 21:05:08 +02:00
parent d17a15ae66
commit 320836e346
1 changed files with 6 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
docs/source/reference/using/token.rst
View File

@ -13,11 +13,6 @@ string-typed.
**String Features** **String Features**
:code:`string`
The form of the word as it appears in the string, include trailing
whitespace. This is useful when you need to use linguistic features to
add inline mark-up to the string.
:code:`orth` / :code:`orth_` :code:`orth` / :code:`orth_`
The form of the word with no string normalization or processing, as it The form of the word with no string normalization or processing, as it
appears in the string, without trailing whitespace. appears in the string, without trailing whitespace.
@ -53,6 +48,12 @@ string-typed.
A length-N substring from the end of the word. Length may vary by A length-N substring from the end of the word. Length may vary by
language; currently for English n=3, i.e. suffix = word.orth\_[-3:] language; currently for English n=3, i.e. suffix = word.orth\_[-3:]
:code:`string`
The form of the word as it appears in the string, **including trailing
whitespace**. This is useful when you need to use linguistic features to
add inline mark-up to the string.
**Distributional Features** **Distributional Features**
:code:`prob` :code:`prob`