explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-06-05 13:43:24 +03:00
Code Issues Packages Projects Releases Wiki Activity

Adjust example

Browse Source 
Not actually supported in this alignment interpretation
This commit is contained in:
Ines Montani 2019-07-17 15:13:50 +02:00
parent 1ea472468a
commit 9f02e3c027
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
website/docs/usage/linguistic-features.md
View File

@ -967,9 +967,8 @@ attributes. For details, see the respective usage pages.
spaCy's tokenization is non-destructive and uses language-specific rules spaCy's tokenization is non-destructive and uses language-specific rules
optimized for compatibility with treebank annotations. Other tools and resources optimized for compatibility with treebank annotations. Other tools and resources
can sometimes tokenize things differently – for example, `"I'm"` → `["I", "am"]` can sometimes tokenize things differently – for example, `"I'm"` →
instead of `["I", "'m"]`, or `"Obama's"` → `["Obama", "'", "s"]` instead of `["I", "'", "m"]` instead of `["I", "'m"]`.
`["Obama", "'s"]`.
In cases like that, you often want to align the tokenization so that you can In cases like that, you often want to align the tokenization so that you can
merge annotations from different sources together, or take vectors predicted by merge annotations from different sources together, or take vectors predicted by