explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-08-02 11:20:19 +03:00
Code Issues Packages Projects Releases Wiki Activity

Add note

Browse Source
This commit is contained in:
richardpaulhudson 2022-10-14 20:29:22 +02:00
parent fa5724e927
commit 356a341096
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
spacy/util.py
View File

@ -1764,6 +1764,9 @@ def get_byte_arrays_for_search_chars(
If *case_sensitive==False*, the lower- or uppercase counterparts of any characters that
have case are added to the search byte arrays, and both the original character and its
other-cased counterpart map to the lower-case version in the finding byte array.
All encodings are little-endian regardless of architecture, as this is what is expected by the
murmurhash library used downstream.
"""
def encode(ch: str, width: int) -> bytes: