explosion/spaCy
1
1
Fork 0
mirror of https://github.com/explosion/spaCy.git synced 2025-08-02 11:20:19 +03:00
Code Issues Packages Projects Releases Wiki Activity

Add note

Browse Source
This commit is contained in:
richardpaulhudson 2022-10-14 20:29:22 +02:00
parent fa5724e927
commit 356a341096
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
spacy/util.py
View File

@ -1764,6 +1764,9 @@ def get_byte_arrays_for_search_chars(
If *case_sensitive==False*, the lower- or uppercase counterparts of any characters that If *case_sensitive==False*, the lower- or uppercase counterparts of any characters that
have case are added to the search byte arrays, and both the original character and its have case are added to the search byte arrays, and both the original character and its
other-cased counterpart map to the lower-case version in the finding byte array. other-cased counterpart map to the lower-case version in the finding byte array.
All encodings are little-endian regardless of architecture, as this is what is expected by the
murmurhash library used downstream.
""" """
def encode(ch: str, width: int) -> bytes: def encode(ch: str, width: int) -> bytes: