--- title: Lookups teaser: A container for large lookup tables and dictionaries tag: class source: spacy/lookups.py new: 2.2 --- This class allows convenient access to large lookup tables and dictionaries, e.g. lemmatization data or tokenizer exception lists using Bloom filters. Lookups are available via the [`Vocab`](/api/vocab) as `vocab.lookups`, so they can be accessed before the pipeline components are applied (e.g. in the tokenizer and lemmatizer), as well as within the pipeline components via `doc.vocab.lookups`. ## Lookups.\_\_init\_\_ {#init tag="method"} Create a `Lookups` object. > #### Example > > ```python > from spacy.lookups import Lookups > lookups = Lookups() > ``` ## Lookups.\_\_len\_\_ {#len tag="method"} Get the current number of tables in the lookups. > #### Example > > ```python > lookups = Lookups() > assert len(lookups) == 0 > ``` | Name | Description | | ----------- | -------------------------------------------- | | **RETURNS** | The number of tables in the lookups. ~~int~~ | ## Lookups.\_\contains\_\_ {#contains tag="method"} Check if the lookups contain a table of a given name. Delegates to [`Lookups.has_table`](/api/lookups#has_table). > #### Example > > ```python > lookups = Lookups() > lookups.add_table("some_table") > assert "some_table" in lookups > ``` | Name | Description | | ----------- | -------------------------------------------------------- | | `name` | Name of the table. ~~str~~ | | **RETURNS** | Whether a table of that name is in the lookups. ~~bool~~ | ## Lookups.tables {#tables tag="property"} Get the names of all tables in the lookups. > #### Example > > ```python > lookups = Lookups() > lookups.add_table("some_table") > assert lookups.tables == ["some_table"] > ``` | Name | Description | | ----------- | ------------------------------------------------- | | **RETURNS** | Names of the tables in the lookups. ~~List[str]~~ | ## Lookups.add_table {#add_table tag="method"} Add a new table with optional data to the lookups. Raises an error if the table exists. > #### Example > > ```python > lookups = Lookups() > lookups.add_table("some_table", {"foo": "bar"}) > ``` | Name | Description | | ----------- | ------------------------------------------- | | `name` | Unique name of the table. ~~str~~ | | `data` | Optional data to add to the table. ~~dict~~ | | **RETURNS** | The newly added table. ~~Table~~ | ## Lookups.get_table {#get_table tag="method"} Get a table from the lookups. Raises an error if the table doesn't exist. > #### Example > > ```python > lookups = Lookups() > lookups.add_table("some_table", {"foo": "bar"}) > table = lookups.get_table("some_table") > assert table["foo"] == "bar" > ``` | Name | Description | | ----------- | -------------------------- | | `name` | Name of the table. ~~str~~ | | **RETURNS** | The table. ~~Table~~ | ## Lookups.remove_table {#remove_table tag="method"} Remove a table from the lookups. Raises an error if the table doesn't exist. > #### Example > > ```python > lookups = Lookups() > lookups.add_table("some_table") > removed_table = lookups.remove_table("some_table") > assert "some_table" not in lookups > ``` | Name | Description | | ----------- | ------------------------------------ | | `name` | Name of the table to remove. ~~str~~ | | **RETURNS** | The removed table. ~~Table~~ | ## Lookups.has_table {#has_table tag="method"} Check if the lookups contain a table of a given name. Equivalent to [`Lookups.__contains__`](/api/lookups#contains). > #### Example > > ```python > lookups = Lookups() > lookups.add_table("some_table") > assert lookups.has_table("some_table") > ``` | Name | Description | | ----------- | -------------------------------------------------------- | | `name` | Name of the table. ~~str~~ | | **RETURNS** | Whether a table of that name is in the lookups. ~~bool~~ | ## Lookups.to_bytes {#to_bytes tag="method"} Serialize the lookups to a bytestring. > #### Example > > ```python > lookup_bytes = lookups.to_bytes() > ``` | Name | Description | | ----------- | --------------------------------- | | **RETURNS** | The serialized lookups. ~~bytes~~ | ## Lookups.from_bytes {#from_bytes tag="method"} Load the lookups from a bytestring. > #### Example > > ```python > lookup_bytes = lookups.to_bytes() > lookups = Lookups() > lookups.from_bytes(lookup_bytes) > ``` | Name | Description | | ------------ | -------------------------------- | | `bytes_data` | The data to load from. ~~bytes~~ | | **RETURNS** | The loaded lookups. ~~Lookups~~ | ## Lookups.to_disk {#to_disk tag="method"} Save the lookups to a directory as `lookups.bin`. Expects a path to a directory, which will be created if it doesn't exist. > #### Example > > ```python > lookups.to_disk("/path/to/lookups") > ``` | Name | Description | | ------ | ------------------------------------------------------------------------------------------------------------------------------------------ | | `path` | A path to a directory, which will be created if it doesn't exist. Paths may be either strings or `Path`-like objects. ~~Union[str, Path]~~ | ## Lookups.from_disk {#from_disk tag="method"} Load lookups from a directory containing a `lookups.bin`. Will skip loading if the file doesn't exist. > #### Example > > ```python > from spacy.lookups import Lookups > lookups = Lookups() > lookups.from_disk("/path/to/lookups") > ``` | Name | Description | | ----------- | ----------------------------------------------------------------------------------------------- | | `path` | A path to a directory. Paths may be either strings or `Path`-like objects. ~~Union[str, Path]~~ | | **RETURNS** | The loaded lookups. ~~Lookups~~ | ## Table {#table tag="class, ordererddict"} A table in the lookups. Subclass of `OrderedDict` that implements a slightly more consistent and unified API and includes a Bloom filter to speed up missed lookups. Supports **all other methods and attributes** of `OrderedDict` / `dict`, and the customized methods listed here. Methods that get or set keys accept both integers and strings (which will be hashed before being added to the table). ### Table.\_\_init\_\_ {#table.init tag="method"} Initialize a new table. > #### Example > > ```python > from spacy.lookups import Table > data = {"foo": "bar", "baz": 100} > table = Table(name="some_table", data=data) > assert "foo" in table > assert table["foo"] == "bar" > ``` | Name | Description | | ------ | ------------------------------------------ | | `name` | Optional table name for reference. ~~str~~ | ### Table.from_dict {#table.from_dict tag="classmethod"} Initialize a new table from a dict. > #### Example > > ```python > from spacy.lookups import Table > data = {"foo": "bar", "baz": 100} > table = Table.from_dict(data, name="some_table") > ``` | Name | Description | | ----------- | ------------------------------------------ | | `data` | The dictionary. ~~dict~~ | | `name` | Optional table name for reference. ~~str~~ | | **RETURNS** | The newly constructed object. ~~Table~~ | ### Table.set {#table.set tag="method"} Set a new key / value pair. String keys will be hashed. Same as `table[key] = value`. > #### Example > > ```python > from spacy.lookups import Table > table = Table() > table.set("foo", "bar") > assert table["foo"] == "bar" > ``` | Name | Description | | ------- | ---------------------------- | | `key` | The key. ~~Union[str, int]~~ | | `value` | The value. | ### Table.to_bytes {#table.to_bytes tag="method"} Serialize the table to a bytestring. > #### Example > > ```python > table_bytes = table.to_bytes() > ``` | Name | Description | | ----------- | ------------------------------- | | **RETURNS** | The serialized table. ~~bytes~~ | ### Table.from_bytes {#table.from_bytes tag="method"} Load a table from a bytestring. > #### Example > > ```python > table_bytes = table.to_bytes() > table = Table() > table.from_bytes(table_bytes) > ``` | Name | Description | | ------------ | --------------------------- | | `bytes_data` | The data to load. ~~bytes~~ | | **RETURNS** | The loaded table. ~~Table~~ | ### Attributes {#table-attributes} | Name | Description | | -------------- | ------------------------------------------------------------- | | `name` | Table name. ~~str~~ | | `default_size` | Default size of bloom filters if no data is provided. ~~int~~ | | `bloom` | The bloom filters. ~~preshed.BloomFilter~~ |