mirror of
https://github.com/ets-labs/python-dependency-injector.git
synced 2024-11-27 12:04:00 +03:00
feed916f46
* Add support of async injections into wiring * Add support of async functions and async generators for resources * Update resource provider typing stub for stutdown * Add resource base class for async resources * Fix tests * Add tests for async injections in wiring @inject * Refactor provider tests * Add tests for async resources * Rework async resources callbacks to .add_done_callback() style (fixes pypy3 issue) * Add awaits into async resource class test * Refactor FastAPI tests * Implement async resources initialization in container * Move container async resource tests to a separate module for Python 3.6+ * Fix init async resources in container on Python 2 * Add first dirty async injections implementation * Fix isawaitable error * Turm asyncio import to conditional for safer Py2 usage * Refactor kwargs injections * Implement positional injections, add tests and make refactoring * Implement attribute injections and add tests * Add singleton implementation + tests for all singleton types * Implement injections in thread-local and thread-safe singleton providers * Update .provided + fix resource concurent initialization issue * Implement async mode for Dependency provider * Add async mode for the provider * Add overload for Factory typing * Add typing stubs for async resource * Refactor abstract* providers __call__() * Add async mode API + tests * Add typing stubs & tests for async mode API * Add tests for async mode auto configuration * Refactor Provider.__call__() to use async mode api * Refactor Dependency provider to use async mode api * Add tests for Dependency provider async mode * Add support of async mode for FactoryAggregate provider + tests * Refactor Singleton provider to use async mode api * Refactor ThreadSafeSingleton provider to use async mode api * Refactor ThreadLocalSingleton provider to use async mode api * Finish Singleton refactoring to use async mode api * Refactor Resource provider to use async mode api * Add Provider.async_() method + tests * Add typing stubs for async_() method + tests * Refactor Singleton typing stubs to return singleton from argument methods * Refactor provider typing stubs * Improve resource typing stub * Add tests for async context kwargs injections * Fix typo in resource provider tests * Cover shutdown of not initialized resource * Add test to cover resource initialization with an error * Fix Singleton and ThreadLocalSingleton to handle initialization errors * Add FastAPI + Redis example * Make cosmetic fixes to FastAPI + Redis example * Add missing development requirements * Update module docblock in fastapi + redis example * Add FastAPI + Redis example docs * Add references to FastAPI + Redis example * Refactor resource docs * Add asynchronous resources docs * Refactor wiring docs * Add async injections docs for wiring * Add async injections page and update docs index, readme, and key features pages * Add providers async injections example * Add docs on provider async mode enabling * Reword async provider docs * Add provider async mode docs * Add cross links to async docs * Mute flake8 errors in async provider examples * Update changelog * Make cosmetic fix to containers.pyx
363 lines
9.0 KiB
ReStructuredText
363 lines
9.0 KiB
ReStructuredText
.. _resource-provider:
|
|
|
|
Resource provider
|
|
=================
|
|
|
|
.. meta::
|
|
:keywords: Python,DI,Dependency injection,IoC,Inversion of Control,Resource,Injection,
|
|
Logging,Event Loop,Thread Pool
|
|
:description: Resource provider provides a component with initialization and shutdown. It works
|
|
well for configuring logging, event loop, thread or process pool, etc.
|
|
This page demonstrates how to use resource provider.
|
|
|
|
.. currentmodule:: dependency_injector.providers
|
|
|
|
:py:class:`Resource` provider provides a component with initialization and shutdown.
|
|
|
|
.. literalinclude:: ../../examples/providers/resource.py
|
|
:language: python
|
|
:lines: 3-
|
|
|
|
Resource providers help to initialize and configure logging, event loop, thread or process pool, etc.
|
|
|
|
Resource provider is similar to ``Singleton``. Resource initialization happens only once.
|
|
You can make injections and use provided instance the same way like you do with any other provider.
|
|
|
|
.. code-block:: python
|
|
:emphasize-lines: 12
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
config = providers.Configuration()
|
|
|
|
thread_pool = providers.Resource(
|
|
init_thread_pool,
|
|
max_workers=config.max_workers,
|
|
)
|
|
|
|
dispatcher = providers.Factory(
|
|
TaskDispatcher,
|
|
executor=thread_pool,
|
|
)
|
|
|
|
Container has an interface to initialize and shutdown all resources at once:
|
|
|
|
.. code-block:: python
|
|
|
|
container = Container()
|
|
container.init_resources()
|
|
container.shutdown_resources()
|
|
|
|
You can also initialize and shutdown resources one-by-one using ``init()`` and
|
|
``shutdown()`` methods of the provider:
|
|
|
|
.. code-block:: python
|
|
|
|
container = Container()
|
|
container.thread_pool.init()
|
|
container.thread_pool.shutdown()
|
|
|
|
When you call ``.shutdown()`` method on a resource provider, it will remove the reference to the initialized resource,
|
|
if any, and switch to uninitialized state. Some of resource initializer types support specifying custom
|
|
resource shutdown.
|
|
|
|
Resource provider supports 3 types of initializers:
|
|
|
|
- Function
|
|
- Generator
|
|
- Subclass of ``resources.Resource``
|
|
|
|
Function initializer
|
|
--------------------
|
|
|
|
Function is the most common way to specify resource initialization:
|
|
|
|
.. code-block:: python
|
|
|
|
def init_resource(argument1=..., argument2=...):
|
|
return SomeResource()
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
init_resource,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
Function initializer may not return a value. This often happens when
|
|
you configure global resource:
|
|
|
|
.. code-block:: python
|
|
|
|
import logging.config
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
configure_logging = providers.Resource(
|
|
logging.config.fileConfig,
|
|
fname='logging.ini',
|
|
)
|
|
|
|
Function initializer does not provide a way to specify custom resource shutdown.
|
|
|
|
Generator initializer
|
|
---------------------
|
|
|
|
Resource provider can use 2-step generators:
|
|
|
|
- First step of generator is an initialization phase
|
|
- The second is step is a shutdown phase
|
|
|
|
.. code-block:: python
|
|
|
|
def init_resource(argument1=..., argument2=...):
|
|
resource = SomeResource() # initialization
|
|
|
|
yield resource
|
|
|
|
# shutdown
|
|
...
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
init_resource,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
Generator initialization phase ends on the first ``yield`` statement. You can return a
|
|
resource object using ``yield resource`` like in the example above. Returning of the
|
|
object is not mandatory. You can leave ``yield`` statement empty:
|
|
|
|
.. code-block:: python
|
|
|
|
def init_resource(argument1=..., argument2=...):
|
|
# initialization
|
|
...
|
|
|
|
yield
|
|
|
|
# shutdown
|
|
...
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
init_resource,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
Subclass initializer
|
|
--------------------
|
|
|
|
You can create resource initializer by implementing a subclass of the ``resources.Resource``:
|
|
|
|
.. code-block:: python
|
|
|
|
from dependency_injector import resources
|
|
|
|
|
|
class MyResource(resources.Resource):
|
|
|
|
def init(self, argument1=..., argument2=...) -> SomeResource:
|
|
return SomeResource()
|
|
|
|
def shutdown(self, resource: SomeResource) -> None:
|
|
# shutdown
|
|
...
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
MyResource,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
Subclass must implement two methods: ``init()`` and ``shutdown()``.
|
|
|
|
Method ``init()`` receives arguments specified in resource provider.
|
|
It performs initialization and returns resource object. Returning of the object
|
|
is not mandatory.
|
|
|
|
Method ``shutdown()`` receives resource object returned from ``init()``. If ``init()``
|
|
didn't return an object ``shutdown()`` method will be called anyway with ``None`` as a
|
|
first argument.
|
|
|
|
.. code-block:: python
|
|
|
|
from dependency_injector import resources
|
|
|
|
|
|
class MyResource(resources.Resource):
|
|
|
|
def init(self, argument1=..., argument2=...) -> None:
|
|
# initialization
|
|
...
|
|
|
|
def shutdown(self, _: None) -> None:
|
|
# shutdown
|
|
...
|
|
|
|
|
|
.. _resource-provider-wiring-closing:
|
|
|
|
Resources, wiring and per-function execution scope
|
|
--------------------------------------------------
|
|
|
|
You can compound ``Resource`` provider with :ref:`wiring` to implement per-function
|
|
execution scope. For doing this you need to use additional ``Closing`` marker from
|
|
``wiring`` module.
|
|
|
|
.. literalinclude:: ../../examples/wiring/flask_resource_closing.py
|
|
:language: python
|
|
:lines: 3-
|
|
:emphasize-lines: 24
|
|
|
|
Framework initializes and injects the resource into the function. With the ``Closing`` marker
|
|
framework calls resource ``shutdown()`` method when function execution is over.
|
|
|
|
The example above produces next output:
|
|
|
|
.. code-block:: bash
|
|
|
|
Init service
|
|
Shutdown service
|
|
127.0.0.1 - - [29/Oct/2020 22:39:40] "GET / HTTP/1.1" 200 -
|
|
Init service
|
|
Shutdown service
|
|
127.0.0.1 - - [29/Oct/2020 22:39:41] "GET / HTTP/1.1" 200 -
|
|
Init service
|
|
Shutdown service
|
|
127.0.0.1 - - [29/Oct/2020 22:39:41] "GET / HTTP/1.1" 200 -
|
|
|
|
.. _resource-async-initializers:
|
|
|
|
Asynchronous initializers
|
|
-------------------------
|
|
|
|
When you write an asynchronous application, you might need to initialize resources asynchronously. Resource
|
|
provider supports asynchronous initialization and shutdown.
|
|
|
|
Asynchronous function initializer:
|
|
|
|
.. code-block:: python
|
|
|
|
async def init_async_resource(argument1=..., argument2=...):
|
|
return await connect()
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
init_resource,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
Asynchronous generator initializer:
|
|
|
|
.. code-block:: python
|
|
|
|
async def init_async_resource(argument1=..., argument2=...):
|
|
connection = await connect()
|
|
yield connection
|
|
await connection.close()
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
init_async_resource,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
Asynchronous subclass initializer:
|
|
|
|
.. code-block:: python
|
|
|
|
from dependency_injector import resources
|
|
|
|
|
|
class AsyncConnection(resources.AsyncResource):
|
|
|
|
async def init(self, argument1=..., argument2=...):
|
|
yield await connect()
|
|
|
|
async def shutdown(self, connection):
|
|
await connection.close()
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
resource = providers.Resource(
|
|
AsyncConnection,
|
|
argument1=...,
|
|
argument2=...,
|
|
)
|
|
|
|
When you use resource provider with asynchronous initializer you need to call its ``__call__()``,
|
|
``init()``, and ``shutdown()`` methods asynchronously:
|
|
|
|
.. code-block:: python
|
|
|
|
import asyncio
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
connection = providers.Resource(init_async_connection)
|
|
|
|
|
|
async def main():
|
|
container = Container()
|
|
connection = await container.connection()
|
|
connection = await container.connection.init()
|
|
connection = await container.connection.shutdown()
|
|
|
|
|
|
if __name__ == '__main__':
|
|
asyncio.run(main())
|
|
|
|
Container ``init_resources()`` and ``shutdown_resources()`` methods should be used asynchronously if there is
|
|
at least one asynchronous resource provider:
|
|
|
|
.. code-block:: python
|
|
|
|
import asyncio
|
|
|
|
|
|
class Container(containers.DeclarativeContainer):
|
|
|
|
connection1 = providers.Resource(init_async_connection)
|
|
|
|
connection2 = providers.Resource(init_sync_connection)
|
|
|
|
|
|
async def main():
|
|
container = Container()
|
|
await container.init_resources()
|
|
await container.shutdown_resources()
|
|
|
|
|
|
if __name__ == '__main__':
|
|
asyncio.run(main())
|
|
|
|
See also:
|
|
|
|
- Provider :ref:`async-injections`
|
|
- Wiring :ref:`async-injections-wiring`
|
|
- :ref:`fastapi-redis-example`
|
|
|
|
|
|
.. disqus::
|