mirror of
				https://github.com/ets-labs/python-dependency-injector.git
				synced 2025-11-04 01:47:36 +03:00 
			
		
		
		
	* Add support of async injections into wiring * Add support of async functions and async generators for resources * Update resource provider typing stub for stutdown * Add resource base class for async resources * Fix tests * Add tests for async injections in wiring @inject * Refactor provider tests * Add tests for async resources * Rework async resources callbacks to .add_done_callback() style (fixes pypy3 issue) * Add awaits into async resource class test * Refactor FastAPI tests * Implement async resources initialization in container * Move container async resource tests to a separate module for Python 3.6+ * Fix init async resources in container on Python 2 * Add first dirty async injections implementation * Fix isawaitable error * Turm asyncio import to conditional for safer Py2 usage * Refactor kwargs injections * Implement positional injections, add tests and make refactoring * Implement attribute injections and add tests * Add singleton implementation + tests for all singleton types * Implement injections in thread-local and thread-safe singleton providers * Update .provided + fix resource concurent initialization issue * Implement async mode for Dependency provider * Add async mode for the provider * Add overload for Factory typing * Add typing stubs for async resource * Refactor abstract* providers __call__() * Add async mode API + tests * Add typing stubs & tests for async mode API * Add tests for async mode auto configuration * Refactor Provider.__call__() to use async mode api * Refactor Dependency provider to use async mode api * Add tests for Dependency provider async mode * Add support of async mode for FactoryAggregate provider + tests * Refactor Singleton provider to use async mode api * Refactor ThreadSafeSingleton provider to use async mode api * Refactor ThreadLocalSingleton provider to use async mode api * Finish Singleton refactoring to use async mode api * Refactor Resource provider to use async mode api * Add Provider.async_() method + tests * Add typing stubs for async_() method + tests * Refactor Singleton typing stubs to return singleton from argument methods * Refactor provider typing stubs * Improve resource typing stub * Add tests for async context kwargs injections * Fix typo in resource provider tests * Cover shutdown of not initialized resource * Add test to cover resource initialization with an error * Fix Singleton and ThreadLocalSingleton to handle initialization errors * Add FastAPI + Redis example * Make cosmetic fixes to FastAPI + Redis example * Add missing development requirements * Update module docblock in fastapi + redis example * Add FastAPI + Redis example docs * Add references to FastAPI + Redis example * Refactor resource docs * Add asynchronous resources docs * Refactor wiring docs * Add async injections docs for wiring * Add async injections page and update docs index, readme, and key features pages * Add providers async injections example * Add docs on provider async mode enabling * Reword async provider docs * Add provider async mode docs * Add cross links to async docs * Mute flake8 errors in async provider examples * Update changelog * Make cosmetic fix to containers.pyx
		
			
				
	
	
		
			363 lines
		
	
	
		
			9.0 KiB
		
	
	
	
		
			ReStructuredText
		
	
	
	
	
	
			
		
		
	
	
			363 lines
		
	
	
		
			9.0 KiB
		
	
	
	
		
			ReStructuredText
		
	
	
	
	
	
.. _resource-provider:
 | 
						|
 | 
						|
Resource provider
 | 
						|
=================
 | 
						|
 | 
						|
.. meta::
 | 
						|
   :keywords: Python,DI,Dependency injection,IoC,Inversion of Control,Resource,Injection,
 | 
						|
              Logging,Event Loop,Thread Pool
 | 
						|
   :description: Resource provider provides a component with initialization and shutdown. It works
 | 
						|
                 well for configuring logging, event loop, thread or process pool, etc.
 | 
						|
                 This page demonstrates how to use resource provider.
 | 
						|
 | 
						|
.. currentmodule:: dependency_injector.providers
 | 
						|
 | 
						|
:py:class:`Resource` provider provides a component with initialization and shutdown.
 | 
						|
 | 
						|
.. literalinclude:: ../../examples/providers/resource.py
 | 
						|
   :language: python
 | 
						|
   :lines: 3-
 | 
						|
 | 
						|
Resource providers help to initialize and configure logging, event loop, thread or process pool, etc.
 | 
						|
 | 
						|
Resource provider is similar to ``Singleton``. Resource initialization happens only once.
 | 
						|
You can make injections and use provided instance the same way like you do with any other provider.
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
   :emphasize-lines: 12
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       config = providers.Configuration()
 | 
						|
 | 
						|
       thread_pool = providers.Resource(
 | 
						|
           init_thread_pool,
 | 
						|
           max_workers=config.max_workers,
 | 
						|
       )
 | 
						|
 | 
						|
       dispatcher = providers.Factory(
 | 
						|
           TaskDispatcher,
 | 
						|
           executor=thread_pool,
 | 
						|
       )
 | 
						|
 | 
						|
Container has an interface to initialize and shutdown all resources at once:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   container = Container()
 | 
						|
   container.init_resources()
 | 
						|
   container.shutdown_resources()
 | 
						|
 | 
						|
You can also initialize and shutdown resources one-by-one using ``init()`` and
 | 
						|
``shutdown()`` methods of the provider:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   container = Container()
 | 
						|
   container.thread_pool.init()
 | 
						|
   container.thread_pool.shutdown()
 | 
						|
 | 
						|
When you call ``.shutdown()`` method on a resource provider, it will remove the reference to the initialized resource,
 | 
						|
if any, and switch to uninitialized state. Some of resource initializer types support specifying custom
 | 
						|
resource shutdown.
 | 
						|
 | 
						|
Resource provider supports 3 types of initializers:
 | 
						|
 | 
						|
- Function
 | 
						|
- Generator
 | 
						|
- Subclass of ``resources.Resource``
 | 
						|
 | 
						|
Function initializer
 | 
						|
--------------------
 | 
						|
 | 
						|
Function is the most common way to specify resource initialization:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   def init_resource(argument1=..., argument2=...):
 | 
						|
       return SomeResource()
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           init_resource,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
Function initializer may not return a value. This often happens when
 | 
						|
you configure global resource:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   import logging.config
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       configure_logging = providers.Resource(
 | 
						|
           logging.config.fileConfig,
 | 
						|
           fname='logging.ini',
 | 
						|
       )
 | 
						|
 | 
						|
Function initializer does not provide a way to specify custom resource shutdown.
 | 
						|
 | 
						|
Generator initializer
 | 
						|
---------------------
 | 
						|
 | 
						|
Resource provider can use 2-step generators:
 | 
						|
 | 
						|
- First step of generator is an initialization phase
 | 
						|
- The second is step is a shutdown phase
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   def init_resource(argument1=..., argument2=...):
 | 
						|
       resource = SomeResource()  # initialization
 | 
						|
 | 
						|
       yield resource
 | 
						|
 | 
						|
       # shutdown
 | 
						|
       ...
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           init_resource,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
Generator initialization phase ends on the first ``yield`` statement. You can return a
 | 
						|
resource object using ``yield resource`` like in the example above. Returning of the
 | 
						|
object is not mandatory. You can leave ``yield`` statement empty:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   def init_resource(argument1=..., argument2=...):
 | 
						|
       # initialization
 | 
						|
       ...
 | 
						|
 | 
						|
       yield
 | 
						|
 | 
						|
       # shutdown
 | 
						|
       ...
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           init_resource,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
Subclass initializer
 | 
						|
--------------------
 | 
						|
 | 
						|
You can create resource initializer by implementing a subclass of the ``resources.Resource``:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   from dependency_injector import resources
 | 
						|
 | 
						|
 | 
						|
   class MyResource(resources.Resource):
 | 
						|
 | 
						|
       def init(self, argument1=..., argument2=...) -> SomeResource:
 | 
						|
           return SomeResource()
 | 
						|
 | 
						|
       def shutdown(self, resource: SomeResource) -> None:
 | 
						|
           # shutdown
 | 
						|
           ...
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           MyResource,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
Subclass must implement two methods: ``init()`` and ``shutdown()``.
 | 
						|
 | 
						|
Method ``init()`` receives arguments specified in resource provider.
 | 
						|
It performs initialization and returns resource object. Returning of the object
 | 
						|
is not mandatory.
 | 
						|
 | 
						|
Method ``shutdown()`` receives resource object returned from ``init()``. If ``init()``
 | 
						|
didn't return an object ``shutdown()`` method will be called anyway with ``None`` as a
 | 
						|
first argument.
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   from dependency_injector import resources
 | 
						|
 | 
						|
 | 
						|
   class MyResource(resources.Resource):
 | 
						|
 | 
						|
       def init(self, argument1=..., argument2=...) -> None:
 | 
						|
           # initialization
 | 
						|
           ...
 | 
						|
 | 
						|
       def shutdown(self, _: None) -> None:
 | 
						|
           # shutdown
 | 
						|
           ...
 | 
						|
 | 
						|
 | 
						|
.. _resource-provider-wiring-closing:
 | 
						|
 | 
						|
Resources, wiring and per-function execution scope
 | 
						|
--------------------------------------------------
 | 
						|
 | 
						|
You can compound ``Resource`` provider with :ref:`wiring` to implement per-function
 | 
						|
execution scope. For doing this you need to use additional ``Closing`` marker from
 | 
						|
``wiring`` module.
 | 
						|
 | 
						|
.. literalinclude:: ../../examples/wiring/flask_resource_closing.py
 | 
						|
   :language: python
 | 
						|
   :lines: 3-
 | 
						|
   :emphasize-lines: 24
 | 
						|
 | 
						|
Framework initializes and injects the resource into the function. With the ``Closing`` marker
 | 
						|
framework calls resource ``shutdown()`` method when function execution is over.
 | 
						|
 | 
						|
The example above produces next output:
 | 
						|
 | 
						|
.. code-block:: bash
 | 
						|
 | 
						|
   Init service
 | 
						|
   Shutdown service
 | 
						|
   127.0.0.1 - - [29/Oct/2020 22:39:40] "GET / HTTP/1.1" 200 -
 | 
						|
   Init service
 | 
						|
   Shutdown service
 | 
						|
   127.0.0.1 - - [29/Oct/2020 22:39:41] "GET / HTTP/1.1" 200 -
 | 
						|
   Init service
 | 
						|
   Shutdown service
 | 
						|
   127.0.0.1 - - [29/Oct/2020 22:39:41] "GET / HTTP/1.1" 200 -
 | 
						|
 | 
						|
.. _resource-async-initializers:
 | 
						|
 | 
						|
Asynchronous initializers
 | 
						|
-------------------------
 | 
						|
 | 
						|
When you write an asynchronous application, you might need to initialize resources asynchronously. Resource
 | 
						|
provider supports asynchronous initialization and shutdown.
 | 
						|
 | 
						|
Asynchronous function initializer:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   async def init_async_resource(argument1=..., argument2=...):
 | 
						|
       return await connect()
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           init_resource,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
Asynchronous generator initializer:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   async def init_async_resource(argument1=..., argument2=...):
 | 
						|
       connection = await connect()
 | 
						|
       yield connection
 | 
						|
       await connection.close()
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           init_async_resource,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
Asynchronous subclass initializer:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   from dependency_injector import resources
 | 
						|
 | 
						|
 | 
						|
   class AsyncConnection(resources.AsyncResource):
 | 
						|
 | 
						|
       async def init(self, argument1=..., argument2=...):
 | 
						|
           yield await connect()
 | 
						|
 | 
						|
       async def shutdown(self, connection):
 | 
						|
           await connection.close()
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       resource = providers.Resource(
 | 
						|
           AsyncConnection,
 | 
						|
           argument1=...,
 | 
						|
           argument2=...,
 | 
						|
       )
 | 
						|
 | 
						|
When you use resource provider with asynchronous initializer you need to call its ``__call__()``,
 | 
						|
``init()``, and ``shutdown()`` methods asynchronously:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   import asyncio
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       connection = providers.Resource(init_async_connection)
 | 
						|
 | 
						|
 | 
						|
   async def main():
 | 
						|
       container = Container()
 | 
						|
       connection = await container.connection()
 | 
						|
       connection = await container.connection.init()
 | 
						|
       connection = await container.connection.shutdown()
 | 
						|
 | 
						|
 | 
						|
   if __name__ == '__main__':
 | 
						|
       asyncio.run(main())
 | 
						|
 | 
						|
Container ``init_resources()`` and ``shutdown_resources()`` methods should be used asynchronously if there is
 | 
						|
at least one asynchronous resource provider:
 | 
						|
 | 
						|
.. code-block:: python
 | 
						|
 | 
						|
   import asyncio
 | 
						|
 | 
						|
 | 
						|
   class Container(containers.DeclarativeContainer):
 | 
						|
 | 
						|
       connection1 = providers.Resource(init_async_connection)
 | 
						|
 | 
						|
       connection2 = providers.Resource(init_sync_connection)
 | 
						|
 | 
						|
 | 
						|
   async def main():
 | 
						|
       container = Container()
 | 
						|
       await container.init_resources()
 | 
						|
       await container.shutdown_resources()
 | 
						|
 | 
						|
 | 
						|
   if __name__ == '__main__':
 | 
						|
       asyncio.run(main())
 | 
						|
 | 
						|
See also:
 | 
						|
 | 
						|
- Provider :ref:`async-injections`
 | 
						|
- Wiring :ref:`async-injections-wiring`
 | 
						|
- :ref:`fastapi-redis-example`
 | 
						|
 | 
						|
 | 
						|
.. disqus::
 |