lazy_loader
makes it easy to load subpackages and functions on demand.
- Allow subpackages to be made visible to users without incurring import costs.
- Allow external libraries to be imported only when used, improving import times.
For a more detailed discussion, see the SPEC.
pip install -U lazy_loader
Consider the __init__.py
from scikit-image:
subpackages = [ ..., 'filters', ... ] import lazy_loader as lazy __getattr__, __dir__, _ = lazy.attach(__name__, subpackages)
You can now do:
import skimage as ski ski.filters.gaussian(...)
The filters
subpackages will only be loaded once accessed.
Consider skimage/filters/__init__.py
:
from ..util import lazy __getattr__, __dir__, __all__ = lazy.attach( __name__, submodules=['rank'], submod_attrs={ '_gaussian': ['gaussian', 'difference_of_gaussians'], 'edges': ['sobel', 'scharr', 'prewitt', 'roberts', 'laplace', 'farid'] } )
The above is equivalent to:
from . import rank from ._gaussian import gaussian, difference_of_gaussians from .edges import (sobel, scharr, prewitt, roberts, laplace, farid)
Except that all subpackages (such as rank
) and functions (such as sobel
) are loaded upon access.
Static type checkers and IDEs cannot infer type information from lazily loaded imports. As a workaround you can load type stubs (.pyi
files) with lazy.attach_stub
:
import lazy_loader as lazy __getattr__, __dir__, _ = lazy.attach_stub(__name__, "subpackages.pyi")
Note that, since imports are now defined in .pyi
files, those are not only necessary for type checking but also at runtime.
The SPEC describes this workaround in more detail.
With lazy loading, missing imports no longer fail upon loading the library. During development and testing, you can set the EAGER_IMPORT
environment variable to disable lazy loading.
The lazy.attach
function discussed above is used to set up package internal imports.
Use lazy.load
to lazily import external libraries:
sp = lazy.load('scipy') # `sp` will only be loaded when accessed sp.linalg.norm(...)
Note that lazily importing subpackages, i.e. load('scipy.linalg')
will cause the package containing the subpackage to be imported immediately; thus, this usage is discouraged.
You can ask lazy.load
to raise import errors as soon as it is called:
linalg = lazy.load('scipy.linalg', error_on_import=True)