Package bytewax

Bytewax is an open source Python framework for building highly scalable dataflows in a streaming or batch context.

See our readme for more documentation.

Expand source code
"""Bytewax is an open source Python framework for building highly
scalable dataflows in a streaming or batch context.

[See our readme for more
documentation.](https://github.com/bytewax/bytewax)

"""  # noqa: D205
__all__ = []

__pdoc__ = {
    # This is the PyO3 module that has to be named "bytewax". Hide it
    # since we re-import its members into the Python source files in
    # their final locations.
    "bytewax": False,
}

Sub-modules

bytewax.connectors

Connectors for IO with external systems …

bytewax.dataflow

How to define dataflows …

bytewax.inputs

Low-level input interfaces and input helpers …

bytewax.outputs

Low-level output interfaces …

bytewax.recovery

Failure recovery …

bytewax.run

Executing dataflows …

bytewax.serde

Serialization for recovery and transport.

bytewax.testing

Helper tools for testing dataflows.

bytewax.tracing

Logging and tracing configuration …

bytewax.window

Time-based windows …