Package bytewax

Bytewax is an open source Python framework for building highly scalable dataflows in a streaming or batch context.

Expand source code
"""Bytewax is an open source Python framework for building highly
scalable dataflows in a streaming or batch context.

"""  # noqa: D205

__pdoc__ = {
    # This is the PyO3 module that has to be named "bytewax". Hide it
    # since we re-import its members into the Python source files in
    # their final locations.
    "bytewax": False,
}

Sub-modules

bytewax.connectors

Connectors for IO with external systems …

bytewax.dataflow

Data model for dataflows and custom operators …

bytewax.inputs

Low-level input interfaces and input helpers …

bytewax.operators

Built-in operators …

bytewax.outputs

Low-level output interfaces …

bytewax.recovery

Failure recovery.

bytewax.run

Executing dataflows and the Bytewax runtime …

bytewax.serde

Serialization for recovery and transport.

bytewax.testing

Helper tools for testing dataflows.

bytewax.tracing

Logging and tracing configuration.