Package bytewax

Bytewax is an open source Python framework for building highly scalable dataflows in a streaming or batch context.

See our readme for more documentation.

Expand source code
"""Bytewax is an open source Python framework for building highly
scalable dataflows in a streaming or batch context.

[See our readme for more
documentation.](https://github.com/bytewax/bytewax)

"""
__all__ = []

__pdoc__ = {
    # This is the PyO3 module that has to be named "bytewax". Hide it
    # since we re-import its members into the Python source files in
    # their final locations.
    "bytewax": False,
}

Sub-modules

bytewax.connectors

bytewax.dataflow

How to define dataflows …

bytewax.execution

How to execute your dataflows …

bytewax.inputs

Dataflow input sources …

bytewax.outputs

Dataflow output sinks …

bytewax.parse

Helpers to read execution arguments from the environment or command line.

bytewax.recovery

Recovering from failures …

bytewax.testing

Helper tools for testing dataflows.

bytewax.tracing

Tracing and logging in bytewax are handled in the rust side, to offer a really detailed view of what is happening in your dataflow …

bytewax.window

Time-based windows …