Python Stream Processing

Bytewax is an open source Python framework for building real-time applications with streaming data.

hero.svg
code
Open Source
lock_open
No Vendor Lock-In
speed
No JVM
cloud
Cloud Native
all_inclusive
Simple Scaling
How it works

Build stream based applications easily. In Python.

> pip install bytewax
> brew install waxctl
  • 1

    Install bytewax and waxctl

  • 2

    Define your inputs and outputs

  • 3

    Define your dataflow as code, it is as flexible as you need

  • 4

    Run it locally - no cluster needed

  • 5

    Deploy to production with waxctl

Main features

join_right

Stateful

Stateful operators allow you to do advanced processing like joins, windows, and aggregations

restore

State recovery

Built-in state recovery with multiple state backend options

schema

Input/output integrations

Built-in integrations for Kafka, Redpanda, Websockets, s3 and more...

open_in_full

Scalable

Dataflow architecture and rust engine make scaling over threaded workers and processes possible.

cloud

Cloud native

Cloud first, runs on any infrastructure with easy deployment in your cloud and on any Kubernetes cluster.

code

Operator Friendly

Waxctl CLI tool enables deployment automation, observability and more...

Stay updated

Latest posts from our blog

Loading posts...
Community buzz

Loved by the data folks

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...