Real time embeddings for RAG

November 14 – 15, 2023
Scottish Rite Center, Oakland

Scale By the Bay 2023 celebrates the 10th anniversary and invites tech enthusiasts to its in-person event in Oakland, beside Lake Merritt, under the theme "Code and Data in the Age of AI." The agenda features tracks on Thoughtful Software Engineering, Cloud Architectures, Data and AI, and introduces the new Open-Source Science track. The conference schedule is packed with FSDL workshop, demonstrations of open-source software, a fireside chat with Mojo, and presentations by experts from top technology companies. It's an opportunity to gain practical insights into creating effective systems and to network with professionals and thought leaders in the field.

Meet our team at SBTB'23

Zander Matheson
Zander is a seasoned data engineer who has founded and currently helms Bytewax. Zander has worked in the data space since 2014 at Heroku, GitHub, and an NLP startup. Before that, he attended business school at the UT Austin and HEC Paris in Europe.
Oli Makhasoeva
Oli Makhasoeva
Oli is a passionate advocate of open-source software with a background in engineering, consulting, and community building. When not actively contributing to Bytewax, where she leads developer relations, Oli enjoys networking online and in person at meetups, conferences, and forums.

Grow with Bytewax!

With a variety of significant talks in the 2023 program, find a topic that resonates with you and engage with an in-depth video explanation.

Nov 14, 2023, 10:25 AM (PST)talk

Real time embeddings for RAG

In the era of AI, real-time access to knowledge through efficient and scalable embedding pipelines has become a critical need. Zander Matheson, CEO and co-founder of Bytewax, will be presenting on how his company is revolutionizing with innovative open source solutions.

In this talk, Zander will dive into how Bytewax's Python-native, highly scalable, cloud-native processing framework is being utilized to power embedding pipelines. He will discuss the challenges of scaling embeddings in real-time and how Bytewax has addressed these issues, making writing and managing pipelines faster and easier for everyone.

Zander will also explain how Bytewax's real-time embedding pipelines have become a critical component in providing up-to-the-minute knowledge to generative AI systems. By continuously updating and expanding the available data, these systems are able to generate more accurate and relevant responses, improving user experience and efficiency.

This talk will provide insights into the technical nuances of creating scalable real-time embeddings, and how these systems can be leveraged to enhance the capabilities of generative AI. Whether you're a data engineer, an AI enthusiast, or simply interested in the mechanics of real-time data processing, you're sure to find valuable insights in this exploration of cutting-edge data streaming technology.

The complete session recording is available for viewing 👇


  • Zander Matheson

Had a dynamic time at SBTB 💛



Supporting SBTB was a delightful experience for us, and being gold sponsors was truly an honor.

We're immensely thankful to all the attendees for their engaging questions and the constant buzz around our booth—it was incredibly inspiring to see such enthusiasm. Plus, our toy bees were a hit, flying off the table just half an hour into the event!