"The wonderful life of a SQL query in a streaming database" ( 2024 )

Sunday at 15:45, 15 minutes, H.2215 (Ferrer), H.2215 (Ferrer), Lightning talks Jan Mensch , slides , video

How do you update materialized views incrementally based on streaming data? In this talk, we follow the life of a query, from the SQL string to the running operators, in a distributed system. This talk follows a SQL query as it runs in RisingWave (https://github.com/risingwavelabs/risingwave), a shared storage streaming system that delivers real-time analytics over unbounded data. We’ll give a brief overview of the systems architecture, and show how the compute layer is used during query processing. You will also discover how this open-source database deploys streaming graphs, scales horizontally, and manages data in motion.