We’re talking all about SQL rollups on streaming data. Hear from the team that built it this Thursday 10/28 at 10am PDT. See you there! https://rockset.com/sql-rollups-on-streaming-data-tech-talk
Rollups in Rockset pre-aggregate streaming data at ingest time. Learn how we built SQL rollups to support exactly-once write semantics and process out-of-order arrivals correctly.
Rockset is a real-time analytics database for serving fast search and analytics at scale. We built SQL rollups in Rockset that can pre-aggregate data from streaming sources, like Apache Kafka and Amazon Kinesis. Using rollups can improve storage efficiency and query performance.
Over the course of this project, we encountered multiple challenges in building SQL rollups on streaming data, including:
- supporting exactly-once write semantics
- executing SQL on streaming data at ingest time
- processing out-of-order arrivals correctly
In this talk, we discuss how we overcame these technical challenges to implement rollups.