Streaming data

Streaming data is data that is transferred in real-time or near real-time, without being stored en route. Streaming can be true streaming (new data is sent as it is generated or arrives) or micro-batches (data is aggregated up to a number of data items, a total data size, all data within a time window, or similar exceptions to sending individual data items as they arrive). 

‍

The data lakehouse is often used for handling incremental updates delivered by streaming data. Some data lakehouse system excel for streaming workloads by processing incoming data incrementally, avoiding costly data rewrites. 

‍

Related terms: data lake; data lakehouse; streaming data

‍

On the Onehouse website: 

• The Ultimate Data Lakehouse for Streaming Data Using Onehouse and Confluent
• An Introduction to the Hudi and Flink Integration
• Apache Hudi vs Delta Lake vs Apache Iceberg