Create and use stateful store in a streaming pipeline.
state_store
object in the kwargs
parameter. Redis is the only supported state store.
interval_window
with the desired interval.
In the meantime, you can add the following blocks after the window aggregation block.
These blocks will be triggered periodically based on the configuration.
For example, you can add a transformer block to report those data into monitoring system.
It can be used as alerts to your pipeline.