package streaming
Ordering
- Alphabetic
Visibility
- Public
- All
Type Members
-
case class
ProcessorBuffer(watermarks: TrieMap[String, Long], calculators: TrieMap[(String, Long), GroupedCalculators], errors: TrieMap[(String, Long), Seq[AccumulatedErrors]], checkpoints: TrieMap[String, Checkpoint]) extends Product with Serializable
Processor state buffer used in streaming applications.
Processor state buffer used in streaming applications. Holds following metric calculation state:
- current watermarks per each stream that is being processed.
- state of metric calculators per each stream and each processing window withing a stream.
- metric error accumulators per each stream and each processing window withing a stream.
- watermarks
Watermarks per each stream.
- calculators
Calculators state per each stream and each window.
- errors
Metric errors per each stream and each window.
- checkpoints
Source checkpoints: map of checkpointId -> checkpoint.
- Note
Scala concurrent Trie Map is used to store results in a buffer as it is a thread safe and allows lock free access to its contents.
Value Members
- object CheckpointIO
- object Checkpoints
- object ProcessorBuffer extends Serializable