case class StreamConfig(trigger: Duration = Duration("10s"), window: Duration = Duration("10m"), watermark: Duration = Duration("5m"), allowEmptyWindows: Boolean = false, checkpointDir: Option[URI] = None) extends Product with Serializable
Application-level configuration describing streaming settings
- trigger
Trigger interval: defines time interval for which micro-batches are collected.
- window
Window interval: defines tabbing window size used to accumulate metrics.
- watermark
Watermark level: defines time interval after which late records are no longer processed.
- allowEmptyWindows
Boolean flag indicating whether empty windows are allowed. Thus, in situation when window is below watermark and for some of the processed streams there are no results then all related checks will be skipped if this flag is set to 'true'. Otherwise, checks will be processed and return error status with 'metric results were not found' message.
- checkpointDir
Checkpoint directory. If not set, then checkpoints in streaming applications will not be saved.
- Alphabetic
- By Inheritance
- StreamConfig
- Serializable
- Serializable
- Product
- Equals
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
StreamConfig(trigger: Duration = Duration("10s"), window: Duration = Duration("10m"), watermark: Duration = Duration("5m"), allowEmptyWindows: Boolean = false, checkpointDir: Option[URI] = None)
- trigger
Trigger interval: defines time interval for which micro-batches are collected.
- window
Window interval: defines tabbing window size used to accumulate metrics.
- watermark
Watermark level: defines time interval after which late records are no longer processed.
- allowEmptyWindows
Boolean flag indicating whether empty windows are allowed. Thus, in situation when window is below watermark and for some of the processed streams there are no results then all related checks will be skipped if this flag is set to 'true'. Otherwise, checks will be processed and return error status with 'metric results were not found' message.
- checkpointDir
Checkpoint directory. If not set, then checkpoints in streaming applications will not be saved.
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- val allowEmptyWindows: Boolean
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
- lazy val checkpointCol: String
- val checkpointDir: Option[URI]
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- lazy val eventTsCol: String
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
- val trigger: Duration
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- val watermark: Duration
- val window: Duration
- lazy val windowTsCol: String