Type Members

1.  final case class AvroFileOutputConfig(path: URI) extends FileOutputConfig with AvroFileConfig with Product with Serializable

   Avro file output configuration

   Avro file output configuration

   path

   Path to file

2.  final case class DelimitedFileOutputConfig(path: URI, delimiter: NonEmptyString = ",", quote: NonEmptyString = "\"", escape: NonEmptyString = "\\", header: Boolean = false) extends FileOutputConfig with DelimitedFileConfig with Product with Serializable

   Delimited file output configuration

   Delimited file output configuration

   path

   Path to file

   delimiter

   Column delimiter (default: ,)

   quote

   Quotation symbol (default: ")

   escape

   Escape symbol (default: \)

   header

   Boolean flag indicating whether schema should be read from file header (default: false)

3.  trait EmailOutputConfig extends NotificationOutputConfig

   Base trait for targets that are sent via email.

   Base trait for targets that are sent via email. Configuration for such targets must contain non-empty sequence of recipients' emails. An optional message template can be provided in form of either an explicit string or an URI to template file location. In addition, email subject can be customized by providing optional subject template.

4.  sealed trait FileOutputConfig extends OutputConfig with FileConfig

   Base class for file outputs.

5.  trait HiveOutputConfig extends OutputConfig

   Base trait for targets that are written to Hive table.

   Base trait for targets that are written to Hive table. Configuration for such targets must contain Hive schema and Hive table in which target data will be inserted.

6.  trait KafkaOutputConfig extends OutputConfig

   Base trait for targets that are sent to Kafka topic.

   Base trait for targets that are sent to Kafka topic. Configuration for such targets must contain reference to a connection ID (must be Kafka connection) and topic name to write target data into.

7.  trait MattermostOutputConfig extends NotificationOutputConfig

   Base trait for targets that are sent as messages to mattermost (to a channels or to users' as direct messages).

   Base trait for targets that are sent as messages to mattermost (to a channels or to users' as direct messages). Configuration for such targets must contain non-empty sequence of recipient: either a channel names prefixed with '#' symbol or usernames prefixed with '@' symbols. In addition an optional message template can be provided in form of either an explicit string or an URI to template file location.

   Note

   Mattermost message do not have subjects, therefore, subjectTemplate is set to None

8.  trait NotificationOutputConfig extends OutputConfig

   Base trait for target that are send as notifications to end users.

   Base trait for target that are send as notifications to end users. Configuration for such targets must contain a list of recipients to receive that notification In addition an optional message template can be provided in form of either an explicit string or an URI to template file location.

9.  final case class OrcFileOutputConfig(path: URI) extends FileOutputConfig with OrcFileConfig with Product with Serializable

   Orc file output configuration

   Orc file output configuration

   path

   Path to file

10.  trait OutputConfig extends AnyRef

    Base class for all outputs configurations

11.  final case class ParquetFileOutputConfig(path: URI) extends FileOutputConfig with ParquetFileConfig with Product with Serializable

    Parquet file output configuration

    Parquet file output configuration

    path

    Path to file

12.  trait SaveToFileConfig extends OutputConfig

    Base class for save to a file configuration

    Base class for save to a file configuration

    Note

    Idea here is that instead of building multiple subclasses for each supported output file format, configuration will contain save parameter with FileOutputConfig of specific kind (format).