Delta Lake Plugin

The delta plugin provide read/write support for Delta Lake tables.

Note that this plugin is only provided for Spark 3.0+. For Spark 2.4, the plugin does not contain the Flowman relations below, you might still be able to use it using a generic relation or file relation, but this is not officially supported, and we strongly recommend moving to Spark 3.0+.

Provided Entities

• deltaTable relation

• deltaFile relation

• deltaVacuum target

Activation

The plugin can be easily activated by adding the following section to the default-namespace.yml

plugins:
  - flowman-delta