DeltaLake Plugin

The delta plugin provide read/write support for DeltaLake tables.

Note that this plugin is only provided for Spark 3.0+. For Spark 2.4, the plugin does not contain the Flowman relations below, you might still be able to use it using a generic relation or file relation, but this is not officially supported and we strongly recommend to move to Spark 3.0+.

Provided Entities

• deltaTable relation

• deltaFile relation

• ‘deltaVacuum’ target

Activation

The plugin can be easily activated by adding the following section to the default-namespace.yml

plugins:
  - flowman-delta