Measures#

Flowman provides capabilities to assess data quality by taking measures from mappings and provide the result as metrics. This enables developer to build data quality dashboards using well known tools like Prometheus and Grafana.

Measure Syntax#

targets:
  my_measures:
    kind: measure
    measures:
      nulls:
        kind: sql
        query: "
          SELECT 
            SUM(col IS NULL) AS col_nulls
          FROM some_mapping
        "

Common Fields#

The common fields available in all mappings are as follows:

  • kind (mandatory) (string): This determines the type of the mapping. Please see the list of all available kinds in the next section

Measure Types#

Flowman supports different kinds of measures, the following list gives you an exhaustive overview: