Measures
Flowman provides capabilities to assess data quality by taking measures from mappings and provide the result as metrics. This enables developer to build data quality dashboards using well known tools like Prometheus and Grafana.
Measure Syntax
targets:
my_measures:
kind: measure
measures:
nulls:
kind: sql
query: "
SELECT
SUM(col IS NULL) AS col_nulls
FROM some_mapping
"
Common Fields
The common fields available in all mappings are as follows:
kind
(mandatory) (string): This determines the type of the mapping. Please see the list of all available kinds in the next section
Measure Types
Flowman supports different kinds of measures, the following list gives you an exhaustive overview: