Spark Schema
The Spark schema refers to a schema produced by Apache Spark.
Example
kind: spark
file: "${project.basedir}/test/data/results/${relation}/schema.json"
Fields
kind
(mandatory) (type: string):spark
file
(optional) (type: string): Specifies the path of a schema file.url
(optional) (type: string): Specifies the URL of a schema.spec
(optional) (type: string): Specifies the schema itself as an embedded string
Note that you can only use one of file
, url
or spec
.