Spark Schema#

The Spark schema refers to a schema produced by Apache Spark.

Example#

kind: spark
file: "${project.basedir}/test/data/results/${relation}/schema.json"

Fields#

  • kind (mandatory) (type: string): spark

  • file (optional) (type: string): Specifies the path of a schema file.

  • url (optional) (type: string): Specifies the URL of a schema.

  • spec (optional) (type: string): Specifies the schema itself as an embedded string

Note that you can only use one of file, url or spec.