Values Mapping#

A values mapping contains directly specified constant values. It is a good candidate to be used for mocking data in tests.

Example#

mappings:
  fake_input:
    kind: values  
    schema:
      kind: inline
      fields:
        - name: int_col
          type: integer
        - name: str_col
          type: string
    records:
      - [1,"some_string"]
      - [2,"cat"]

mappings:
  fake_input:
    kind: values
    columns:
      int_col: integer
      str_col: string
    records:
      - [1,"some_string"]
      - [2,"cat"]

mappings:
  fake_input:
    kind: values
    columns:
      int_col: integer
      str_col: string
    records:
      - int_col: 1
        str_col: "some_string"
      - str_col: "cat"

Fields#

  • kind (mandatory) (type: string): values

  • broadcast (optional) (type: boolean) (default: false): Hint for broadcasting the result of this mapping for map-side joins.

  • cache (optional) (type: string) (default: NONE): Cache mode for the results of this mapping. Supported values are

    • NONE

    • DISK_ONLY

    • MEMORY_ONLY

    • MEMORY_ONLY_SER

    • MEMORY_AND_DISK

    • MEMORY_AND_DISK_SER

  • records (optional) (type: list:array) (default: empty): An optional list of records to be returned.

  • columns (optional) (type: map:string): Specifies the list of column names (key) with their type (value)

  • schema (optional) (type: schema): As an alternative of specifying a list of columns you can also directly specify a schema.

Outputs#

  • main - the only output of the mapping