Values Mapping¶

A values mapping contains directly specified constant values. It is a good candidate to be used for mocking data in tests.

Example¶

mappings:
  fake_input:
    kind: values  
    schema:
      kind: inline
      fields:
        - name: int_col
          type: integer
        - name: str_col
          type: string
    records:
      - [1,"some_string"]
      - [2,"cat"]

mappings:
  fake_input:
    kind: values
    columns:
      int_col: integer
      str_col: string
    records:
      - [1,"some_string"]
      - [2,"cat"]

mappings:
  fake_input:
    kind: values
    columns:
      int_col: integer
      str_col: string
    records:
      - int_col: 1
        str_col: "some_string"
      - str_col: "cat"

Fields¶

kind (mandatory) (type: string): values
broadcast (optional) (type: boolean) (default: false): Hint for broadcasting the result of this mapping for map-side joins.
cache (optional) (type: string) (default: NONE): Cache mode for the results of this mapping. Supported values are
- NONE
- DISK_ONLY
- MEMORY_ONLY
- MEMORY_ONLY_SER
- MEMORY_AND_DISK
- MEMORY_AND_DISK_SER
records (optional) (type: list:array) (default: empty): An optional list of records to be returned.
columns (optional) (type: map:string): Specifies the list of column names (key) with their type (value)
schema (optional) (type: schema): As an alternative of specifying a list of columns you can also directly specify a schema.

Outputs¶

main - the only output of the mapping