Skip to main content

File Formats

Spice currently supports CSV and Parquet data file-formats. Support for Iceberg and other file-formats are on the roadmap.

The parameters supported for specific file-format are detailed on this page.

CSV

Parameters

  • has_header: Optional. Indicate if the CSV file has header row. Defaults to true
  • quote: Optional. A one-character string used to quote fields containing special characters. Defaults to "
  • escape: Optional. A one-character string used to represent special characters or to include characters that would normally be interpreted as delimiters or new line characters within a field value. Defaults to null
  • schema_infer_max_records: Optional. A number used to set the limit in terms of records to scan to infer the schema. Defaults to 1000
  • delimiter: Optional. A one-character string used to separate individual fields. Defaults to ,