View Source

Availability

The CSVSerde is available in Hive 0.14 and greater.

Background

The CSV Serde is based from https://github.com/ogrodnek/csv-serde, and was added to Hive distribution in HIVE-7777.

Usage

This Serde works for most CSV data, but does not handled embedded newlines. To use the Serde, specify the fully qualified class name org.apache.hadoop.hive.serde2.OpenCSVSerde.

Documentation is based on original documentation at https://github.com/ogrodnek/csv-serde.

create table my_table(a string, b string, ...)
 row format serde 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
 with serdeproperties (
   "separatorChar" = "\t",
   "quoteChar"     = "'",
   "escapeChar"    = "\\"
  )   
 stored as textfile
;

DEFAULT_ESCAPE_CHARACTER \
DEFAULT_QUOTE_CHARACTER  "
DEFAULT_SEPARATOR        ,

For general information about SerDes, see Hive SerDe in the Developer Guide. Also see SerDe for details about input and output processing.

Requirements

The CSVSerde has been built and tested against Hive 0.14 and later, and uses Super-CSV 2.2.0.

Hive Versions	SuperCSV Version
Hive 0.14 and later	2.2.0