Availability
| Note |
|---|
| title | Earliest version CSVSerde is available |
|---|
|
The CSVSerde is available in Hive 0.14 and greater. |
Background
The CSV SerDe is based from https://github.com/ogrodnek/csv-serde, and was added to the Hive distribution in HIVE-7777.
Usage
This SerDe works for most CSV data, but does not handle embedded newlines. To use the SerDe, specify the fully qualified class name org.apache.hadoop.hive.serde2.OpenCSVSerde.
Documentation is based on original documentation at https://github.com/ogrodnek/csv-serde.
| Code Block |
|---|
| language | sql |
|---|
| title | Create table, specify CSV properties |
|---|
|
CREATE TABLE my_table(a string, b string, ...)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
WITH SERDEPROPERTIES (
"separatorChar" = "\t",
"quoteChar" = "'",
"escapeChar" = "\\"
)
STORED AS TEXTFILE; |
| Code Block |
|---|
| title | Default separator, quote, and escape characters if unspecified |
|---|
|
DEFAULT_ESCAPE_CHARACTER \
DEFAULT_QUOTE_CHARACTER "
DEFAULT_SEPARATOR , |
For general information about SerDes, see Hive SerDe in the Developer Guide. Also see SerDe for details about input and output processing.
Versions
The CSVSerde has been built and tested against Hive 0.14 and later, and uses Open-CSV 2.3 which is bundled with the Hive distribution.
| Hive Versions | Open-CSV Version |
|---|
| Hive 0.14 and later | 2.3 |