Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: serde2.av

...

Avro type

Becomes Hive type

Note

null

void

boolean

boolean

int

int

long

bigint

float

float

double

double

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="d096e7a9f34dc307-005fd95e-41934274-abd1a905-bc32408465a6c30d7d850545"><ac:plain-text-body><![CDATA[

bytes

binary

Bytes are converted to Array[smallint] prior to Hive 0.12.0

]]></ac:plain-text-body></ac:structured-macro>

string

string

record

struct

map

map

list

array

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="029c0c8edafb67e9-79e4b960-46d24a73-8f96bba5-f80e139f089763b5e1add632"><ac:plain-text-body><![CDATA[

union

union

Unions of [T, null] transparently convert to nullable T, other types translate directly to Hive's unions of those types. However, unions were introduced in Hive 7 and are not currently able to be used in where/group-by statements. They are essentially look-at-only. Because the AvroSerde transparently converts [T,null], to nullable T, this limitation only applies to unions of multiple types or unions not of a single type and null.

]]></ac:plain-text-body></ac:structured-macro>

enum

string

Hive has no concept of enums

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="348a2851bbc8c10d-dbe43b1a-458f484f-9019b5f3-3a9499b0b0073956f6a9c2f1"><ac:plain-text-body><![CDATA[

fixed

binary

Fixeds are converted to Array[smallint] prior to Hive 0.12.0

]]></ac:plain-text-body></ac:structured-macro>

...