...
The AvroSerde has been built and tested against Hive 0.9.1 and later, and uses Avro 1.7.5.
Avro to Hive type conversion
...
Code Block |
---|
CREATE TABLE kst
PARTITIONED BY (ds string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
TBLPROPERTIES (
'avro.schema.url'='http://schema_provider/kst.avsc');
For Hive 0.14 and later:
CREATE TABLE kst (
string1 string,
string2 string,
int1 int,
boolean1 boolean,
long1 bigint,
float1 float,
double1 double,
inner_record1 struct<int_in_inner_record1:int,string_in_inner_record1:string>,
enum1 string,
array1 array<string>,
map1 map<string,string>,
union1 uniontype<float,boolean,string>,
fixed1 binary,
null1 void,
unionnullint int,
bytes1 binary)
PARTITIONED BY (ds string)
STORED AS AVRO; |
In this example we're pulling the source-of-truth reader schema from a webserver. Other options for providing the schema are described below.
...