Contents:
Datatype Considerations
The key considerations for specifying datatype support in Sqoop is to ensure the following:
- Easy for connectors to work with
- Flexible enough to accomodate variations in different target systems.
Avro Types
According to Avro 1.7.0 specification, the following primitive types are supported:
Data Type |
Description |
|---|---|
null |
no value |
boolean |
binary value |
int |
32-bit signed integer |
long |
64-bit signed integer |
float |
single precision (32-bit) IEEE 754 floating-point number |
double |
double precision (64-bit) IEEE 754 floating-point number |
bytes |
sequence of 8-bit unsigned bytes |
string |
unicode character sequence |
Apart from these, Avro also supports following non-primitive types:
- Record: a free from collection of other types organized as a type
- Enum: a value from a fixed set of predefined symbols
- Array: an ordered collection of instance of the same type
- Map: an unordered collection of string name and defined typed values
- Union: a value that can be of any one of the defined types
- Fixed: a value that can be defined as a fixed number of bytes.