ConnectorDelta Read / FetchDelta Write / MergePriority for 1.99.5 / 1.99.6 releaseSupported in Release

Generic JDBC Connector

https://issues.apache.org/jira/browse/SQOOP-1810

Yes

 

Yes

Type of WriteSupported
Append new records, i.e INSERT onlyYes
Merge updates for old records, INSERT or UPDATEYes
HIGH1.99.5 or higher

HDFS Standalone connector

https://issues.apache.org/jira/browse/SQOOP-1949

N/A ( not applicable)

Yes, format supported only Text

Type of Write 
Append new recordsYes
Merge updates from old recordsNo
HIGH1.99.5 or higher

Kite Connector HDFS

No ticket yet.

N/A ( not applicable)

Yes, format support Avro and Parquet ( confirm ??)

 

HIGH 1.99.5 or higher

Kite Connector HIVE

SQOOP-1947 - Getting issue details... STATUS

  MED 

Kite Connector Hbase

https://issues.apache.org/jira/browse/SQOOP-1948

  MED 
Hbase Connector  MED 
Kafka ConnectorYES (record topic,partition,offset tuples and always fetch from last_values)Append will be supported (just write values...)
Can't do a Merge/update 		LOW (FROM connector doesn't exist yet...) 
     
     
     
     
     
  • No labels

1 Comment

  1. Gwen Shapira

    Jan 09, 2015

    HDFS could support merges (by running an extra MR job in the "destoryer" - the MR job will basically dedup the dataset). Not sure about priority, but just putting it here for the record.