Sqoop 2 Roadmap

Released

1.99.4 (Refactoring/Stability)

In this release, let’s try to get all infrastructure in place so that we can enable connector developers.

• From/To (stabilize APIs) - Done

• Entity name cleanup - Done  (SQOOP-1496, SQOOP-1497, SQOOP-1498, SQOOP-1566)

• Connector API/Upgrader/Configurables Refactoring - Done (SQOOP-1547, SQOOP-1557)

• Rest API changes - Done - SQOOP-1509

• Generic JDBC Connector - Done

• HDFS Connector - Done (still plenty of cleanup to do)

1.99.5 (Security/Feature parity)

• Kerberos authentication

• Incremental data transfer

• PostgreSQL repository

• Kite Connector - HDFS/ HIVE/ Hbase data sets

• Upgrade to Hadoop 2.5.x and beyond.
• SQOOP-1350 - CSV IDF support for all the 14 data types with extensive unit test coverage
• Config Top Level Entity ( Client and API support)
• Avro IDF support

Unreleased

1.99.6 (Security/Feature parity)

In this release, let’s focus on developing new connectors and execution engines.

• Role Based Access Control

• HUE and Sqoop 2 Integration

1.99.7 (Connectors and execution engines)

In this release, let’s focus on developing new connectors and execution engines.

• HBase connector

• Hive connector

• HCatalog connector (Or is this the same as Hive connector?)

• MySQL fast connector

• PostgreSQL fast connector

• Oracle fast connector

• Netezza connector

• Teradata connector (?)
• Spark execution engine

2.0.0 (GA)

• Config and Input Annotation enhancements