Child pages
  • Features and Use Cases
Skip to end of metadata
Go to start of metadata

Targeted Features

The following features are targeted by Flume NG (FLUME-728). This list is still mutable. That said, the goal is to product a working core and incrementally build out the features necessary for robust data ingestion. A lack of a JIRA may indicate that work has not yet begun on a given feature.

Feature

JIRA

General Features

Source, Sink, Channel, Event Interfaces

 

Source and Sink Runners (event-driven and pollable)

 

Input and Output Format Interfaces / Serialization

 

Configuration Interfaces

 

Metrics collection infrastructure

 

JMX mbean support

 

Configuration

File-based configuration system

 

Centrally managed ZK based configuration system

 

Channels / Reliability Features

In-memory "best effort" channel

 

JDBC-based durable channel

FLUME-760

File-based durable channel

 

Sources

Avro RPC source

 

Thrift RPC source

 

Scribe compatibility source

 

Exec source

 

Tail source

 

Sinks

HDFS sink

FLUME-761

FS sink

 

HBase sink

 

Specialized Adapters / Integration

log4j -> avro source appender

 

Use Cases

TODO

  • No labels