...
Component | Type | Description | Implementation Class |
|---|---|---|---|
Channel | memory MEMORY | In-memory, fast, non-durable event transport | MemoryChannel |
Channel | FILE file | A channel for reading, writing, mapping, and manipulating a file | FileChannel |
Channel | JDBC jdbc | JDBC-based, durable event transport (Derby-based) | JDBCChannel |
Channel | RECOVERABLEMEMORY recoverablememory | A durable channel implementation that uses the local file system for its storage | RecoverableMemoryChannel |
Channel | org.apache.flume.channel.PseudoTxnMemoryChannel | Mainly for testing purposes. Not meant for production use. | PseudoTxnMemoryChannel |
Channel | (custom type as FQCN) | Your own Channel impl. | (custom FQCN) |
Source | AVRO avro | Avro Netty RPC event source | AvroSource |
Source | EXEC exec | Execute a long-lived Unix process and read from stdout | ExecSource |
Source | NETCAT netcat | Netcat style TCP event source | NetcatSource |
Source | SEQ seq | Monotonically incrementing sequence generator event source | SequenceGeneratorSource |
Source | org.apache.flume.source.StressSource | Mainly for testing purposes. Not meant for production use. Serves as a continuous source of events where each event has the same payload. The payload consists of some number of bytes (specified by size property, defaults to 500) where each byte has the signed value Byte.MAX_VALUE (0x7F, or 127). | org.apache.flume.source.StressSource |
Source | syslogtcp SYSLOGTCP |
| SyslogTcpSource |
Source | SYSLOGUDP syslogudp |
| SyslogUDPSource |
Source | org.apache.flume.source.avroLegacy.AvroLegacySource |
| AvroLegacySource |
Source | org.apache.flume.source.thriftLegacy.ThriftLegacySource |
| ThriftLegacySource |
Source | org.apache.flume.source.scribe.ScribeSource |
| ScribeSource |
Source | (custom type as FQCN) | Your own Source impl. | (custom FQCN) |
Sink | HDFS hdfs | Writes all events received to HDFS (with support for rolling, bucketing, HDFS-200 append, and more) | HDFSEventSink |
Sink | org.apache.flume.sink.hbase.HBaseSink | A simple sink that reads events from a channel and writes them to HBase. | org.apache.flume.sink.hbase.HBaseSink |
Sink | org.apache.flume.sink.hbase.AsyncHBaseSink |
| org.apache.flume.sink.hbase.AsyncHBaseSink |
Sink | LOGGER logger | Log events at INFO level via configured logging subsystem (log4j by default) | LoggerSink |
Sink | AVRO avro | Sink that invokes a pre-defined Avro protocol method for all events it receives (when paired with an avro source, forms tiered collection) | AvroSink |
Sink | FILE file_ROLL roll |
| RollingFileSink |
Sink | irc IRC |
| IRCSink |
Sink | null NULL | /dev/null for Flume - blackhole all events received | NullSink |
Sink | (custom type as FQCN) | Your own Sink impl. | (custom FQCN) |
ChannelSelector | replicating REPLICATING |
| ReplicatingChannelSelector |
ChannelSelector | multiplexing MULTIPLEXING |
| MultiplexingChannelSelector |
ChannelSelector | (custom type) | Your own ChannelSelector impl. | (custom FQCN) |
SinkProcessor | default DEFAULT |
| DefaultSinkProcessor |
SinkProcessor | failover FAILOVER |
| FailoverSinkProcessor |
SinkProcessor | LOAD load_BALANCE balance | Provides the ability to load-balance flow over multiple sinks. | LoadBalancingSinkProcessor |
SinkProcessor | (custom type as FQCN) | Your own SinkProcessor impl. | (custom FQCN) |
Interceptor$Builder | HOST host |
| HostInterceptor$Builder |
Interceptor$Builder | TIMESTAMP timestamp | TimestampInterceptor | TimestampInterceptor$Builder |
Interceptor$Builder | static STATIC |
| StaticInterceptor$Builder |
Interceptor$Builder | REGEX regex_FILTER filter |
| RegexFilteringInterceptor$Builder |
Interceptor$Builder | (custom type as FQCN) | Your own Interceptor$Builder impl. | (custom FQCN) |
EventSerializer$Builder | text TEXT |
| BodyTextEventSerializer$Builder |
EventSerializer$Builder | AVRO avro_EVENT event |
| FlumeEventAvroEventSerializer$Builder |
EventSerializer | org.apache.flume.sink.hbase.SimpleHbaseEventSerializer |
| SimpleHbaseEventSerializer |
EventSerializer | org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer |
| SimpleAsyncHbaseEventSerializer |
EventSerializer | org.apache.flume.sink.hbase.RegexHbaseEventSerializer |
| RegexHbaseEventSerializer |
HbaseEventSerializer | Custom implementation of serializer for HBaseSink. | Your own HbaseEventSerializer impl. | (custom FQCN) |
AsyncHbaseEventSerializer | Custom implementation of serializer for AsyncHbase sink. | Your own AsyncHbaseEventSerializer impl. | (custom FQCN) |
EventSerializer$Builder | Custom implementation of serializer for all sinks except for HBaseSink and AsyncHBaseSink. | Your own EventSerializer$Builder impl. | (custom FQCN) |
...