This project is not maintained. I strongly suggest you use Logstash instead.

ElasticsearchSink2

This is Flume-NG Sink for Elasticsearch >= 2.0. I developed this because the official version does not support Elasticsearch >= 2.0 due to API changes. Hope Flume dev team will fix this soon.

Requirements

Build

Build standard jar by the following command

$ ./gradlew build

Build fat jar which contains elasticsearch dependencies

$ ./gradlew assembly

Jar will be generated in build/libs

Usage

  1. Append the built jar to Flume's classpath
  2. remove guava-*.jar and jackson-core-*.jar in flume's default libs dir. They are outdated and newer version are included in Elasticsearch.
  3. set sink type to com.frontier45.flume.sink.elasticsearch2.ElasticSearchSink in flume.conf
  4. start flume agent