# An extended serializer for the Elasticsearch sink for Flume

**URL:** <https://discuss.elastic.co/t/an-extended-serializer-for-the-elasticsearch-sink-for-flume/19688>\
**Category:** Elasticsearch\
**Created:** [September 9, 2014, 2:48pm UTC](https://discuss.elastic.co/t/an-extended-serializer-for-the-elasticsearch-sink-for-flume/19688 "2014-09-09T14:48:33Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![rore](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rore/32/399_2.png) [@rore](https://discuss.elastic.co/u/rore)\
**Post date:** [September 9, 2014, 2:48pm UTC](https://discuss.elastic.co/t/an-extended-serializer-for-the-elasticsearch-sink-for-flume/19688/1 "2014-09-09T14:48:33Z")

</div>

We use Flume at Gigya to ship logs and application events into  
Elasticsearch (and kibana).

We're using the flume-ng elasticsearch sink, but we've encountered a few  
issues with it. So we created an extended version of the logstash  
serializer that the sink uses, that fixes some bugs contained in the  
original one, and adds some features that we needed (like removing the  
@fields node level, collecting objects and generating a consistent document  
ID per event).

Hoping that some of you may find it useful, you can find the sources for  
the extended serializer here -

> **[gigya/flume-ng-elasticsearch-ser-ex](https://github.com/gigya/flume-ng-elasticsearch-ser-ex)**
>
> flume-ng-elasticsearch-ser-ex - An extended serializer for Flume ElasticSearch sink

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/24e4792b-f5a4-4b30-ac66-64487064745c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/24e4792b-f5a4-4b30-ac66-64487064745c%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:03am UTC](https://discuss.elastic.co/t/an-extended-serializer-for-the-elasticsearch-sink-for-flume/19688/2 "2017-07-06T01:03:38Z")

</div>

Closed on July 6, 2017, 1:03am UTC