# Streaming Binary files’s decoded data to elastic :) **URL:** \ **Category:** Elasticsearch\ **Created:** [December 20, 2019, 10:25pm UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713 "2019-12-20T22:25:40Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![liron\_gofberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liron_gofberg/32/59823_2.png) [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Post date:** [December 20, 2019, 10:25pm UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713/1 "2019-12-20T22:25:40Z")
I am wondering what tools I can use for streaming decoded data from binary files to elastic the fastest way. Here is what I am trying to do. files are located at directory . Those files are binary encoded files to save space. After decoding each file I get human readable structs (in c++). A lot of regular c++ structs. I want my directory to be continuously checked for new files automatically and then I will decode the new files with my own decoder code into structs . every struct object is a record in elastic. Please help me , it’s important ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 21, 2019, 2:06am UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713/2 "2019-12-21T02:06:04Z")
I don't know how this would help but may be look at FSCrawler project. It "monitors" a directory and index its content. If you have your own decoding process, you need I guess to implement everything by yourself. You could always use FSCrawler source code as a start. ---
**Author:** ![liron\_gofberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liron_gofberg/32/59823_2.png) [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Post date:** [December 21, 2019, 9:17am UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713/4 "2019-12-21T09:17:46Z")
Hi, Thank u for answering 🙂 I read about it but unfortunately ,my code is written in C++😓 But I need to upload decoded data to elastic and not the binary files themselves And I need it to recognize and process new files without delete the old ones I don’t want to make any changes in destination directory because another programmers use it for another use cases I have my own decoding process do u know if I can use Logstash or another tool for this use case?🙏🏻 ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [December 21, 2019, 12:48pm UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713/5 "2019-12-21T12:48:52Z")
Can't you translate your code to Java? The languages are super closed. I'm not aware of anything out of the box which would help. ---
**Author:** ![liron\_gofberg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/liron_gofberg/32/59823_2.png) [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Post date:** [December 21, 2019, 1:26pm UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713/6 "2019-12-21T13:26:22Z")
I have exists folder updated with lots of new binary files all the time. I can’t change their format or replace it . And the format is wrriten in a very complicated way in c++ headers and there r some technicians to save space So I have to read the data with the c++ format (the way it was wrriten) I can’t translate it with java because it was wrriten in c++ sizes. 😥 ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 18, 2020, 1:26pm UTC](https://discuss.elastic.co/t/streaming-binary-files-s-decoded-data-to-elastic/212713/7 "2020-01-18T13:26:24Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.