I am wondering what tools I can use for streaming decoded data from binary files to elastic the fastest way.
Here is what I am trying to do.
files are located at directory .
Those files are binary encoded files to save space. After decoding each file I get human readable structs (in c++). A lot of regular c++ structs.
I want my directory to be continuously checked for new files automatically and then I will decode the new files with my own decoder code into structs . every struct object is a record in elastic.
Please help me , it’s important