I am wondering what tools I can use for streaming decoded data from binary files to elastic the the fastest way. files are located at library and i want the library to be continuously checked for new files so the new data will be transfered automatically
I need to know the fastest way to do that.
Here is what I am trying to do.
Those files are binary encoded files to save space. After decoding each file I get human readable structs (in c++). A lot of regular c++ structs.
I want my folder to be checked for new files automatically and then decode the new files ןinto structs . i want every struct object to be a record in elastic. and i want every struct object to be moved to elastic automatically.
Please help me , it’s important