Indexing new data automatically from a folder in desktop to the existing index in elasticstack

[samnayak (Sampashree Nayak)]

Hi All,

I am a CSE grad student and I use Elasticstack for my research. Could you please help me with below question?

Can I index the data automatically from a folder in the computer to Elasticstack so that when new data comes into the same folder in the computer, data would add automatically to the existing index? So I don't have to create an index again for similar data.

In other words, how can I set up the config file to watch the folder for new data?

If you could provide me some link/tutorial or reference that would be helpful.

Thanks,

[Constantine_Abayeu]

You can look at file beat: https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-getting-started.html

I am unsure if this is exactly what you are looking for, but should be something to check out for sure.

Is your data added to new files within a folder, or is it added to the same file?

[samnayak (Sampashree Nayak)]

Thank You!

Data added to a new file within a folder.

[Constantine_Abayeu]

Ok, Filebeat should work for you then!

You can wildcard the file name and get the contents of it.

[samnayak (Sampashree Nayak)]

Thank you so much!

I am looking in to it.