Check for new files addition and index them as an attachment

Elastic Stack Elasticsearch
1

Is there any plugin or method to check if any new files(either doc or pdf or ppt) are added to a particular folder and if added, they should be indexed to the ES server as an attachment. (not looking for a console application which does the feeder job)
TIA :slight_smile:

2

That was the goal of https://github.com/dadoonet/fscrawler

3

I'm using FilesSystemWatcher of .NET for the changes in the folder and indexing the documents. But if the document is open or being modified , it is throwing an error while attaching . How can I ignore the files which are open or being modified and take the older version of the document?

try
            {
                Attachment attach = new Attachment
                {
                    Name = Path.GetFileNameWithoutExtension(file),
                    Content = Convert.ToBase64String(File.ReadAllBytes(file)),
                    ContentType = Path.GetExtension(file)
                };

                doc = new Document()
                {
                    Title = Path.GetFileNameWithoutExtension(file),
                    FilePath = Path.GetFullPath(file), 
                    CreatedDate = DateTime.Now,
                    File = attach
                };
            }
            catch (IOException e) //it is going into this exception if the file is open
            {
                Console.WriteLine("A Exception Occurred While Attaching :" + e);
            }
4

IMO it's a .Net question and not related to Elasticsearch.
Or you may want to ask in Clients list?

5

what is clients list?

6

Sorry. I meant: https://discuss.elastic.co/c/development

7

okok. Thanks David.