File output plugin - index not created

Elastic Stack Logstash
1

Hello,
I am an ELK noob. I am running Elastic Search 5.6.2 and Logstash 5.6.2.

I am using the file input plug and output to elastic search with no filters, but having no luck getting the output into ES.

I started logstash in debug and ran it for 24 hours. When I went into Kibana and entered the index name (files*) to create the index, Kibana could not find it.

There was only one very small pdf file in the folder. The file and folder permission allows all users read/write access.

The config file looks like this:
input {
file {
id => "4"
path => "C:\documents"
}
}
output {
elasticsearch {
#protocol => http
index => "files"
document_type => "file"
document_id => "%{docid}"
hosts => "CRMVM75:9200"
}
stdout { codec => rubydebug }
}

The output from the debug is this:
[2017-11-03T08:39:41,372][DEBUG][logstash.inputs.file ] _globbed_files: C:\documents: glob is: []
[2017-11-03T08:39:43,284][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:39:48,286][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:39:53,288][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:39:56,398][DEBUG][logstash.inputs.file ] _globbed_files: C:\documents: glob is: []
[2017-11-03T08:39:58,294][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:03,297][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:08,299][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:11,427][DEBUG][logstash.inputs.file ] _globbed_files: C:\documents: glob is: []
[2017-11-03T08:40:13,302][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:18,303][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:23,306][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:26,447][DEBUG][logstash.inputs.file ] _globbed_files: C:\documents: glob is: []
[2017-11-03T08:40:28,309][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:33,312][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-11-03T08:40:38,322][DEBUG][logstash.pipeline ] Pushing flush onto pipeline

2

Apologies-

  1. I had the wrong title: It should be File input Plugin - Index not created.
  2. The file input plugin is not appropriate for my requirements. I need to ingest Word and PDF documents. The FS Crawler seems like the best tool for this job.
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.