Pipeline to ingest data from multiple files in a folder - not responsive

Elastic Stack Logstash
1

I am trying to ingest multiple files in a folder into Elasticsearch. I am using ELK 6.0 version on windows 8 OS.

logstash -f ingestcars.config command is non-responsive. The log says "pipeline is running".

If I try to load single file it works fine. Is "*" not the correct way to indicate all files in a folder?

   input {
	      file{
		    path=>"C:\Downloads\ELK Stack\logstash-6.2.2\data\LoadMultipleFiles\*"
    		start_position=>"beginning"
    		sincedb_path=>""
	     }
   }
    filter{
	csv{
		separator=>","
		columns=>["maker","model","mileage","manufacture_year","engine_displacement","engine_power","body_type","color_slug	stk_year","transmission","door_count","seat_count","fuel_type","date_created","date_last_seen","price_eur"]
	}
	mutate{convert=>["mileage","integer"]}
	mutate{convert=>["price_eur","float"]}
	mutate{convert=>["engine_power","integer"]}
	mutate{convert=>["door_counte","integer"]}
	mutate{convert=>["seat_count","integer"]}
	
}
output{
	elasticsearch{
		hosts=> "localhost:9200"
		index=>"cars"
		document_type=>"sold_cars"
	}
	stdout{}
}
2

If I try to load single file it works fine. Is "*" not the correct way to indicate all files in a folder?

It is, but I think you need to use forward slashes instead of backslashes in the path.

		sincedb_path=>""

What's this supposed to mean?

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.