Import CSV file to Logstash on windows10

Hi,

I am trying to import a CSV file to elasticsearch using logstash, but with no success.

Windows 10
Logstash 7.3.0/Elasticsearch 7.3.0/Kibana 7.3.0

// Config File is as below
input
{
file
{
path => ["E:\Softwares\ES\UU_Telemetry.csv"]
start_position => "beginning"
sincedb_path => "NUL"
}
}
filter
{
csv
{
separator => ","
columns => ["Site", "Process_Area", "Asset", "Description", "Alarms", "Alarm_Priority", "date_created"]

}
 mutate {convert => ["Alarm_Priority", "integer"]}

}
output
{
elasticsearch
{
hosts => ["localhost:9200"]
index => "UU_Telemetry"
}
stdout {}
}

//config file end

//Output @ power shell
PS E:\Softwares\ES> .\logstash-7.3.0\bin\logstash -f .\logstash-UU_Tele.conf
Thread.exclusive is deprecated, use Thread::Mutex
Sending Logstash logs to E:/Softwares/ES/logstash-7.3.0/logs which is now configured via log4j2.properties
[2019-08-11T22:16:05,585][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2019-08-11T22:16:05,599][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.3.0"}
[2019-08-11T22:16:06,743][INFO ][org.reflections.Reflections] Reflections took 32 ms to scan 1 urls, producing 19 keys and 39 values
[2019-08-11T22:16:08,780][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>, :added=>[http://localhost:9200/]}}
[2019-08-11T22:16:09,009][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://localhost:9200/"}
[2019-08-11T22:16:09,052][INFO ][logstash.outputs.elasticsearch] ES Output version determined {:es_version=>7}
[2019-08-11T22:16:09,055][WARN ][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the type event field won't be used to determine the document _type {:es_version=>7}
[2019-08-11T22:16:09,078][INFO ][logstash.outputs.elasticsearch] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//localhost:9200"]}
[2019-08-11T22:16:09,142][INFO ][logstash.outputs.elasticsearch] Using default mapping template
[2019-08-11T22:16:09,183][WARN ][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been create for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.
[2019-08-11T22:16:09,187][INFO ][logstash.javapipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>8, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>1000, :thread=>"#<Thread:0x5e61ec0a run>"}
[2019-08-11T22:16:09,227][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}
[2019-08-11T22:16:09,809][INFO ][logstash.javapipeline ] Pipeline started {"pipeline.id"=>"main"}
[2019-08-11T22:16:09,877][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>}
[2019-08-11T22:16:09,880][INFO ][filewatch.observingtail ] START, creating Discoverer, Watch with file and sincedb collections
[2019-08-11T22:16:10,230][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}

//END

Please help

Thanks in advance

Hi thanks for try Logstash on windows

Try
path => ["E:/Softwares/ES/UU_Telemetry.csv"]

Also in the future if you use the </> button at the top of the editor it will format your code correctly and make it easier for others to help.

Hope this helps...

That did the job.
Thanks

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.