Dear All,
Need help resolving to convert string into date. The logstash is configured to read data from csv file and helps converts string to integer but not string to date for certain column.
Here is the sample data, software versions and configuration for your reference. Please help!!
Sample data extracted from csv file:
9999999995,Wing-B Level 10,1181,Pre-Launch,Corporate,6/17/2019,00:00-09:00,50012065,Veg Cheese Sandwich,,0,115,115,0
9999999996,Wing-B Level 10,1181,Pre-Launch,Corporate,6/17/2019,00:00-09:00,50012065,Veg Cheese Sandwich,,0,115,115,0
software versions :
Logstash version : 6.7
ElasticSearch version : 6.3
Logstash configuration :
input {
file {
path => "/home/logstash/data_oos_csv_load/*.csv"
start_position => "beginning"
sincedb_path => "/home/logstash/data_oos_csv_load/sincedb_path_for_oos_csv.log"
tags => ["logstash-load-oos_csv_details"]
}
}
filter {
csv {
separator => ","
columns => [ "id", "location_name", "location_id", "stable_status", "segment", "date", "time", "product_id", "product_name", "temperature", "essential_flag", "estimated_in_stock_time", "actual_in_stock_time", "oos_percentage" ]
convert => {
"id" => "integer"
"essential_flag" => "integer"
"estimated_in_stock_time" => "integer"
"actual_in_stock_time" => "integer"
"oos_percentage" => "float"
}
}
date {
match => ["timestamp","mm/dd/yyyy"]
target => "date"
}
}
output {
if "logstash-load-oos_csv_details" in [tags]{
elasticsearch {
hosts => ["superaws.live.94.com:9200"]
index => "index-csv-oos"
document_id => "%{id}"
user => logstash_shipper
password => shipper_logstash
}
stdout {}
}
}