Logstash Unexpected character ('-' (code 45)): was expecting comma to separate Array entries

Elastic Stack Logstash
1

Hi i am trying to move my application logs to kibana through logstash.
1.This is my logstash.conf file:

input {
     file {
    path  => "/home/ubuntu/*"
  }
}
filter {
	  
    json {
        source => "message"
    }
}

output {
  amazon_es {
    hosts => ["*****************************************"]
    region => "us-east-1"
    index => "stash"
    #user => "elastic"
    #password => "changeme"
  }
}
  1. when i try to run the config file this what the output i get:

[WARN ] 2020-03-24 11:15:34.878 [[main]>worker1] json - Error parsing json {:source=>"message", :raw=>"[2020-03-24 11:15:33] file_db_logger.INFO: {\"Code\":\"BGDRIF947\",\"Message\":\"Total items backup today\",\"time\":1585048533,\"userId\":\"*************\",\"businessUserId\":\"**********\",\"cloudId\":1,\"domainId\":\"****\",\"additionalInfo\":\"389,395,0\"} [] []", :exception=>#<LogStash::Json::ParserError: Unexpected character ('-' (code 45)): was expecting comma to separate Array entries

kindly help me out with this

2

That is not valid JSON. You could parse the prefix off using dissect.

3

Hi Badger, Thank for replying will try it

4

Hi

  1. Dissect dint work for me but i used this
input {
  file {
    path  => "/home/ubuntu/*"
    start_position => "beginning"
  }
}
filter {

   grok {
    match => { "message" => "(?<jsonf>({.*}))"}
  }
  json {
            source => "jsonf"
  }
  mutate {
        remove_field => [ "message","jsonf" ]
      }
}

output {
  amazon_es {
    hosts => ["***********************"]
    region => "us-east-1"
    index => "lgs-%{+YYYY.MM.dd}"
    #user => "elastic"
    #password => "changeme"
  }
}
  1. It dint show up any error says that "logstash API started successfully "
  2. But still i am not able to see up the index created in kibana . I am using AWS Elasticsearch.
  3. My server has a full permission to Elastic Search.
    So, what am i doing wrong here
5

Try put:

codec => "json" into the input

Regards,
Fadjar Tandabawana

6

Hey guys thank for you time Actually i was giving my log file path wrongly other than that the configurations works perfectly.