Logstash 6.3.2: sqs to bq output error

Elastic Stack Logstash
1

Hello
I am trying to push data to BQ from sqs
I have below configuration in logstash file

json
{
source => "Message"
target => "parsed"
}
split {
field => "parsed"
}
mutate{
rename => { "[parsed][timestamp]" => "mytime" }
gsub => ["mytime","T"," "]
gsub => ["mytime","Z",""]
gsub => ["mytime"," \w+[:]\w+[:]\w+.\w+",""]
add_field => { "_PARTITIONTIME" => "%{mytime}" }
}

I am sending this data to BQ but every time run into below issue

[2018-08-30T17:49:36,518][WARN ][logstash.outputs.googlebigquery] Error while inserting {:key=>0, :location=>"_partitiontime", :message=>"no such field.", :reason=>"invalid"}

please suggest what could be the problem here?

Thanks

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.