hi there
i use tcp input > grok filter > amazon_es output > then see the logs at kibana
it works for me but yesterday i change logstash config for some patterns
then logstash can not push the logs to amazon_es domain.
when i debug flag is on, i saw input received, filter received, and i don't see output received msg
and i also saw these msg
Pushing flush onto pipeline <Thread:0x4aa71feb sleep> in logstash
PageIO recovery element index:4, readNextElement exception: Element seqNum 0 is expected to be 5..
anyone help me out??
here is my output config setting
amazon_es {
hosts => ["test-1.es.amazonaws.com"]
region => "ap-southeast-1"
aws_access_key_id => "aaa"
aws_secret_access_key => "aaaa"
# this setting controls how many events will be buffered before sending a batch of events in bulk API (default => 500)
flush_size => 50000
# the amount of time in seconds since last flush before a flush is forced (default => 1)
idle_flush_time => 10
# retry parameters
#max_retries (number, default => 3)
#retry_max_items (number, default => 5000)
#retry_max_interval (number, default => 5)
index => "logstash-%{+YYYY.MM.dd}"
}