Persistent queue breaks UTF-8 international language

my.conf:
input {
file { path => [ "/var/log/logstash/input.log" ] }
}
output {
file { path => "/var/log/logstash/output.log" }
}

input.log:
1가2나3다4

It works fine on memory queue.

logstash.yml:
path.data: /var/lib/logstash
#queue.type: persisted
path.logs: /var/log/logstash
xpack.monitoring.elasticsearch.url: http://xxxxx:9200

output.log:
{"@timestamp":"2018-05-02T02:02:53.649Z","message":"1가2나3다4","@version":"1","path":"/var/log/logstash/input.log","host":"xxxxx"}

But it looks like persisted queue breaks international language encoded by UTF-8.

logstash.yml:
path.data: /var/lib/logstash
queue.type: persisted
path.logs: /var/log/logstash
xpack.monitoring.elasticsearch.url: http://xxxxx:9200

output.log:
{"host":"xxxxx","@version":"1","path":"/var/log/logstash/input.log","@timestamp":"2018-05-02T02:01:20.209Z","message":"1가2나3다4"}

Here is the hex code of input/output.

input
output2

This is a known issue that should be fixed with 6.2.4.

Fantastic! Thank you for the response.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.