Persistent queue breaks UTF-8 international language


#1

my.conf:
input {
file { path => [ "/var/log/logstash/input.log" ] }
}
output {
file { path => "/var/log/logstash/output.log" }
}

input.log:
1가2나3다4

It works fine on memory queue.

logstash.yml:
path.data: /var/lib/logstash
#queue.type: persisted
path.logs: /var/log/logstash
xpack.monitoring.elasticsearch.url: http://xxxxx:9200

output.log:
{"@timestamp":"2018-05-02T02:02:53.649Z","message":"1가2나3다4","@version":"1","path":"/var/log/logstash/input.log","host":"xxxxx"}

But it looks like persisted queue breaks international language encoded by UTF-8.

logstash.yml:
path.data: /var/lib/logstash
queue.type: persisted
path.logs: /var/log/logstash
xpack.monitoring.elasticsearch.url: http://xxxxx:9200

output.log:
{"host":"xxxxx","@version":"1","path":"/var/log/logstash/input.log","@timestamp":"2018-05-02T02:01:20.209Z","message":"1가2나3다4"}

Here is the hex code of input/output.

input
output2


(Ry Biesemeyer) #2

This is a known issue that should be fixed with 6.2.4.


#3

Fantastic! Thank you for the response.


(system) #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.