Hello, I am running into an issue where I am sending incorrectly formatted JSON to my logstash such that logstash throws errors about being unable to parse it. I learned about Dead Letter Queue, and now I am hoping someone can help me understand how I could send the entire bad JSON data as-is to elasticsearch. I was thinking I could use a single "message" key with a value set to the raw string of bad JSON.
My goal is to ensure I see EVERYTHING sent to logstash in Kibana even if they are malformed. The idea is that I would simply follow up with my app to correct the malformed data and in the mean time, I would not be missing messages when I am in the discover tab. I understand DLQ has the power to mutate the data so it is still usable, but as a stop-gap, I am very interested in getting the malformed data from Logstash into Elasticsearch and I am looking at DLQ to do it. Thanks!