That all works well. When I try to parse the JSON output with python I keep getting Extra data errors. I've been searching around and everything looks like it's more focused on sending logs to logstash from python.
Please link me to any work already done. Any specific trips on getting Logstash JSON output parsed by python?
What does your pipeline's output configuration look like? What codec is being used?
I presume that you're using the json_lines codec, which outputs the events as a series of newline-delimited JSON blobs; this format also called jsonlines or ndjson (Newline-Delimtied JSON).
If this is the case, when you're consuming in your python application, you'll need to split the input on the newline character before passing each chunk to a JSON parser. There is a python plugin that will do this for you called jsonlines.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.