Hello, I have been trying to ingest an XML file into Elastic using Logstash. I have been using Xpath, target, source in the XML filter options and gsub for mutate filter, however, I keep running into an Error parsing xml with XmlSimple....ParseException: Missing end tag for ' '. How does one proper…

Sure here is the XML. In between the there are more with the exact same fields as the ones above. Different values of course but with pretty much the exact same format. Exact same number of fields. (View Down Below)

Please do not post pictures of text, just post the text.

> <?xml version="1.0" encoding="utf-8"?> <PlanRequests> <Header export_date="25-Jun-2018 18:00" query="test_query extents"/> <ChgTestRev test_id="TD-TD-00000004" test_rev="001" type="TT-TD" status="TEst" url="https://test.some.com/test/#com.company.more.testfx.test.write.showObject;nid=tgERGEs…

Even though it has an extra "> " at the beginning, I have no problem parsing that using an xml filter. xml { source => "message" target => "theXML" }

Is that regardless of any other xml filter options?

I'm getting this error, it's not creating the index: [2019-05-31T10:47:20,937][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=>500, :url=>" http://localhost:9200/_xpack/monitoring/_bulk?system_id=logstash&system_api_version=2&interva…

If logstash is seeing a 500 error from elasticsearch I would expect there to be a more informative error message in the elasticsearch logs.

[2019-05-31T10:49:44,085][WARN ][o.e.x.m.e.l.LocalExporter] unexpected error while indexing monitoring document org.elasticsearch.xpack.monitoring.exporter.ExportException: ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];] at org.elasticsearch.xpack.monitoring…

What's the rest of your pipeline look like. The error says forbidden, im thinking your output may be incorrect.

Discuss the Elastic Stack

How to properly read and ingest XML file into Elastic

Elastic Stack Logstash

system (system) Closed June 28, 2019, 3:41pm 16

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Parsing XML files using LogStash Logstash	14	21372	July 6, 2017
Indexing data in elasticsearch through logstash using xml files Logstash	5	381	December 25, 2018
XML on Elasticsearch Logstash	10	839	August 29, 2018
Import xml file in to Elasticsearch through logstash Logstash	5	5585	January 3, 2017
Log file parsing and ingesting into ES Logstash	15	1739	October 6, 2020

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

How to properly read and ingest XML file into Elastic

Related topics