Hello, I have a pipeline to update my documents with parsed url information via the uri_parts processor. However when I look at the datastream or in kibana those addition fields are absent. I checked the data in the backing indexes and it is present. I tried updating the index template in the datas…

The issue was with the mapping I had an object field set as a text field in the index template.

jessgarson (Jess Garson) July 18, 2024, 5:33pm 4

Thanks for following up, @Zachary_Joyner. Typically this error occurs when new requests were disreaged because the queue was full.

Here are some further resources that could be helpful here:

java - Error writing to Elasticsearch, some elements could not be inserted from dataflow - Stack Overflow
Ingest data with GCP Dataflow - #6 by gustafkisi

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Data in index not populating in the data view or kibana