# Unable to locate data ingestion logs to debug GCP Dataflow errors

**URL:** https://discuss.elastic.co/t/unable-to-locate-data-ingestion-logs-to-debug-gcp-dataflow-errors/296667
**Category:** Elasticsearch
**Created:** [February 8, 2022, 10:36pm UTC](https://discuss.elastic.co/t/unable-to-locate-data-ingestion-logs-to-debug-gcp-dataflow-errors/296667 "2022-02-08T22:36:28Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![reza1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/reza1/32/101555_2.png) [@reza1](https://discuss.elastic.co/u/reza1)
#### Post date: [February 8, 2022, 10:36pm UTC](https://discuss.elastic.co/t/unable-to-locate-data-ingestion-logs-to-debug-gcp-dataflow-errors/296667/1 "2022-02-08T22:36:28Z")

</div>

Hello, I'm trying to debug an issue with a GCP Dataflow job which inserts documents into an index.

I get the following errors from GCP Dataflow:

```auto
java.io.IOException: Error writing to Elasticsearch, some elements could not be inserted:  
com.google.cloud.teleport.v2.elasticsearch.utils.ElasticsearchIO.checkForErrors(ElasticsearchIO.java:231)  
com.google.cloud.teleport.v2.elasticsearch.utils.ElasticsearchIO$Write$WriteFn.flushBatch(ElasticsearchIO.java:1483)
com.google.cloud.teleport.v2.elasticsearch.utils.ElasticsearchIO$Write$WriteFn.processElement(ElasticsearchIO.java:1442)

```

I've been trying to follow [this thread](https://discuss.elastic.co/t/ingest-data-with-gcp-dataflow/294046) to debug my issue, but I can't find any data logs in Observability - Logs. How can I find the log messages that show either the documents being inserted in my index or the error messages when a document is not inserted?

I have logging enabled on my instances, and I've even turned on audit logging for Elasticsearch and kibana. I've also tried streaming my logs and running a successful dataflow job that inserts data, but I don't see any log statements that show up as a result of the job.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 8, 2022, 10:37pm UTC](https://discuss.elastic.co/t/unable-to-locate-data-ingestion-logs-to-debug-gcp-dataflow-errors/296667/2 "2022-03-08T22:37:17Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.