Hi, I'm following this tutorial: Ingest data directly from Google Cloud Storage into Elastic using Google Dataflow | Elastic Blog
but when the dataflow job is running I got this error:
{"severity":"INFO","time":"2023/01/24 12:23:38.224114","line":"exec.go:38","message":"Executing: java -cp /template/gcs-to-elasticsearch/gcs-to-elasticsearch-conscrypt.jar:/template/gcs-to-elasticsearch/*:/template/gcs-to-elasticsearch/libs/*:/template/gcs-to-elasticsearch/classes com.google.cloud.teleport.v2.elasticsearch.templates.GCSToElasticsearch --delimiter=, --apiKey=YnF5NDQ0VUJ6QXdEbE1GM2YtVUQ6NmwzNGZRbmFTc09IbExSSTdnUlY0UQ== --connectionUrl=elastic-craftlabs:dXMtY2VudHJhbDEuZ2NwLmNsb3VkLmVzLmlvOjQ0MyRlNWZhM2RmYzZlNmY0YTA4OTZiMTI3YmQxZjJkOGFhMSQ0ZThmNTQwMzFkNTc0MGM0YjRjYTliNGY4MjgzOTYwNw== --serviceAccount=554339879332-compute@developer.gserviceaccount.com --templateLocation=gs://dataflow-staging-us-central1-554339879332/staging/template_launches/2023-01-24_04_22_25-6029852043322062261/job_object --stagingLocation=gs://dataflow-staging-us-central1-554339879332/staging --labels={\n \"goog-dataflow-provided-template-name\" : \"gcs_to_elasticsearch\",\n \"goog-dataflow-provided-template-type\" : \"flex\"\n}\n --inputFileSpec=gs://bucket-terra-craftlabs/2.5_month.csv --runner=DataflowRunner --project=craftlabs-sandbox --tempLocation=gs://dataflow-staging-us-central1-554339879332/tmp --index=quakes --jobName=elastic4 --region=us-central1 --deadletterTable=craftlabs-sandbox:dataflow_test.error_queue"}
{"severity":"INFO","time":"2023/01/24 12:23:46.775422","line":"exec.go:66","message":"org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 2 files. Enable logging at DEBUG level to see which files will be staged."}
{"severity":"ERROR","time":"2023/01/24 12:23:47.834478","line":"exec.go:66","message":"com.google.cloud.teleport.v2.common.UncaughtExceptionLogger - The template launch failed.\njava.lang.IllegalArgumentException: TupleTag Tag\u003ccom.google.cloud.teleport.v2.elasticsearch.templates.GCSToElasticsearch#0\u003e not found in this PCollectionTuple tuple\n\tat org.apache.beam.sdk.values.PCollectionTuple.get(PCollectionTuple.java:222)\n\tat com.google.cloud.teleport.v2.transforms.CsvConverters$LineToFailsafeJson.expand(CsvConverters.java:368)\n\tat com.google.cloud.teleport.v2.transforms.CsvConverters$LineToFailsafeJson.expand(CsvConverters.java:300)\n\tat org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)\n\tat org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)\n\tat org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:263)\n\tat
Do you have any clue? thanks in advance.