Failed to execute pipeline for a bulk request after a successfull ingest plugin

Elastic Stack Elasticsearch
1

Hi, I made an ingest plugin for Eleasticsearch 5.4.0, the ingest plugin works well in simulate mode .
but in standard mode I have a "failed to execute pipeline for a bulk request" message in the logs after the execution of the processor.

so:

  • if I use the pipeline in simulate mode => the processor works.
  • if I don't use the pipeline ( in logstash or Dev console ) => the document is inserted.
  • if I use the pipeline ( in logstash or Dev console ) => the processor is executed but the document is not inserted. and I have the following message in the logs.

Have you any Idea what I am missing ?

[2017-08-24T18:49:23,947][ERROR][o.e.a.b.TransportBulkAction] [node_one] failed to execute pipeline for a bulk request
java.lang.NullPointerException: null
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$DateMathExpressionResolver.resolveExpression(IndexNameExpressionResolver.java:775) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.hasIndexOrAlias(IndexNameExpressionResolver.java:251) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.support.AutoCreateIndex.shouldAutoCreate(AutoCreateIndex.java:73) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.bulk.TransportBulkAction.shouldAutoCreate(TransportBulkAction.java:214) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.bulk.TransportBulkAction.doExecute(TransportBulkAction.java:160) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.bulk.TransportBulkAction.lambda$processBulkIndexIngestRequest$3(TransportBulkAction.java:526) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.ingest.PipelineExecutionService$2.doRun(PipelineExecutionService.java:98) [elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) [elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.4.0.jar:5.4.0]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
[2017-08-24T18:49:23,948][WARN ][r.suppressed             ] path: /lookup/Patient/1, params: {pipeline=lookup, index=lookup, id=1, type=Patient}
java.lang.NullPointerException: null
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$DateMathExpressionResolver.resolveExpression(IndexNameExpressionResolver.java:775) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.hasIndexOrAlias(IndexNameExpressionResolver.java:251) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.support.AutoCreateIndex.shouldAutoCreate(AutoCreateIndex.java:73) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.bulk.TransportBulkAction.shouldAutoCreate(TransportBulkAction.java:214) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.bulk.TransportBulkAction.doExecute(TransportBulkAction.java:160) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.action.bulk.TransportBulkAction.lambda$processBulkIndexIngestRequest$3(TransportBulkAction.java:526) ~[elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.ingest.PipelineExecutionService$2.doRun(PipelineExecutionService.java:98) [elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) [elasticsearch-5.4.0.jar:5.4.0]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.4.0.jar:5.4.0]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_131]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_131]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]
2

I still don't know why the "failed to execute pipeline for a bulk request" error occured but after some reorganisation of the code every thing works as expected.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.