# Elasticsearch indexing with bulkprocessor, got broken pipeline

**URL:** <https://discuss.elastic.co/t/elasticsearch-indexing-with-bulkprocessor-got-broken-pipeline/292918>\
**Category:** Elasticsearch\
**Created:** [December 25, 2021, 5:41pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-with-bulkprocessor-got-broken-pipeline/292918 "2021-12-25T17:41:46Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Derrick](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/derrick/32/49944_2.png) [@Derrick](https://discuss.elastic.co/u/Derrick)\
**Post date:** [December 25, 2021, 5:41pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-with-bulkprocessor-got-broken-pipeline/292918/1 "2021-12-25T17:41:46Z")

</div>

anyone can tell me why I am getting this error when I index 140K data to Elasticsearch, our document is very huge, maybe 10M/doc, and each document has a few hundres fields.

```auto
INFO [12:32:59.351] [][User:none] [pool-14-thread-2] b.g.d.s.t.e.e.BulkProcessorManager - Executing bulk [1] with 344 requests
ERROR [12:33:01.085] [][User:none] [I/O dispatcher 40] b.g.d.s.t.e.e.ElasticSearchFactory - Couldn't initialize Low Level Rest Client on host: ******
ERROR [12:33:01.085] [][User:none] [I/O dispatcher 40] b.g.d.s.t.e.e.BulkProcessorManager - Failed to execute bulk, error:{}
java.io.IOException: Broken pipe
        at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
        at sun.nio.ch.IOUtil.write(IOUtil.java:65)
        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
        at org.apache.http.impl.nio.codecs.AbstractContentEncoder.doWriteChunk(AbstractContentEncoder.java:171)
        at org.apache.http.impl.nio.codecs.AbstractContentEncoder.doWriteChunk(AbstractContentEncoder.java:164)
        at org.apache.http.impl.nio.codecs.AbstractContentEncoder.writeToChannel(AbstractContentEncoder.java:138)
        at org.apache.http.impl.nio.codecs.LengthDelimitedEncoder.write(LengthDelimitedEncoder.java:130)
        at org.apache.http.nio.entity.NByteArrayEntity.produceContent(NByteArrayEntity.java:135)
        at org.apache.http.nio.protocol.BasicAsyncRequestProducer.produceContent(BasicAsyncRequestProducer.java:125)
        at org.apache.http.impl.nio.client.MainClientExec.produceContent(MainClientExec.java:262)
        at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.produceContent(DefaultClientExchangeHandlerImpl.java:136)
        at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.outputReady(HttpAsyncRequestExecutor.java:241)
        at org.apache.http.impl.nio.DefaultNHttpClientConnection.produceOutput(DefaultNHttpClientConnection.java:290)
        at org.apache.http.impl.nio.client.InternalIODispatch.onOutputReady(InternalIODispatch.java:86)
        at org.apache.http.impl.nio.client.InternalIODispatch.onOutputReady(InternalIODispatch.java:39)
        at org.apache.http.impl.nio.reactor.AbstractIODispatch.outputReady(AbstractIODispatch.java:145)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.writable(BaseIOReactor.java:188)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:341)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588)
        at java.lang.Thread.run(Thread.java:745)

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 22, 2022, 5:41pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-with-bulkprocessor-got-broken-pipeline/292918/2 "2022-01-22T17:41:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.