# ERR Failed to Perform Many Index Operations

**URL:** <https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [November 3, 2015, 11:35pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684 "2015-11-03T23:35:20Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![jbiggley](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jbiggley/32/5643_2.png) [@jbiggley](https://discuss.elastic.co/u/jbiggley)\
**Post date:** [November 3, 2015, 11:35pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/1 "2015-11-03T23:35:20Z")

</div>

We're trying to get filebeat to run on our logstash host to test the ingestion of logs but we keep getting the same error regardless of the config. I've pasted the config file we are using below which results in the error

output.go:287: ERR Failed to perform many index operations in a single API call: PerformRequest fails: Sending the request fails: Post [http://localhost:5173/\_bulk:](http://localhost:5173/_bulk:) EOF

Any ideas?

```
filebeat:

  prospectors:
    -
      paths:
        - "/var/log/messages"
      type: log
      scan_frequency: 10s
  registry_file: /var/lib/filebeat/registry

  config_dir: /etc/filebeat/prospector_configs

output:

  elasticsearch:
    enabled: false

  logstash:
    enabled: true
    hosts: ["localhost:5173"]

  file:
    enabled: false
    path: "/tmp/filebeat"
    filename: filebeat.log
    rotate_every_kb: 10000

shipper:
```

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [November 4, 2015, 12:31am UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/2 "2015-11-04T00:31:20Z")

</div>

I'd check your ES logs, it may be rejecting things and if so it should mention something about threadpools and queue capacity.

---

<div class="post-metadata">

**Author:** ![tudor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tudor/32/3753_2.png) [@tudor](https://discuss.elastic.co/u/tudor)\
**Post date:** [November 4, 2015, 10:36am UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/3 "2015-11-04T10:36:31Z")

</div>

Something is strange here. You config shows that the logstash output is enabled, but the log message indicates that the elasticsearch output is used. I suspect there's something wrong with the YAML file, can you try complete removing the elasticsearch section and see if it helps?

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [November 4, 2015, 12:11pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/4 "2015-11-04T12:11:35Z")

</div>

it even uses the hosts configured in logstash output when trying to connect to elasticsearch.

---

<div class="post-metadata">

**Author:** ![jbiggley](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jbiggley/32/5643_2.png) [@jbiggley](https://discuss.elastic.co/u/jbiggley)\
**Post date:** [November 5, 2015, 2:07pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/5 "2015-11-05T14:07:34Z")

</div>

Thanks @tudor, I made some minor changes to the config. First, I did set up an input on the logstash server using the beats input plugin instead of lumberjack. I also changed the port from the lumberjack default port to 5044.

The input (on the same server) takes the filebeat input and dumps it to a lumberjack output which (as odd as this feels) sends it to a lumberjack input/redis output on the same server for shipping to redis. That feels like an extra step to me, but it works.

filebeat:  
prospectors:  
-  
paths:  
- "/var/log/messages"  
type: log  
scan\_frequency: 10s  
registry\_file: var/lib/filebeat/registry  
output:  
elasticsearch:  
enabled: false  
logstash:  
enabled: true  
hosts: ["localhost:5044"]  
shipper:

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [November 5, 2015, 3:36pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/6 "2015-11-05T15:36:21Z")

</div>

huh, so you config goes like this:

filebeat ---(lumberjack v2)---\> logstash ----(lumberjack v1)----\> logstash ----- (redis API) ----\> redis

---

<div class="post-metadata">

**Author:** ![jbiggley](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jbiggley/32/5643_2.png) [@jbiggley](https://discuss.elastic.co/u/jbiggley)\
**Post date:** [November 9, 2015, 11:45pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/7 "2015-11-09T23:45:04Z")

</div>

No lumberjack version 2 is the mix.

Our environment goes filebeat to a logstash-based filebeat input which we then output via to Redis via a Redis output.

If it matters, we then have dual-LS boxes in AWS where we pull from then Redis queue and shove into a 3 server ES cluster.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 9:58pm UTC](https://discuss.elastic.co/t/err-failed-to-perform-many-index-operations/33684/8 "2017-07-05T21:58:19Z")

</div>


