# Logstash is not able to send complete data

**URL:** <https://discuss.elastic.co/t/logstash-is-not-able-to-send-complete-data/208986>\
**Category:** Logstash\
**Created:** [November 21, 2019, 10:10pm UTC](https://discuss.elastic.co/t/logstash-is-not-able-to-send-complete-data/208986 "2019-11-21T22:10:52Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Avinaba\_Ghosh\_Hajra](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/avinaba_ghosh_hajra/32/57697_2.png) [@Avinaba\_Ghosh\_Hajra](https://discuss.elastic.co/u/Avinaba_Ghosh_Hajra)\
**Post date:** [November 21, 2019, 10:10pm UTC](https://discuss.elastic.co/t/logstash-is-not-able-to-send-complete-data/208986/1 "2019-11-21T22:10:52Z")

</div>

Logstash is running with a pipeline from command line with w = 1.  
After successfully starting, it sends some data successfully to elasticsearch. But after sending dome data it will not able so send the data with the following error

`[2019-11-22T00:00:13,210][WARN][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://xxxxx:9210/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://xxxxxx:9210/][Manticore::ConnectTimeout] connect timed out"}`

And in the server where the elasticsearch's nodes are running having less amount of memory left. (Only 270 -350 MB Primary memory)  
Can any one tell me how to avoid this issue so that logstash can send data to elasticsearch continuously.

I have done  
[http://xxxxxxx:9200/\_nodes/thread\_pool](http://xxxxxxx:9200/_nodes/thread_pool) and got the following result

```
      "thread_pool": {
                "watcher": {
                    "type": "fixed",
                    "min": 20,
                    "max": 20,
                    "queue_size": 1000
                },
                "force_merge": {
                    "type": "fixed",
                    "min": 1,
                    "max": 1,
                    "queue_size": -1
                },
                "security-token-key": {
                    "type": "fixed",
                    "min": 1,
                    "max": 1,
                    "queue_size": 1000
                },
                "ml_datafeed": {
                    "type": "fixed",
                    "min": 20,
                    "max": 20,
                    "queue_size": 200
                },
                "fetch_shard_started": {
                    "type": "scaling",
                    "min": 1,
                    "max": 8,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "listener": {
                    "type": "fixed",
                    "min": 2,
                    "max": 2,
                    "queue_size": -1
                },
                "ml_autodetect": {
                    "type": "fixed",
                    "min": 80,
                    "max": 80,
                    "queue_size": 80
                },
                "index": {
                    "type": "fixed",
                    "min": 4,
                    "max": 4,
                    "queue_size": 200
                },
                "refresh": {
                    "type": "scaling",
                    "min": 1,
                    "max": 2,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "generic": {
                    "type": "scaling",
                    "min": 4,
                    "max": 128,
                    "keep_alive": "30s",
                    "queue_size": -1
                },
                "rollup_indexing": {
                    "type": "fixed",
                    "min": 4,
                    "max": 4,
                    "queue_size": 4
                },
                "warmer": {
                    "type": "scaling",
                    "min": 1,
                    "max": 2,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "search": {
                    "type": "fixed_auto_queue_size",
                    "min": 7,
                    "max": 7,
                    "queue_size": 1000
                },
                "ccr": {
                    "type": "fixed",
                    "min": 32,
                    "max": 32,
                    "queue_size": 100
                },
                "flush": {
                    "type": "scaling",
                    "min": 1,
                    "max": 2,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "fetch_shard_store": {
                    "type": "scaling",
                    "min": 1,
                    "max": 8,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "management": {
                    "type": "scaling",
                    "min": 1,
                    "max": 5,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "ml_utility": {
                    "type": "fixed",
                    "min": 80,
                    "max": 80,
                    "queue_size": 500
                },
                "get": {
                    "type": "fixed",
                    "min": 4,
                    "max": 4,
                    "queue_size": 1000
                },
                "analyze": {
                    "type": "fixed",
                    "min": 1,
                    "max": 1,
                    "queue_size": 16
                },
                "write": {
                    "type": "fixed",
                    "min": 4,
                    "max": 4,
                    "queue_size": 200
                },
                "snapshot": {
                    "type": "scaling",
                    "min": 1,
                    "max": 2,
                    "keep_alive": "5m",
                    "queue_size": -1
                },
                "search_throttled": {
                    "type": "fixed_auto_queue_size",
                    "min": 1,
                    "max": 1,
                    "queue_size": 100
                }
            }
```

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 22, 2019, 6:10am UTC](https://discuss.elastic.co/t/logstash-is-not-able-to-send-complete-data/208986/2 "2019-11-22T06:10:41Z")

</div>

How much resources does your Elasticsearch node have? How much indices, shards and data does it hold? Is there anything in the Elasticsearch logs that explain the problems it seems to be having?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 20, 2019, 6:12am UTC](https://discuss.elastic.co/t/logstash-is-not-able-to-send-complete-data/208986/3 "2019-12-20T06:12:21Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.