# Partial json results when nodes /var partitions are filled

**URL:** <https://discuss.elastic.co/t/partial-json-results-when-nodes-var-partitions-are-filled/21227>\
**Category:** Elasticsearch\
**Created:** [December 12, 2014, 1:29am UTC](https://discuss.elastic.co/t/partial-json-results-when-nodes-var-partitions-are-filled/21227 "2014-12-12T01:29:29Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Maxwell\_Spangler](https://avatars.discourse-cdn.com/v4/letter/m/f14d63/32.png) [@Maxwell\_Spangler](https://discuss.elastic.co/u/Maxwell_Spangler)\
**Post date:** [December 12, 2014, 1:29am UTC](https://discuss.elastic.co/t/partial-json-results-when-nodes-var-partitions-are-filled/21227/1 "2014-12-12T01:29:29Z")

</div>

We observed a situation recently where a large increase in the amount of  
data being ingested into ES caused log files in /var to fill to capacity on  
each node in a six node cluster.

Attempts to curl to a master VIP front-ended on the cluster would return a  
portion of the full json, but not all of it. Imagine expecting ten "pages"  
of some type of information and only receiving 2-3 when it suddenly stops.

I first saw this when manually using curl on a Linux client. I mistakenly  
thought it might be a client issue or a load balancer or proxy issue  
between me and the the cluster.

The next symptom came in the form of Elastic HQ being able to connect to  
the cluster but producing "_Error: Unable to Read Node List_".

The third symptom came from Kibana being unable to pull up any dashboards,  
timing out and proclaiming that our ES cluster was down.

Monitoring should have been enabled to monitor /var and we hadn't received  
any alerts on it, so of course we didn't think to stop and check any of the  
filesystems for out-of-space issues. After we noticed this and corrected  
the problem, all our problems went away.

_The question is: Why would /var filling cause the cluster to return  
partial json in this manner?_

Thanks,

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/45780f2b-df8d-4780-a107-bd8c6a58d325%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/45780f2b-df8d-4780-a107-bd8c6a58d325%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:44am UTC](https://discuss.elastic.co/t/partial-json-results-when-nodes-var-partitions-are-filled/21227/2 "2017-07-06T00:44:01Z")

</div>