Disk space almost filled

Elastic Stack Elasticsearch
1

Hi I have a remote elasticsearch server set up with 1 node (I cannot ssh into this)

The disk space (Total 50GB) is almost filled. Only about 1.5GB are left. But when I run _cat/indices?v&s=store.size:desc I can see that the indices only take up about 2GB.

My cluster is in red status. There are 1000s of unassigned shards. I know this is wrong. I want to delete red indices but every delete operation times out.

2

How much disk is allocated and do you know if elasticsearch is on it's own mount? It could be something besides elastic data filling your disk.

Elalsticsearch doesn't do log rotation, once you start getting a sick node, it will tend to write messages to /var/log/elasticsearch until that disk is full.

Without SSH, you [probably can't do "du -sh /* | grep G" to see what is using disk :slight_smile:

3

How can I find this out? (Although I am very sure anything else is not installed in this machine)

I don't really care about the data now. I just want to clean up this cluster. Any advice on what can I do?

4

You need a command line and probably root access. Then if my "du" command above shows /var being the largest user, repeat with "du -sh /var/* | grep G" and drill down.

5

Thanks!

Any ideas about clearing up the cluster without taking it down?

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.