# Can't import data after reaching a certain amount in storage capacity

**URL:** <https://discuss.elastic.co/t/cant-import-data-after-reaching-a-certain-amount-in-storage-capacity/143874>\
**Category:** Elasticsearch\
**Created:** [August 10, 2018, 12:59pm UTC](https://discuss.elastic.co/t/cant-import-data-after-reaching-a-certain-amount-in-storage-capacity/143874 "2018-08-10T12:59:42Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![ganessen23](https://avatars.discourse-cdn.com/v4/letter/g/b5a626/32.png) [@ganessen23](https://discuss.elastic.co/u/ganessen23)\
**Post date:** [August 10, 2018, 12:59pm UTC](https://discuss.elastic.co/t/cant-import-data-after-reaching-a-certain-amount-in-storage-capacity/143874/1 "2018-08-10T12:59:42Z")

</div>

Hello guys,

I am having an issue.  
My present scenario is that I have 2 indices in my Elasticsearch instance.  
index 1==\> Used to store logs (86 000 documents/lines)  
index 2 ==\> Used to store data from a SQL Server Database (trying to import 200 millions rows)

I encounter the error below after having imported nearly 5 millions rows from the SQL server:

![image](https://us1.discourse-cdn.com/elastic/original/3X/5/f/5fb60797fa991eba366ff88cf54829b9ff596e93.jpg)

From one of the answer that I found on the forum, that is to delete the data, I still can't resolve my problem. Even after having deleted some data, the storage on the linux machine where Elasticsearch has been installed, does not appear to be reduced.

![image](https://us1.discourse-cdn.com/elastic/original/3X/d/e/de16db23c74f62c03a66571e35058c5490cbf0f6.jpg)

![image](https://us1.discourse-cdn.com/elastic/original/3X/1/d/1d0687ca9ac469d6ec6fa38ace6d8fd626f83dee.png)

As a result, I'm unabled to ingest any more data into Elasticsearch.  
So my question would be as follows:

1. By deleting the data in one of the index (index 2: 5 millions rows) using the command `delete index_name`, does it actually delete data on the physical drive???  
Or is there any cache that needs to be flushed down?

The location of the data files: `/var/lib/elasticsearch`

![image](https://us1.discourse-cdn.com/elastic/original/3X/3/b/3b65949d8ddcda78c48d5a12865b296a9df13e10.png)

Note:  
I have not found any accumulation of large logs generated due to error generated which could be causing this rise in storage used:

Logs of Logstash:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/4/e/4e9296f5178826a73e5897d3b2b02410fd6c93a7.png)

Logs of kibana:

![image](https://us1.discourse-cdn.com/elastic/original/3X/1/b/1b4db72144fbcf2b6b7ce61be075e455dbc7ad87.png)

Logs of elasticsearch:

```
root@AZEMEAPCRMDOS02:/var/log/elasticsearch# ls -sh
total 885M
4.0K elasticsearch-2018-03-28-1.log.gz 304K elasticsearch-2018-05-25-1.log.gz 508K elasticsearch-2018-07-19-1.log.gz 1.1M elasticsearch-2018-08-09-36.log.gz
4.0K elasticsearch-2018-03-29-1.log.gz 508K elasticsearch-2018-05-26-1.log.gz 504K elasticsearch-2018-07-20-1.log.gz 1.1M elasticsearch-2018-08-09-37.log.gz
4.0K elasticsearch-2018-03-30-1.log.gz 260K elasticsearch-2018-05-27-1.log.gz 504K elasticsearch-2018-07-21-1.log.gz 1.1M elasticsearch-2018-08-09-38.log.gz
4.0K elasticsearch-2018-03-31-1.log.gz 400K elasticsearch-2018-05-28-1.log.gz 512K elasticsearch-2018-07-22-1.log.gz 1.1M elasticsearch-2018-08-09-39.log.gz
4.0K elasticsearch-2018-04-01-1.log.gz 516K elasticsearch-2018-05-29-1.log.gz 508K elasticsearch-2018-07-23-1.log.gz 1.1M elasticsearch-2018-08-09-4.log.gz
4.0K elasticsearch-2018-04-02-1.log.gz 520K elasticsearch-2018-05-30-1.log.gz 508K elasticsearch-2018-07-24-1.log.gz 456K elasticsearch-2018-08-09-40.log.gz
4.0K elasticsearch-2018-04-03-1.log.gz 508K elasticsearch-2018-05-31-1.log.gz 508K elasticsearch-2018-07-25-1.log.gz 1.1M elasticsearch-2018-08-09-5.log.gz
 12K elasticsearch-2018-04-04-1.log.gz 504K elasticsearch-2018-06-01-1.log.gz 504K elasticsearch-2018-07-26-1.log.gz 1.1M elasticsearch-2018-08-09-6.log.gz
4.0K elasticsearch-2018-04-05-1.log.gz 504K elasticsearch-2018-06-02-1.log.gz 508K elasticsearch-2018-07-27-1.log.gz 1.1M elasticsearch-2018-08-09-7.log.gz
4.0K elasticsearch-2018-04-06-1.log.gz 508K elasticsearch-2018-06-03-1.log.gz 508K elasticsearch-2018-07-28-1.log.gz 1.1M elasticsearch-2018-08-09-8.log.gz
4.0K elasticsearch-2018-04-07-1.log.gz 508K elasticsearch-2018-06-04-1.log.gz 508K elasticsearch-2018-07-29-1.log.gz 1.1M elasticsearch-2018-08-09-9.log.gz
4.0K elasticsearch-2018-04-08-1.log.gz 508K elasticsearch-2018-06-05-1.log.gz 504K elasticsearch-2018-07-30-1.log.gz 1.1M elasticsearch-2018-08-10-1.log.gz
4.0K elasticsearch-2018-04-09-1.log.gz 500K elasticsearch-2018-06-06-1.log.gz 508K elasticsearch-2018-07-31-1.log.gz 904K elasticsearch-2018-08-10-10.log.gz
4.0K elasticsearch-2018-04-10-1.log.gz 504K elasticsearch-2018-06-07-1.log.gz 224K elasticsearch-2018-08-01-1.log.gz 1.1M elasticsearch-2018-08-10-11.log.gz
4.0K elasticsearch-2018-04-11-1.log.gz 508K elasticsearch-2018-06-08-1.log.gz 4.0K elasticsearch-2018-08-02-1.log.gz 1.1M elasticsearch-2018-08-10-12.log.gz
8.0K elasticsearch-2018-04-12-1.log.gz 508K elasticsearch-2018-06-09-1.log.gz 4.0K elasticsearch-2018-08-03-1.log.gz 1.1M elasticsearch-2018-08-10-13.log.gz
4.0K elasticsearch-2018-04-13-1.log.gz 504K elasticsearch-2018-06-10-1.log.gz 4.0K elasticsearch-2018-08-04-1.log.gz 82M elasticsearch-2018-08-10-14.log

```

Kind regards,  
Ganessen

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [August 10, 2018, 1:34pm UTC](https://discuss.elastic.co/t/cant-import-data-after-reaching-a-certain-amount-in-storage-capacity/143874/2 "2018-08-10T13:34:59Z")

</div>

> [@ganessen23](#):
>
> By deleting the data in one of the index (index 2: 5 millions rows) using the command `delete index_name` , does it actually delete data on the physical drive???

Yes.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 7, 2018, 1:35pm UTC](https://discuss.elastic.co/t/cant-import-data-after-reaching-a-certain-amount-in-storage-capacity/143874/3 "2018-09-07T13:35:02Z")

</div>

Closed on September 7, 2018, 1:35pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
