# Is ElasticSearch meant for long term storage of large datasets?
**URL:** https://discuss.elastic.co/t/is-elasticsearch-meant-for-long-term-storage-of-large-datasets/220477
**Category:** Elasticsearch
**Created:** [February 22, 2020, 9:36am UTC](https://discuss.elastic.co/t/is-elasticsearch-meant-for-long-term-storage-of-large-datasets/220477 "2020-02-22T09:36:36Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@Basman](https://discuss.elastic.co/u/Basman)
#### Post date: [February 22, 2020, 9:36am UTC](https://discuss.elastic.co/t/is-elasticsearch-meant-for-long-term-storage-of-large-datasets/220477/1 "2020-02-22T09:36:36Z")
I have users that all have hundreds of GB’s of documents (pdf, word, etc). I want to use Elastic with the ingest-attachment plugin to make the plaintext contents of these documents searchable. It’s unlikely these documents will eventually be deleted, so the dataset will mostly get bigger.
My question: is this a usecase that Elastic can safely handle? Or will I eventually run into a wall of sorts if the data set gets too big? The thing I’m mostly worried about is that searching for text will get slower if users upload too many documents.
---
### Author:  [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)
#### Post date: [February 22, 2020, 12:16pm UTC](https://discuss.elastic.co/t/is-elasticsearch-meant-for-long-term-storage-of-large-datasets/220477/2 "2020-02-22T12:16:34Z")
Hundreds of GBs is not really a "large" dataset in Elasticsearch terms; you can search [TBs of data with a single node](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster) and there are clusters out there containing PBs of data that ingest hundreds of GBs of new documents every hour.
Moreover PDFs and Word documents typically contain a lot of unsearchable overhead, so the size of the plaintext content that Elasticsearch actually sees is often many times smaller than the total file size.
I'm not saying that there are no scaling limits, of course, and this all depends on your usage pattern and performance goals too, but in terms of data size alone you're well within the comfort zone.
---
### Author:  [@Basman](https://discuss.elastic.co/u/Basman)
#### Post date: [February 22, 2020, 1:34pm UTC](https://discuss.elastic.co/t/is-elasticsearch-meant-for-long-term-storage-of-large-datasets/220477/3 "2020-02-22T13:34:16Z")
Excellent, thanks for the feedback.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 21, 2020, 1:34pm UTC](https://discuss.elastic.co/t/is-elasticsearch-meant-for-long-term-storage-of-large-datasets/220477/4 "2020-03-21T13:34:16Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.