# Elasticsearch as a primary storage

**URL:** <https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196>\
**Category:** Elasticsearch\
**Created:** [November 25, 2021, 3:27pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196 "2021-11-25T15:27:42Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![xtapodi](https://avatars.discourse-cdn.com/v4/letter/x/d07c76/32.png) [@xtapodi](https://discuss.elastic.co/u/xtapodi)\
**Post date:** [November 25, 2021, 3:27pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/1 "2021-11-25T15:27:42Z")

</div>

We have lots of users(30-200 million). Each user has N(30-100) attributes. The attribute can be of type integer, text, timestamp or counter. Schema is not defined.

We are looking for a database to which we can index and retrieve(GET API) users in the most efficient way(low response time). We also have the requirement to search for users but this is out of this topic. We also need to have strong consistent and high available data.

I already know that GET API provides consistent data, but I'm not sure if Elasticsearch is the right choice for this case. We have tried Cassandra but the read performance was low(high disk IOPS).

---

<div class="post-metadata">

**Author:** ![DineshNaik](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dineshnaik/32/89308_2.png) [@DineshNaik](https://discuss.elastic.co/u/DineshNaik)\
**Post date:** [November 25, 2021, 4:11pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/2 "2021-11-25T16:11:16Z")

</div>

Please read this

> [@Elasticsearch as a primary database](https://discuss.elastic.co/t/elasticsearch-as-a-primary-database/85733/13):
>
> No. Not completely. Some shards might be missing. Not all. It depends but it might be hard to recover from that situation. Depending on how the RED actually occurred. The one I already pasted: Some customers use Elasticsearch as a primary datastore, some set-up comprehensive back-up solutions using features such as our Snapshot and Restore, while others use Elasticsearch in conjunction with a data storage system like Hadoop or even flat files. Elasticsearch can be used for so many differe…

You will get an idea!

---

<div class="post-metadata">

**Author:** ![xtapodi](https://avatars.discourse-cdn.com/v4/letter/x/d07c76/32.png) [@xtapodi](https://discuss.elastic.co/u/xtapodi)\
**Post date:** [November 25, 2021, 4:25pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/3 "2021-11-25T16:25:08Z")

</div>

Thanks DineshNaik. I have already read this answer. My question is more about performance.

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [November 25, 2021, 4:53pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/4 "2021-11-25T16:53:54Z")

</div>

Hi @xtapodi Welcome to the community and Thanks for considering Elasticsearch.

Elasticsearch when configured correctly (hardware software and index strategy) is highly performant We would need to learn a little bit about what you're trying to do.

even 200 million records with the 100 attributes each is still a relatively small data set with respect to Elasticsearch.

I know you said no schema but there will be a schema whether you set it or not and then with proper queries you should be able to query across that entire data set with highly performant low latency queries.

I would suggest setting up the a node or a cluster or better yet just try a [Elastic Cloud](https://www.elastic.co/cloud/) and do some testing.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [November 25, 2021, 9:47pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/5 "2021-11-25T21:47:33Z")

</div>

> [@DineshNaik](#):
>
> Please read this

That's nearly 5 years old. I'd encourage you to read up on resilience changes that have been made since then.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 26, 2021, 4:17am UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/6 "2021-11-26T04:17:42Z")

</div>

Ha! Right. I wrote this answer a looong time ago and all the great work about sequence numbers and resilience have been done since then.

IMO the source of truth (which is always up to date) is [Elasticsearch Resiliency Status | Elastic](https://www.elastic.co/guide/en/elasticsearch/resiliency/current/index.html)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 24, 2021, 4:18am UTC](https://discuss.elastic.co/t/elasticsearch-as-a-primary-storage/290196/7 "2021-12-24T04:18:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
