# ElasticSearch - many data - can ES handle it?

**URL:** <https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338>\
**Category:** Elasticsearch\
**Created:** [August 30, 2016, 4:21pm UTC](https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338 "2016-08-30T16:21:55Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![uncleBens](https://avatars.discourse-cdn.com/v4/letter/u/a9a28c/32.png) [@uncleBens](https://discuss.elastic.co/u/uncleBens)\
**Post date:** [August 30, 2016, 4:21pm UTC](https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338/1 "2016-08-30T16:21:55Z")

</div>

I have Events entity in my database. Event looks like this:

`ID, NAME, DATE, CITY`

Now.. I integrated ElasticSearch JavaAPI to my application.  
There are millions of events in database.

So after typing New in searchbox I want to search events and display them grouped by cities.

Questions:

1. Is it possible to query ElasticSearch for such data structure having only such document sturture: Events(ID, NAME, DATE, CITY) indexed ?

2. Should ElasticSearch have Events(ID, NAME, DATE, CITY) records indexed or some more complicated documents, ready for display?

There are 1,5millions of new events daily..

---

<div class="post-metadata">

**Author:** ![abeyad](https://avatars.discourse-cdn.com/v4/letter/a/278dde/32.png) [@abeyad](https://discuss.elastic.co/u/abeyad)\
**Post date:** [August 30, 2016, 6:01pm UTC](https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338/2 "2016-08-30T18:01:42Z")

</div>

> [@uncleBens](#):
>
> 1. Is it possible to query Elasticsearch for such data structure having only such document sturture: Events(ID, NAME, DATE, CITY) indexed ?

ES should be able to readily handle such a workload but of course it depends on your hardware characteristics, how many nodes, etc. You will want to experiment and profile with your data. For suggesters, you will want to look at the suggester API: [Suggesters | Elasticsearch Guide [8.11] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/search-suggesters.html)

> [@uncleBens](#):
>
> 1. Should Elasticsearch have Events(ID, NAME, DATE, CITY) records indexed or some more complicated documents, ready for display?

I don't follow the question. You should have fields on your documents that are pertinent for searching and retrieving from Elasticsearch. Its up to your application's needs what information would be important to store for each event.

---

<div class="post-metadata">

**Author:** ![uncleBens](https://avatars.discourse-cdn.com/v4/letter/u/a9a28c/32.png) [@uncleBens](https://discuss.elastic.co/u/uncleBens)\
**Post date:** [August 30, 2016, 7:08pm UTC](https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338/3 "2016-08-30T19:08:40Z")

</div>

Thanks for your answer. I didn't know the suggesters.

Generally I wonder what to put into ES index. It depends on ES capabilities and best practice / experience which I don't have yet.

---

<div class="post-metadata">

**Author:** ![abeyad](https://avatars.discourse-cdn.com/v4/letter/a/278dde/32.png) [@abeyad](https://discuss.elastic.co/u/abeyad)\
**Post date:** [August 30, 2016, 7:25pm UTC](https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338/4 "2016-08-30T19:25:37Z")

</div>

You will want to read up on these sections of the guide at minimum:

[https://www.elastic.co/guide/en/elasticsearch/guide/current/capacity-planning.html](https://www.elastic.co/guide/en/elasticsearch/guide/current/capacity-planning.html)

[https://www.elastic.co/guide/en/elasticsearch/guide/current/modeling-your-data.html](https://www.elastic.co/guide/en/elasticsearch/guide/current/modeling-your-data.html)

In general, there is no better way than to experiment and determine what your capacity needs to be. ES is used by many organizations to handle more events than that per day, but it depends on document size, structure, hardware, query characteristics, etc. etc.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:23pm UTC](https://discuss.elastic.co/t/elasticsearch-many-data-can-es-handle-it/59338/5 "2017-07-05T22:23:54Z")

</div>