# How Elasticsearch Working With Big Data?
**URL:** https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432
**Category:** Elasticsearch
**Created:** [July 13, 2015, 10:03am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432 "2015-07-13T10:03:37Z")
**Posts on this page:** 10
**Page:** 1
### Author:  [@tvlinh](https://discuss.elastic.co/u/tvlinh)
#### Post date: [July 13, 2015, 10:03am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/1 "2015-07-13T10:03:37Z")
Hi everyone,
Can you explain me in detail how Elasticsearch working with Big Data? Elasticsearch mechanism when processing Big Data?
I'm really really need information about Elasticsearch mechanism when its processing Big Data.
Best Regards
---
### Author:  [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [July 13, 2015, 10:16am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/2 "2015-07-13T10:16:27Z")
This question is too open-ended for anyone to give you a good answer. Please try to be more specific.
---
### Author:  [@tvlinh](https://discuss.elastic.co/u/tvlinh)
#### Post date: [July 13, 2015, 10:19am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/3 "2015-07-13T10:19:45Z")
Hi @magnusbaeck,
I mean how Elasticsearch indexing, Searching, Analyzing Big Data?
I cannot find it on elastic.co page.
---
### Author:  [@colings86](https://discuss.elastic.co/u/colings86)
#### Post date: [July 13, 2015, 10:29am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/4 "2015-07-13T10:29:27Z")
Unfortunately this question is still too vague. What do you mean by 'Big Data'? This term means different things to different people. What is the requirement that you are actually needing to solve? e.g. How to get data from Hadoop into Elasticsearch?
---
### Author:  [@tvlinh](https://discuss.elastic.co/u/tvlinh)
#### Post date: [July 13, 2015, 10:38am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/5 "2015-07-13T10:38:31Z")
I only want to summarize how it processing the Big Data (huge data sets: structure and non-structure data). If you felt this question is too vague, you can give me some LINKS or DOCUMENTS for consulting ^^.
Thanks you.
---
### Author:  [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)
#### Post date: [July 13, 2015, 11:08am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/6 "2015-07-13T11:08:10Z")
The general coping strategy for "Big Data" is to use the age-old tactic of "divide and conquer".
The dividing strategy is typically called "sharding" and involves putting only a subset of your overall data onto each machine. Queries can then run in parallel on many machines and then merge the results from many smaller pots of data faster than it would take to produce the same results if you used a single machine to search one very large pot of data.
Elasticsearch is not alone in adopting this approach. For general background here's a Wikipedia article[1]
> **[Shard (database architecture)](https://en.wikipedia.org/wiki/Shard_(database_architecture))**
>
> A database shard is a horizontal partition of data in a database or search engine. Each individual partition is referred to as a shard or database shard. Each shard is held on a separate database server instance, to spread load. Some data within a database remains present in all shards,\[notes 1\] but some appears only in a single shard. Each shard (or server) acts as the single source for this subset of data.
---
### Author:  [@tvlinh](https://discuss.elastic.co/u/tvlinh)
#### Post date: [July 14, 2015, 10:29am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/7 "2015-07-14T10:29:19Z")
Thank for your helps, but i need more in formation in detail about how Elasticsearch process Big Data (Not focus on ES-Hadoop). Can anyone help me ? T.T
---
### Author:  [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [July 14, 2015, 10:35am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/8 "2015-07-14T10:35:08Z")
Please, you must understand that the question is too vague. You _will_ not get a useful answer as it stands. The _[Elasticsearch: The Definitive Guide](https://www.elastic.co/guide/en/elasticsearch/guide/current/index.html)_ book does a good job at explaining how Elasticsearch works. I suggest you start by reading it, and after a while you'll be able to ask more specific questions.
---
### Author:  [@tvlinh](https://discuss.elastic.co/u/tvlinh)
#### Post date: [July 15, 2015, 2:23am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/9 "2015-07-15T02:23:20Z")
Thanks you so much @magnusbaeck .
I understood what i need to do 😄
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 12:01am UTC](https://discuss.elastic.co/t/how-elasticsearch-working-with-big-data/25432/10 "2017-07-06T00:01:26Z")