# Localized data with Shard Knowledge

**URL:** <https://discuss.elastic.co/t/localized-data-with-shard-knowledge/18734>\
**Category:** Elasticsearch\
**Created:** [July 18, 2014, 12:35pm UTC](https://discuss.elastic.co/t/localized-data-with-shard-knowledge/18734 "2014-07-18T12:35:36Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [July 18, 2014, 12:35pm UTC](https://discuss.elastic.co/t/localized-data-with-shard-knowledge/18734/1 "2014-07-18T12:35:36Z")

</div>

Hi,

I have a query about using ElasticSearch.

I have part of my data (about 90%) to be indexed in ElasticSearch and the  
remaining 10% to be stored elsewhere (like a DB/NoSQL DB etc.) since that  
10% data will be very frequently changing data.

I have the following queries:

1.] Should I be keeping the remaining 10% of my data on non-ES/Lucene  
persistent store? Is it okay to store/index those fields in ES/Lucene even  
if they are frequently updating? With NRT readers, will it be efficient at  
reflecting changes and perform at par when I have to search for those  
changes in different threads?

2.] Is there any concept of localization in ES? Can I segregate my data  
based on some logical partition and apply filters and search only on that  
subsection? Not sure how shard routing works, but if I route search  
requests to multiple shards using SearchRequestBuilder, how do I aggregate  
the results from multiple shards? Probably this is not the solution I am  
looking for. My use case is to not worry too much about how ES is  
organizing my data, but I still want to set specific filters for data that  
will exist on a corresponding shard. If this is confusing, please let me  
know, and I will rephrase.

Thanks,  
Sandeep

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/f6dcfbb2-f065-43f7-9e0d-bfc5e3be43a3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/f6dcfbb2-f065-43f7-9e0d-bfc5e3be43a3%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:14am UTC](https://discuss.elastic.co/t/localized-data-with-shard-knowledge/18734/2 "2017-07-06T01:14:57Z")

</div>


