# Load about 1 million document from elastic search in .net application using nest

**URL:** <https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188>\
**Category:** Elasticsearch\
**Created:** [September 26, 2019, 8:48am UTC](https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188 "2019-09-26T08:48:42Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Irakli](https://avatars.discourse-cdn.com/v4/letter/i/ecc23a/32.png) [@Irakli](https://discuss.elastic.co/u/Irakli)\
**Post date:** [September 26, 2019, 8:48am UTC](https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188/1 "2019-09-26T08:48:42Z")

</div>

Hi there,

I am trying to get about 1.5 million document which includes less then 6 field from elasticsearch index to .net app and it is unreachable, super slow. Is there any way to get such number of documents in real time using nest api ?

---

<div class="post-metadata">

**Author:** ![forloop](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/forloop/32/9021_2.png) [@forloop](https://discuss.elastic.co/u/forloop)\
**Post date:** [October 16, 2019, 3:13am UTC](https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188/2 "2019-10-16T03:13:35Z")

</div>

> [@Irakli](#):
>
> I am trying to get about 1.5 million document which includes less then 6 field from elasticsearch index to .net app

Are you trying to load 1.5 million documents into memory in an app?

---

<div class="post-metadata">

**Author:** ![Irakli](https://avatars.discourse-cdn.com/v4/letter/i/ecc23a/32.png) [@Irakli](https://discuss.elastic.co/u/Irakli)\
**Post date:** [October 16, 2019, 8:17am UTC](https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188/3 "2019-10-16T08:17:09Z")

</div>

Yes, because I need some joins over returned documents and elasticsearch does not have sql like temporary tables

---

<div class="post-metadata">

**Author:** ![forloop](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/forloop/32/9021_2.png) [@forloop](https://discuss.elastic.co/u/forloop)\
**Post date:** [October 16, 2019, 11:40am UTC](https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188/4 "2019-10-16T11:40:48Z")

</div>

Loading 1.5 million documents to join data in memory is going to be challenging, irrespective of the data store.

It’s possible to get 1.5 million documents out of Elasticsearch using the .NET client’s observable `ScrollAll()` helper method, but you may want to consider denormalizing the data that is being joined, to persist it with the documents.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 13, 2019, 11:40am UTC](https://discuss.elastic.co/t/load-about-1-million-document-from-elastic-search-in-net-application-using-nest/201188/5 "2019-11-13T11:40:53Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.