# How is data stored

**URL:** <https://discuss.elastic.co/t/how-is-data-stored/21446>\
**Category:** Elasticsearch\
**Created:** [January 1, 2015, 3:36am UTC](https://discuss.elastic.co/t/how-is-data-stored/21446 "2015-01-01T03:36:27Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![bkamiche](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bkamiche/32/14559_2.png) [@bkamiche](https://discuss.elastic.co/u/bkamiche)\
**Post date:** [January 1, 2015, 3:36am UTC](https://discuss.elastic.co/t/how-is-data-stored/21446/1 "2015-01-01T03:36:27Z")

</div>

Hello, I'm new in using elasticsearch, so maybe this is a basic question...

Is there any way to see how is the text "stored" or at least how it would  
look once the filters defined for a field (in the analyzer) are applied?

I know that the actual field is stored "as is", and the filters are  
considered for indexing purposes, but i want to see what is the result of  
that operation.

Why do I ask this, the reason is that I'm applying filters to a field (for  
example removing urls), and performing aggregations on that field, but the  
aggregations return "http" as a used word, and guess that is not correct,  
as it shall be removed...

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [January 1, 2015, 4:26am UTC](https://discuss.elastic.co/t/how-is-data-stored/21446/2 "2015-01-01T04:26:06Z")

</div>

Use the analyze API to get a view into how your analysis chain (tokenizer  
and filters) affect text.

The index itself is all jumbled together with all the documents and there  
isn't a good way to dig the data for a single document out of it.  
On Dec 31, 2014 10:36 PM, "Bruno Kamiche" [bkamiche@gmail.com](mailto:bkamiche@gmail.com) wrote:

> Hello, I'm new in using elasticsearch, so maybe this is a basic question...
> 
> Is there any way to see how is the text "stored" or at least how it would  
> look once the filters defined for a field (in the analyzer) are applied?
> 
> I know that the actual field is stored "as is", and the filters are  
> considered for indexing purposes, but i want to see what is the result of  
> that operation.
> 
> Why do I ask this, the reason is that I'm applying filters to a field (for  
> example removing urls), and performing aggregations on that field, but the  
> aggregations return "http" as a used word, and guess that is not correct,  
> as it shall be removed...
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0O%3D3YV17kxuRVxYLX3na-CXYFFhW28wtDveNb2LDutSQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0O%3D3YV17kxuRVxYLX3na-CXYFFhW28wtDveNb2LDutSQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [January 1, 2015, 4:09pm UTC](https://discuss.elastic.co/t/how-is-data-stored/21446/3 "2015-01-01T16:09:16Z")

</div>

Beside analyze API, the explain API in the query can tell why a document  
has been included into the result set, and allows conclusions about the  
terms how they are stored in the index.

> **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)**
>
> Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today.

Jörg

On Thu, Jan 1, 2015 at 5:26 AM, Nikolas Everett [nik9000@gmail.com](mailto:nik9000@gmail.com) wrote:

> Use the analyze API to get a view into how your analysis chain (tokenizer  
> and filters) affect text.
> 
> The index itself is all jumbled together with all the documents and there  
> isn't a good way to dig the data for a single document out of it.  
> On Dec 31, 2014 10:36 PM, "Bruno Kamiche" [bkamiche@gmail.com](mailto:bkamiche@gmail.com) wrote:
> 
> > Hello, I'm new in using elasticsearch, so maybe this is a basic  
> > question...
> > 
> > Is there any way to see how is the text "stored" or at least how it would  
> > look once the filters defined for a field (in the analyzer) are applied?
> > 
> > I know that the actual field is stored "as is", and the filters are  
> > considered for indexing purposes, but i want to see what is the result of  
> > that operation.
> > 
> > Why do I ask this, the reason is that I'm applying filters to a field  
> > (for example removing urls), and performing aggregations on that field, but  
> > the aggregations return "http" as a used word, and guess that is not  
> > correct, as it shall be removed...
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com)  
> > [https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/841f7899-a45f-4b19-bc05-6e156f76777a%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > .  
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0O%3D3YV17kxuRVxYLX3na-CXYFFhW28wtDveNb2LDutSQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0O%3D3YV17kxuRVxYLX3na-CXYFFhW28wtDveNb2LDutSQ%40mail.gmail.com)  
> [https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0O%3D3YV17kxuRVxYLX3na-CXYFFhW28wtDveNb2LDutSQ%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAPmjWd0O%3D3YV17kxuRVxYLX3na-CXYFFhW28wtDveNb2LDutSQ%40mail.gmail.com?utm_medium=email&utm_source=footer)  
> .
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHEQO1jf-8xxwFd2ZCdm3zrraPUBEBuGXgLwYrje9Jmgg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHEQO1jf-8xxwFd2ZCdm3zrraPUBEBuGXgLwYrje9Jmgg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![bkamiche](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bkamiche/32/14559_2.png) [@bkamiche](https://discuss.elastic.co/u/bkamiche)\
**Post date:** [January 1, 2015, 5:05pm UTC](https://discuss.elastic.co/t/how-is-data-stored/21446/4 "2015-01-01T17:05:25Z")

</div>

Thanks for your replies, that gave me the clue for what I was looking for,  
and now it is solved!

On Wednesday, December 31, 2014 10:36:27 PM UTC-5, Bruno Kamiche wrote:

> Hello, I'm new in using elasticsearch, so maybe this is a basic question...
> 
> Is there any way to see how is the text "stored" or at least how it would  
> look once the filters defined for a field (in the analyzer) are applied?
> 
> I know that the actual field is stored "as is", and the filters are  
> considered for indexing purposes, but i want to see what is the result of  
> that operation.
> 
> Why do I ask this, the reason is that I'm applying filters to a field (for  
> example removing urls), and performing aggregations on that field, but the  
> aggregations return "http" as a used word, and guess that is not correct,  
> as it shall be removed...

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9196629f-7bf8-4256-8b16-8ecee2fbd020%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9196629f-7bf8-4256-8b16-8ecee2fbd020%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Peter\_Johnson\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/peter_johnson_2/32/8494_2.png) [@Peter\_Johnson\_2](https://discuss.elastic.co/u/Peter_Johnson_2)\
**Post date:** [January 5, 2015, 3:23pm UTC](https://discuss.elastic.co/t/how-is-data-stored/21446/5 "2015-01-05T15:23:04Z")

</div>

have a look  
at [GitHub - polyfractal/elasticsearch-inquisitor: Site plugin for Elasticsearch to help understand and debug queries.](https://github.com/polyfractal/elasticsearch-inquisitor#analyzer-testing)

On Thursday, 1 January 2015 17:05:25 UTC, Bruno Kamiche wrote:

> Thanks for your replies, that gave me the clue for what I was looking for,  
> and now it is solved!
> 
> On Wednesday, December 31, 2014 10:36:27 PM UTC-5, Bruno Kamiche wrote:
> 
> > Hello, I'm new in using elasticsearch, so maybe this is a basic  
> > question...
> > 
> > Is there any way to see how is the text "stored" or at least how it would  
> > look once the filters defined for a field (in the analyzer) are applied?
> > 
> > I know that the actual field is stored "as is", and the filters are  
> > considered for indexing purposes, but i want to see what is the result of  
> > that operation.
> > 
> > Why do I ask this, the reason is that I'm applying filters to a field  
> > (for example removing urls), and performing aggregations on that field, but  
> > the aggregations return "http" as a used word, and guess that is not  
> > correct, as it shall be removed...

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/59accfbd-46a4-437c-81b1-6978b752ac4c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/59accfbd-46a4-437c-81b1-6978b752ac4c%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:40am UTC](https://discuss.elastic.co/t/how-is-data-stored/21446/6 "2017-07-06T00:40:50Z")

</div>


