# Remove features

**URL:** https://discuss.elastic.co/t/remove-features/13586
**Category:** Elasticsearch
**Created:** [September 13, 2013, 6:34am UTC](https://discuss.elastic.co/t/remove-features/13586 "2013-09-13T06:34:02Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Anand\_Nalya](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/anand_nalya/32/571_2.png) [@Anand\_Nalya](https://discuss.elastic.co/u/Anand_Nalya)
#### Post date: [September 13, 2013, 6:34am UTC](https://discuss.elastic.co/t/remove-features/13586/1 "2013-09-13T06:34:02Z")

</div>

Hi,

I want to use elasticsearch for searches that tells whether a particular  
tokens occurs within a document or not. I don't want any sort of scoring,  
frequency or positioning info. For this I've set omit\_norms=true and  
index\_options=docs.

In the data directory, I can see pos and doc file. Doc file accounts for  
17% of the storage and Pos file takes 1.5% storage. Is there any way, we  
can skip this files?

Thanks,  
Anand

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![mvg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mvg/32/98890_2.png) [@mvg](https://discuss.elastic.co/u/mvg)
#### Post date: [September 13, 2013, 9:46am UTC](https://discuss.elastic.co/t/remove-features/13586/2 "2013-09-13T09:46:03Z")

</div>

The .doc files contain the posting list. The postings list and the term  
dictionary (.tim files) are used for basic filtering / querying, without  
those files simple simple filtering / querying wouldn't work.

If all your fields are configured with `index_options` : `docs` then there  
shouldn't be a .pos file. If you want to know more about the Lucene files I  
recommend you to read:  
[http://lucene.apache.org/core/4\_4\_0/core/org/apache/lucene/codecs/lucene41/package-summary.html](http://lucene.apache.org/core/4_4_0/core/org/apache/lucene/codecs/lucene41/package-summary.html)

Martijn

On 13 September 2013 08:34, Anand Nalya [anand.nalya@gmail.com](mailto:anand.nalya@gmail.com) wrote:

> Hi,
> 
> I want to use elasticsearch for searches that tells whether a particular  
> tokens occurs within a document or not. I don't want any sort of scoring,  
> frequency or positioning info. For this I've set omit\_norms=true and  
> index\_options=docs.
> 
> In the data directory, I can see pos and doc file. Doc file accounts for  
> 17% of the storage and Pos file takes 1.5% storage. Is there any way, we  
> can skip this files?
> 
> Thanks,  
> Anand
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
Met vriendelijke groet,

Martijn van Groningen

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![simonw\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/simonw_2/32/1130_2.png) [@simonw\_2](https://discuss.elastic.co/u/simonw_2)
#### Post date: [September 13, 2013, 10:42am UTC](https://discuss.elastic.co/t/remove-features/13586/3 "2013-09-13T10:42:47Z")

</div>

There is a .pos file hold data from the ID / Version field since we use  
payloads for versioning. This will go away in 1.0 since we use DocValues  
for this in 1.0.

simon

On Friday, September 13, 2013 11:46:03 AM UTC+2, Martijn v Groningen wrote:

> The .doc files contain the posting list. The postings list and the term  
> dictionary (.tim files) are used for basic filtering / querying, without  
> those files simple simple filtering / querying wouldn't work.
> 
> If all your fields are configured with `index_options` : `docs` then there  
> shouldn't be a .pos file. If you want to know more about the Lucene files I  
> recommend you to read:  
> [org.apache.lucene.codecs.lucene41 (Lucene 4.4.0 API)](http://lucene.apache.org/core/4_4_0/core/org/apache/lucene/codecs/lucene41/package-summary.html)
> 
> Martijn
> 
> On 13 September 2013 08:34, Anand Nalya \<[anand...@gmail.com](mailto:anand...@gmail.com) \<javascript:\>\>wrote:
> 
> > Hi,
> > 
> > I want to use elasticsearch for searches that tells whether a particular  
> > tokens occurs within a document or not. I don't want any sort of scoring,  
> > frequency or positioning info. For this I've set omit\_norms=true and  
> > index\_options=docs.
> > 
> > In the data directory, I can see pos and doc file. Doc file accounts for  
> > 17% of the storage and Pos file takes 1.5% storage. Is there any way, we  
> > can skip this files?
> > 
> > Thanks,  
> > Anand
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> Met vriendelijke groet,
> 
> Martijn van Groningen

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![mvg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mvg/32/98890_2.png) [@mvg](https://discuss.elastic.co/u/mvg)
#### Post date: [September 13, 2013, 10:50am UTC](https://discuss.elastic.co/t/remove-features/13586/4 "2013-09-13T10:50:10Z")

</div>

Ah I forgot about \_version field! Thanks Simon.

On 13 September 2013 12:42, simonw [simon.willnauer@elasticsearch.com](mailto:simon.willnauer@elasticsearch.com)wrote:

> There is a .pos file hold data from the ID / Version field since we use  
> payloads for versioning. This will go away in 1.0 since we use DocValues  
> for this in 1.0.
> 
> simon
> 
> On Friday, September 13, 2013 11:46:03 AM UTC+2, Martijn v Groningen wrote:
> 
> > The .doc files contain the posting list. The postings list and the term  
> > dictionary (.tim files) are used for basic filtering / querying, without  
> > those files simple simple filtering / querying wouldn't work.
> > 
> > If all your fields are configured with `index_options` : `docs` then  
> > there shouldn't be a .pos file. If you want to know more about the Lucene  
> > files I recommend you to read: [http://lucene.apache](http://lucene.apache).\*\*  
> > org/core/4\_4\_0/core/org/ **apache/lucene/codecs/lucene41/**  
> > package-summary.html[http://lucene.apache.org/core/4\_4\_0/core/org/apache/lucene/codecs/lucene41/package-summary.html](http://lucene.apache.org/core/4_4_0/core/org/apache/lucene/codecs/lucene41/package-summary.html)
> > 
> > Martijn
> > 
> > On 13 September 2013 08:34, Anand Nalya [anand...@gmail.com](mailto:anand...@gmail.com) wrote:
> > 
> > > Hi,
> > > 
> > > I want to use elasticsearch for searches that tells whether a particular  
> > > tokens occurs within a document or not. I don't want any sort of scoring,  
> > > frequency or positioning info. For this I've set omit\_norms=true and  
> > > index\_options=docs.
> > > 
> > > In the data directory, I can see pos and doc file. Doc file accounts for  
> > > 17% of the storage and Pos file takes 1.5% storage. Is there any way, we  
> > > can skip this files?
> > > 
> > > Thanks,  
> > > Anand
> > > 
> > > --  
> > > You received this message because you are subscribed to the Google  
> > > Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it, send  
> > > an email to elasticsearc...@\*\*[googlegroups.com](http://googlegroups.com).
> > > 
> > > For more options, visit [https://groups.google.com/\*\*groups/opt\_out](https://groups.google.com/**groups/opt_out)[https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out)  
> > > .
> > 
> > --  
> > Met vriendelijke groet,
> > 
> > Martijn van Groningen

--  
Met vriendelijke groet,

Martijn van Groningen

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 2:16am UTC](https://discuss.elastic.co/t/remove-features/13586/5 "2017-07-06T02:16:38Z")

</div>


