# Insights for an ES Newbie

**URL:** <https://discuss.elastic.co/t/insights-for-an-es-newbie/3962>\
**Category:** Elasticsearch\
**Created:** [February 22, 2011, 9:46pm UTC](https://discuss.elastic.co/t/insights-for-an-es-newbie/3962 "2011-02-22T21:46:01Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![zupeanut](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/zupeanut/32/3266_2.png) [@zupeanut](https://discuss.elastic.co/u/zupeanut)\
**Post date:** [February 22, 2011, 9:46pm UTC](https://discuss.elastic.co/t/insights-for-an-es-newbie/3962/1 "2011-02-22T21:46:01Z")

</div>

Hi,

I would like to try and cluster my documents. From what I understand of Lucene, it means fully replacing the term-vector. From my reading, I have determined that this vector is hidden in ES. Is there a way to augment my results using some or all of the information I do have available?

**Available Information:**

- Global term importance (ie. _word_ and _importance relative to corpus_)
- Document vectors (ie. _word_ and _importance relative to document_)

Many thanks in advance!

Regards,  
Andrew

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [February 24, 2011, 5:08am UTC](https://discuss.elastic.co/t/insights-for-an-es-newbie/3962/2 "2011-02-24T05:08:11Z")

</div>

In general you can do it, but its quite low level Lucene (and elasticsearch) work. You can write your own analyzer that puts your own "importance" as a payload on terms the analyzer generates, and then use those payloads in a custom query you implement.

I have been thinking hard on trying to enable this simply in elasticsearch, but did not come up (yet) with a nice API centric solution.  
On Tuesday, February 22, 2011 at 11:46 PM, zupeanut wrote:

> Hi,
> 
> I would like to try and cluster my documents. From what I understand of  
> Lucene, it means fully replacing the term-vector. From my reading, I have  
> determined that this vector is hidden in ES. Is there a way to augment my  
> results using some or all of the information I do have available?
> 
> Available Information:
> 
> - Global term importance (ie. word and importance relative to corpus)
> - Document vectors (ie. word and importance relative to document)
> 
> Many thanks in advance!
> 
> ## Regards, Andrew
> 
> View this message in context: [http://elasticsearch-users.115913.n3.nabble.com/Insights-for-an-ES-Newbie-tp2555803p2555803.html](http://elasticsearch-users.115913.n3.nabble.com/Insights-for-an-ES-Newbie-tp2555803p2555803.html)  
> Sent from the Elasticsearch Users mailing list archive at [Nabble.com](http://Nabble.com).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:11am UTC](https://discuss.elastic.co/t/insights-for-an-es-newbie/3962/3 "2017-07-06T04:11:35Z")

</div>

Closed on July 6, 2017, 4:11am UTC