# Using only Analyzers, Tokenizers

**URL:** <https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621>\
**Category:** Elasticsearch\
**Created:** [December 3, 2010, 10:22am UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621 "2010-12-03T10:22:10Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![jazzbearz](https://avatars.discourse-cdn.com/v4/letter/j/e47c2d/32.png) [@jazzbearz](https://discuss.elastic.co/u/jazzbearz)\
**Post date:** [December 3, 2010, 10:22am UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621/1 "2010-12-03T10:22:10Z")

</div>

Is there anyway to use the analyzer and tokenizer separately?

I’m trying to make a real-time search service like the twitter. In  
order to do this, I need to develop a server that does pull a result  
from elasticsearch first, then send real-time search results by  
comet. To accomplish this, the server needs analyzed search words and  
analyzed data lines. So, is it possible to get the analyzed result  
from eleasticsearch server?

---

<div class="post-metadata">

**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\
**Post date:** [December 3, 2010, 12:58pm UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621/2 "2010-12-03T12:58:45Z")

</div>

> Iâm trying to make a real-time search service like the twitter. In  
> order to do this, I need to develop a server that does pull a result  
> from elasticsearch first, then send real-time search results by  
> comet. To accomplish this, the server needs analyzed search words and  
> analyzed data lines. So, is it possible to get the analyzed result  
> from eleasticsearch server?

This sounds like what you're looking for:

> <https://github.com/elastic/elasticsearch/issues/529>
>
> An API to analyze custom text provided ("within" a specific analyzer). The REST …endpoint is:
> 
> \`\`\`
> curl -XGET localhost:9200/{index}/\_analyze
> \`\`\`
> 
> For example:
> 
> \`\`\`
> curl -XGET localhost:9200/test/\_analyze?text=this is a test
> \`\`\`
> 
> An \`analyzer\` can also be provided to use a different analyzer than the default indexing analyzer for the index:
> 
> \`\`\`
> curl -XGET localhost:9200/test/\_analyze?analyzer=whitespace&text=this is a test
> \`\`\`
> 
> The text can also be provided as the request body.
> 
> The \`format\` of the response can also be provided, by default it is \`detailed\` (breaking each token information into a json object). The \`text\` format provides the analyzed data in a single text response.

Due for release in version 0.14.0

clint

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [December 3, 2010, 5:58pm UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621/3 "2010-12-03T17:58:30Z")

</div>

Out of curiosity, I am not sure I understand why do you need the analyzed text?  
On Friday, December 3, 2010 at 2:58 PM, Clinton Gormley wrote:

> > Iâm trying to make a real-time search service like the twitter. In  
> > order to do this, I need to develop a server that does pull a result  
> > from elasticsearch first, then send real-time search results by  
> > comet. To accomplish this, the server needs analyzed search words and  
> > analyzed data lines. So, is it possible to get the analyzed result  
> > from eleasticsearch server?
> 
> This sounds like what you're looking for:  
> [Analyze API: An API to analyzer custom text based on an optional analyzer · Issue #529 · elastic/elasticsearch · GitHub](http://github.com/elasticsearch/elasticsearch/issues/issue/529)
> 
> Due for release in version 0.14.0
> 
> clint

---

<div class="post-metadata">

**Author:** ![jazzbearz](https://avatars.discourse-cdn.com/v4/letter/j/e47c2d/32.png) [@jazzbearz](https://discuss.elastic.co/u/jazzbearz)\
**Post date:** [December 7, 2010, 6:01pm UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621/4 "2010-12-07T18:01:22Z")

</div>

Clinton,  
Thanks. That was what I needed.

Shay,  
My Idea of making a real-time search requires separate http handling  
comet server that can process texts pushed from web servers. The  
comet server tries to search the analyzed input text based on analyzed  
user's search queries, then send back to users if it matches to the  
queries.

On Dec 4, 2:58 am, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote:

> Out of curiosity, I am not sure I understand why do you need the analyzed text?
> 
> On Friday, December 3, 2010 at 2:58 PM, Clinton Gormley wrote:
> 
> > > I’m trying to make a real-time search service like the twitter. In  
> > > order to do this, I need to develop a server that does pull a result  
> > > from elasticsearch first, then send real-time search results by  
> > > comet. To accomplish this, the server needs analyzed search words and  
> > > analyzed data lines. So, is it possible to get the analyzed result  
> > > from eleasticsearch server?
> 
> > This sounds like what you're looking for:  
> > [Analyze API: An API to analyzer custom text based on an optional analyzer · Issue #529 · elastic/elasticsearch · GitHub](http://github.com/elasticsearch/elasticsearch/issues/issue/529)
> 
> > Due for release in version 0.14.0
> 
> > clint

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [December 8, 2010, 7:52am UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621/5 "2010-12-08T07:52:19Z")

</div>

Then why not just execute the search against an index? Are you going to implement your own search mechanism?  
On Tuesday, December 7, 2010 at 8:01 PM, jazzbearz wrote:

> Clinton,  
> Thanks. That was what I needed.
> 
> Shay,  
> My Idea of making a real-time search requires separate http handling  
> comet server that can process texts pushed from web servers. The  
> comet server tries to search the analyzed input text based on analyzed  
> user's search queries, then send back to users if it matches to the  
> queries.
> 
> On Dec 4, 2:58 am, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote:
> 
> > Out of curiosity, I am not sure I understand why do you need the analyzed text?
> > 
> > On Friday, December 3, 2010 at 2:58 PM, Clinton Gormley wrote:
> > 
> > > > Iâm trying to make a real-time search service like the twitter. In  
> > > > order to do this, I need to develop a server that does pull a result  
> > > > from elasticsearch first, then send real-time search results by  
> > > > comet. To accomplish this, the server needs analyzed search words and  
> > > > analyzed data lines. So, is it possible to get the analyzed result  
> > > > from eleasticsearch server?
> > 
> > > This sounds like what you're looking for:  
> > > [Analyze API: An API to analyzer custom text based on an optional analyzer · Issue #529 · elastic/elasticsearch · GitHub](http://github.com/elasticsearch/elasticsearch/issues/issue/529)
> > 
> > > Due for release in version 0.14.0
> > 
> > > clint

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:15am UTC](https://discuss.elastic.co/t/using-only-analyzers-tokenizers/3621/6 "2017-07-06T04:15:31Z")

</div>


