# Elastic Search Result

**URL:** <https://discuss.elastic.co/t/elastic-search-result/33170>\
**Category:** Elasticsearch\
**Created:** [October 28, 2015, 5:19pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170 "2015-10-28T17:19:13Z")\
**Posts on this page:** 16\
**Page:** 1

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [October 28, 2015, 5:19pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/1 "2015-10-28T17:19:13Z")

</div>

Hi Team,

I have a sample user document which i am indexing by userName. While querying instead of retrieving all fields i just need userName and address2, so i added the required fields in my query. It is just returning only userName.

My question here is Can we use non indexed fields in my search query?

```auto
{
userName :'test',
address:'test123'
address2:'test456'
}

```

POST:

```auto
URL : http:/localhost:9300/user-2015/_search?q=test
search query : {
    "fields" : ["userName","address2"]
    }

```

Result gives only userName. Can some one help me on this?

---

<div class="post-metadata">

**Author:** ![javanna](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/javanna/32/4698_2.png) [@javanna](https://discuss.elastic.co/u/javanna)\
**Post date:** [October 29, 2015, 1:38pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/2 "2015-10-29T13:38:58Z")

</div>

Hi,  
do you mean that out of the \_source, you would only like to get back userName and address2? In that case source filtering should be what you are looking for: [https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-source-filtering.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-source-filtering.html) . Use \_source: ["userName", "address2"].

In case I misunderstood, could you please post a complete recreation, with expected response and the actual response that you are getting when sending your request?

Cheers  
Luca

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [October 29, 2015, 11:52pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/3 "2015-10-29T23:52:16Z")

</div>

Thanks Luca. This is what i am expecting. Thanks for your help.

I have one more question, I have nearly .5 million documents indexed in my system. Now I want to change the mappings of the index( adding new fields and updating data type of some fields) .

In this case how can i reindex all my existing index?

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [October 30, 2015, 12:22am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/4 "2015-10-30T00:22:40Z")

</div>

For now, yes. You have to rebuild the index using scan/scroll. There is an  
old blog post called something like "no downtime mapping updates" which  
describes a good process for this.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [October 30, 2015, 12:26am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/5 "2015-10-30T00:26:48Z")

</div>

Thanks Nik.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [November 1, 2015, 8:59pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/6 "2015-11-01T20:59:10Z")

</div>

Hi Nik,

I am able to reindex using scan/scroll, now i have new index with different name. But still my customers are using my old index. I am trying to create alias for my old index based on the following tutorial.

[https://www.elastic.co/guide/en/elasticsearch/guide/current/index-aliases.html](https://www.elastic.co/guide/en/elasticsearch/guide/current/index-aliases.html)

I am getting error.

```auto
POST:

POST /_aliases
{
    "actions": [
        { "remove":    
            { "index": "customer1", 
              "alias": "customer"
            }
        }
    ]
}

Response:
{
   "error": {
      "root_cause": [
         {
            "type": "invalid_alias_name_exception",
            "reason": "Invalid alias name [customer], an index exists with the same name as the alias",
            "index": "customer1"
         }
      ],
      "type": "invalid_alias_name_exception",
      "reason": "Invalid alias name [customer], an index exists with the same name as the alias",
      "index": "customer1"
   },
   "status": 400
}

customer1 is my new index, customer is my old index.

```

Based on the exception we have to give alias name, But I am getting error while indexing if i give same alias name for both my index. alias name is allcustomer

```auto
PUT allcustomer/external/3?pretty
{
  "firstname": "abcd",
  "lastname":"efgh"
}

Response:
{
   "error": {
      "root_cause": [
         {
            "type": "illegal_argument_exception",
            "reason": "Alias [allcustomer] has more than one indices associated with it [[customer, customer1]], can't execute a single index op"
         }
      ],
      "type": "illegal_argument_exception",
      "reason": "Alias [allcustomer] has more than one indices associated with it [[customer, customer1]], can't execute a single index op"
   },
   "status": 400
}

```

Please help me to fix this.

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [November 1, 2015, 10:28pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/7 "2015-11-01T22:28:27Z")

</div>

I don't think you can atomically delete an index and replace it with an  
alias. I believe you'll b have to delete the index and then create the  
alias.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [November 1, 2015, 11:24pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/8 "2015-11-01T23:24:43Z")

</div>

Thanks Nik. I have one more doubt.

Say for example i have multiple (for e.g 10000 indices) indices for the customer based on the company.  
e.g: customer-abc, customer-aaa..etc

I need to change the template mapping for the customer\* indices. after i changed the template mapping do i need to run reindex for all the customer\* indices one by one?

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [November 2, 2015, 12:12am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/9 "2015-11-02T00:12:00Z")

</div>

> [@pranesh002](#):
>
> Say for example i have multiple (for e.g 10000 indices) indices for the customer based on the company. e.g: customer-abc, customer-aaa..etc

Generally its a bad idea to have an index per customer. It just doesn't scale to the number of customers people want - 10,000 indices in a cluster is a lot! You shouldn't have an index per customer.

I'm really curious now, why were you thinking of using an index per customer?

> [@pranesh002](#):
>
> I need to change the template mapping for the customer\* indices. after i changed the template mapping do i need to run reindex for all the customer\* indices one by one?

Warning: Mapping has a specific meaning in elasticsearch and templates aren't part of it.

If you are doing this delete index and replace with alias thing then yes, you should do it one by one. If you were doing a template swap you could do them all at once if you wanted to. But you may not want to for lots of reasons - it might be better to do it for some indexes at a time to lower the impact of serving from cold data.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [November 2, 2015, 12:27am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/10 "2015-11-02T00:27:17Z")

</div>

> [@nik9000](#):
>
> I'm really curious now, why were you thinking of using an index per customer?
> 
> pranesh002:

Hi Nik,

The reason i have created index based on company is, my requirement is to serve the customer information based on the company. In a request i will get customer information and company information to query ES.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [November 2, 2015, 12:45am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/11 "2015-11-02T00:45:12Z")

</div>

> [@nik9000](#):
>
> If you were doing a template swap you could do them all at once if you wanted to

Based on current indices, customer template will have settings and mappings.

```auto
Current customer template is

GET_template/template_customer

{
   "template_customer": {
      "order": 0,
      "template": "customer*",
      "settings": {
         "index": {
            "number_of_shards": "1"
         }
      },
      "mappings": {
         "cus": {
            "dynamic": "false",
            "properties": {
               "firstname": {
                  "type": "string"
               }
            }
         }
      },
      "aliases": {}
   }
}

```

I need to add one more field in the template mapping (because i want to reflect this for all customer indices) and need to add custom analyzer for firstName field. So i feel like reindexing all customer\* indices one by one is painful.

So as you said i need to think of indices design.

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [November 2, 2015, 12:58am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/12 "2015-11-02T00:58:24Z")

</div>

Yeah, but you can to that with a simple filter and a field per document.  
It's how you'd do it if you were using a relational database. I'm just  
curious if there is another system that you are used to that supports index  
per customer kinds of things.

I don't fault you at all for thinking that index per customer is ok. Lots  
of people think that way. I was talking to someone who thought similar  
stuff yesterday. Its a really common error, I'm just super curious why!  
You've been quick to respond so I thought I'd ask you.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [November 2, 2015, 1:35am UTC](https://discuss.elastic.co/t/elastic-search-result/33170/13 "2015-11-02T01:35:42Z")

</div>

Thanks Nik, thanks for clarifying this error. We are also using relational database, and company id is one of the field there.  
We don't have other system for indexing.

---

<div class="post-metadata">

**Author:** ![pranesh002](https://avatars.discourse-cdn.com/v4/letter/p/48db29/32.png) [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Post date:** [November 2, 2015, 3:27pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/14 "2015-11-02T15:27:06Z")

</div>

I have a requirement as follows.

We have a field called customer desc, it should work for both partial and exact key word search.

E.g : If customer desc is less than 8 it should work as exact key word search, if it is greater than 8 then it should be sub string.

my current mapping is

```auto
PUT /test
{  
   "mappings":{  
      "test":{  
         "properties":{  
            "desc":{  
               "type":"string",
               "analyzer":"index_ngram",
               "search_analyzer":"search_ngram"
            }
         }
      }
   },
   "settings":{  
      "analysis":{  
         "filter":{  
            "desc_ngram":{  
               "type":"ngram",
               "min_gram":8,
               "max_gram":20
            }
         },
         "analyzer":{  
            "index_ngram":{  
               "type":"custom",
               "tokenizer":"standard",
               "filter":[  
                   "lowercase",
                   "desc_ngram"
               ]
            },
            "search_ngram":{  
               "type":"custom",
               "tokenizer":"keyword",
               "filter":["lowercase","standard"]
            }
         }
      }
   }
}

GET /test/_analyze?analyzer=index_ngram&source=34FG

Response:
{
   "tokens": []
}

Expected output is
{
   "tokens": [
    {
         "token": "34fg"
      }
   ]
}

If length is greater than 8 then nGram should trigger.

```

Can some one help me to fix this.

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [November 2, 2015, 4:29pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/15 "2015-11-02T16:29:37Z")

</div>

This should probably be another topic for searchability.

> [@pranesh002](#):
>
> If customer desc is less than 8 it should work as exact key word search, if it is greater than 8 then it should be sub string.

That feels backwards - if the user if the user types more characters you want to search for the documents that have any substring match? But if the search term is short you want to search for the exact string? I _think_ the other way makes sense - if the user types 8 or less characters then they don't have a full id so do a substring search.

Either way, your plan to have different search and index analyzers is the right idea I think.

Some examples would help here. I think.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 11:41pm UTC](https://discuss.elastic.co/t/elastic-search-result/33170/16 "2017-07-05T23:41:14Z")

</div>