# How to implement a search by multiple fields and support whitespace, symbols, case insensitive

**URL:** <https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030>\
**Category:** Elasticsearch\
**Created:** [April 14, 2023, 3:31pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030 "2023-04-14T15:31:05Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Juan\_Manuel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/juan_manuel/32/119837_2.png) [@Juan\_Manuel](https://discuss.elastic.co/u/Juan_Manuel)\
**Post date:** [April 14, 2023, 3:31pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030/1 "2023-04-14T15:31:05Z")

</div>

I have an index with many fields and I want to be able to search by some of them at the same time, and this search should support partial match (in any position), case insensitive, support some symbols.

Example of my index:

```auto
PUT my_index
{
    settings: {
      analysis: {
        analyzer: {
          analyzerCaseInsensitive: {
            filter: ['lowercase'],
            tokenizer: 'keyword',
          },
          default: {
            type: 'keyword',
          },
        },
      },
    },
    mappings: {
      properties: {
        id: {
            type: 'text',
            analyzer: 'analyzerCaseInsensitive'
        },
        email: {
            type: 'text',
            analyzer: 'analyzerCaseInsensitive'
        },
        fullName: {
            type: 'text',
            analyzer: 'analyzerCaseInsensitive'
        }
      }
    }
  }

```

And then to search I'm using this query:

```auto
GET my_index/_search
{
  from: 0,
  size: 10,
  query: {
    bool: {
      must: [
        {
          {
            query_string: {
              query: `*{search}*`,
              fields: ['id', 'email', 'fullName'],
            }
          }
        }
      ]
    }
  }
}

```

With this query I'm able to search partial match, case insensitive, and some symbols, but I'm not able to search text with whitespace in the middle to get those that match only that literal text.

I will describe some examples of what I want to achieve.

**--- FIELDS ---**

**Id field** is an uuidv4, so the format is something like: "6e0baaae-ff10-4812-b27d-ca307560b9e3".

**fullName field** could include whitespace like, "Jhon Doe".

**--- EXPECTED BEHAVIOR---**

```auto
PUT my_index/_doc/1
{
    "id": "6e0baaae-ff10-4812-b27d-ca307560b9e3",
    "email": "jhon.doe@gmail.com",
    "fullName": "Jhon Doe"
}

PUT my_index/_doc/2
{
    "id": "3b8605f9-1fad-4b25-a061-ab0943f7d55e",
    "email": "jhonny_saur@hotmail.com",
    "fullName": "Scott Doe"
}

```

So if I search "jho", I expect both, because it's included in the fullName of 1 and in the email of 2.  
Search "jhon Doe", I expect only the 1, because it's the only that match the whole text.  
Search "nny", I expect the 2, because it's included in the email.

How can I improve my index or query to support this? Thanks

---

<div class="post-metadata">

**Author:** ![RabBit\_BR](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rabbit_br/32/82261_2.png) [@RabBit\_BR](https://discuss.elastic.co/u/RabBit_BR)\
**Post date:** [April 14, 2023, 4:08pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030/2 "2023-04-14T16:08:32Z")

</div>

Hi @Juan_Manuel

My suggestion:

if you dont want change your mapping use should clause with multi-match query and query\_string

New query:

```auto
{
  "from": 0,
  "size": 10,
  "query": {
    "bool": {
      "minimum_should_match": 1, 
      "should": [
        {
          "query_string": {
            "query": "*jho*",
            "fields": [
              "id",
              "email",
              "fullName"
            ]
          }
        },
        {
          "multi_match": {
            "query": "jho",
            "fields": [
              "id",
              "email",
              "fullName"
            ]
          }
        }
      ]
    }
  }
}

```

I would create a new field for received to receive all values other fields using [copy to](https://www.elastic.co/guide/en/elasticsearch/reference/current/copy-to.html).

Ex:

```auto
"properties": {
      "multi_fields": {
        "type": "text",
        "analyzer": "analyzerCaseInsensitive"
      },
      "id": {
        "type": "text",
        "copy_to": "multi_fields"
      },
      "email": {
        "type": "text",
        "copy_to": "multi_fields"
      },
      "fullName": {
        "type": "text",
        "copy_to": "multi_fields"
      }
    }

```

Query:

```auto
{
  "from": 0,
  "size": 10,
  "query": {
    "bool": {
      "should": [
        {
          "query_string": {
            "query": "*nny*",
            "fields": [
              "multi_fields"
            ]
          }
        },
        {
          "match": {
            "multi_fields": "nny"
          }
        }
      ]
    }
  }
}

```

---

<div class="post-metadata">

**Author:** ![Juan\_Manuel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/juan_manuel/32/119837_2.png) [@Juan\_Manuel](https://discuss.elastic.co/u/Juan_Manuel)\
**Post date:** [April 14, 2023, 4:55pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030/3 "2023-04-14T16:55:08Z")

</div>

Ohh I think it's working as I expected. I just did a couple of quick tests and it worked!!  
Let me do some more tests before closing the question, but I think it's working!

Thanks Rabbit!

---

<div class="post-metadata">

**Author:** ![Juan\_Manuel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/juan_manuel/32/119837_2.png) [@Juan\_Manuel](https://discuss.elastic.co/u/Juan_Manuel)\
**Post date:** [April 14, 2023, 7:25pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030/4 "2023-04-14T19:25:25Z")

</div>

@RabBit_BR, it's working almost perfect in all the cases I need, but there is only one that it doesn't.

The case is when I have something like this:

```auto
{
    "id": "6e0baaae-ff10-4812-b27d-ca307560b9e3",
    "email": "random@gmail.com",
    "fullName": "Jhon Doe"
}
{
    "id": "3b8605f9-1fad-4b25-a061-ab0943f7d55e",
    "email": "jhon@gmail.com",
    "fullName": "Bob White"
}

```

And the query I'm using is:

```auto
{
  "from": 0,
  "size": 10,
  "query": {
    "bool": {
      "should": [
        {
          "query_string": {
            "query": "*any jhon*",
            "fields": [
              "multi_fields"
            ]
          }
        },
        {
          "match": {
            "multi_fields": "any jhon"
          }
        }
      ]
    }
  }
}

```

The response of this query contains both documents, because the first one has **jhon** in the **fullName** , and the second one has it in the **email** , but none has the **"any"** word.

In this case I'm expecting no results, I want to match the whole word.

I don't know if this is possible? I don't mind changing my mappings or settings.

---

<div class="post-metadata">

**Author:** ![RabBit\_BR](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rabbit_br/32/82261_2.png) [@RabBit\_BR](https://discuss.elastic.co/u/RabBit_BR)\
**Post date:** [April 14, 2023, 8:00pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030/5 "2023-04-14T20:00:12Z")

</div>

you can try with operator AND in query\_string?

```auto
 {
          "query_string": {
            "query": "*any jhon*",
            "default_operator": "AND", 
            "fields": [
              "id",
              "email",
              "fullName"
            ]
          }
        }

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 12, 2023, 8:00pm UTC](https://discuss.elastic.co/t/how-to-implement-a-search-by-multiple-fields-and-support-whitespace-symbols-case-insensitive/330030/6 "2023-05-12T20:00:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.