# Merge tokens (terms) after the tokenisation

**URL:** <https://discuss.elastic.co/t/merge-tokens-terms-after-the-tokenisation/330316>\
**Category:** Elasticsearch\
**Created:** [April 19, 2023, 2:36pm UTC](https://discuss.elastic.co/t/merge-tokens-terms-after-the-tokenisation/330316 "2023-04-19T14:36:51Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ranjana](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ranjana/32/117693_2.png) [@Ranjana](https://discuss.elastic.co/u/Ranjana)\
**Post date:** [April 19, 2023, 2:36pm UTC](https://discuss.elastic.co/t/merge-tokens-terms-after-the-tokenisation/330316/1 "2023-04-19T14:36:51Z")

</div>

Hi there,

I am trying to find a solution to combine all tokens (terms) after tokenisation.

for example - This analyser(my-analyser) produce n tokens after applying "custom\_stop" filter. Is there any way to combine all tokens and generate one single token?

I have seen 'fingerprint' filter which combine all tokens but it does sorting as well, which I don't want. Please suggest solution for this.

```auto
 `"analysis": {
      "analyzer": {
        "my-analyser": {
          "tokenizer": "standard",
          "filter": ["custom_stop"]
        }
      },
      "filter": {
        "custom_stop": {
          "type": "stop",
          "ignore_case": true,
          "stopwords": ["elastic", "aws", "java"]
        },

```

Thanks  
Ranjan

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [April 19, 2023, 11:52pm UTC](https://discuss.elastic.co/t/merge-tokens-terms-after-the-tokenisation/330316/2 "2023-04-19T23:52:40Z")

</div>

Welcome to our community! 😃

So if you end up with tokens like `["token0", "token1", "token2"]` you want `"token0token1token2"`?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 17, 2023, 11:53pm UTC](https://discuss.elastic.co/t/merge-tokens-terms-after-the-tokenisation/330316/3 "2023-05-17T23:53:33Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.