# Custom Analyzer \[my\_analyzer\] failed to find tokenizer under name \[whitespace\]

**URL:** <https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743>\
**Category:** Elasticsearch\
**Created:** [February 4, 2020, 8:36am UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743 "2020-02-04T08:36:34Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![amit.nema](https://avatars.discourse-cdn.com/v4/letter/a/2bfe46/32.png) [@amit.nema](https://discuss.elastic.co/u/amit.nema)\
**Post date:** [February 4, 2020, 8:36am UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/1 "2020-02-04T08:36:34Z")

</div>

Hello Team,

I'm using elasticsearch version 6.7.2. While testing with elasticsearch test framework, getting following error.

```
java.lang.IllegalArgumentException: Custom Analyzer [my_analyzer] failed to find tokenizer under name [whitespace]
    at __randomizedtesting.SeedInfo.seed([15944A0400B02A8:3E5900C2E7F115DD]:0)
    at org.elasticsearch.index.analysis.CustomAnalyzerProvider.build(CustomAnalyzerProvider.java:58)
    at org.elasticsearch.index.analysis.AnalysisRegistry.processAnalyzerFactory(AnalysisRegistry.java:553)
    at org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:477)
    at org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:167)
    at org.elasticsearch.index.IndexService.<init>(IndexService.java:164)
    at org.elasticsearch.index.IndexModule.newIndexService(IndexModule.java:402)
    at org.elasticsearch.indices.IndicesService.createIndexService(IndicesService.java:526)
    at org.elasticsearch.indices.IndicesService.createIndex(IndicesService.java:480)

```

Kindly suggest.

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [February 4, 2020, 9:03am UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/2 "2020-02-04T09:03:19Z")

</div>

can you share the request causing this?

---

<div class="post-metadata">

**Author:** ![amit.nema](https://avatars.discourse-cdn.com/v4/letter/a/2bfe46/32.png) [@amit.nema](https://discuss.elastic.co/u/amit.nema)\
**Post date:** [February 4, 2020, 9:17am UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/3 "2020-02-04T09:17:39Z")

</div>

Thanks for your quick response.

Currently using elasticsearch version 6.7.2. Using following setup in test class.

```
@Override
@Before
public void setUp() throws Exception {
    super.setUp();

    final Settings.Builder settings = Settings.builder();
    settings.put(IndexMetaData.SETTING_NUMBER_OF_REPLICAS, 0).put(IndexMetaData.SETTING_NUMBER_OF_SHARDS, 1)
            .put("index.similarity.simpay.type", SimPayPlugin.NAME)
            .put("analysis.analyzer.my_analyzer.type", "custom")
            .put("analysis.analyzer.my_analyzer.tokenizer", "whitespace")
            .putList("analysis.analyzer.my_analyzer.filter", "lowercase", MyAnalyzerTokenFilterPlugin.NAME);

    prepareCreate(INDEX).setSettings(settings)
            .addMapping(INDEX_TYPE, jsonBuilder().startObject().startObject("properties")
                    //
                    .startObject("content").field("type", "text").field("similarity", "simpay")
                    .field("analyzer", "my_analyzer").endObject()
                    //
                    .endObject().endObject())
            .get();
    ensureGreen();

    client().prepareIndex(INDEX, INDEX_TYPE, "1")
            .setSource("content", "foo:2.3 bar:2.5 baz foo:3.7", "material", "Wafers:7.3 ICs:0.02 Chips:5.8").get();

    refresh();
}

```

while running the test it fails and displays the error.

---

<div class="post-metadata">

**Author:** ![amit.nema](https://avatars.discourse-cdn.com/v4/letter/a/2bfe46/32.png) [@amit.nema](https://discuss.elastic.co/u/amit.nema)\
**Post date:** [February 5, 2020, 9:04am UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/4 "2020-02-05T09:04:53Z")

</div>

@spinscale Any clue for me? 🤔  
Thanks in advance. 🙂

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [February 5, 2020, 9:36am UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/5 "2020-02-05T09:36:56Z")

</div>

can you share the HTTP request that is about to be executed? You can increase the logging of the HTTP Client if you need to so the data gets dumped. See [https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.5/java-rest-low-usage-logging.html](https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.5/java-rest-low-usage-logging.html)

---

<div class="post-metadata">

**Author:** ![amit.nema](https://avatars.discourse-cdn.com/v4/letter/a/2bfe46/32.png) [@amit.nema](https://discuss.elastic.co/u/amit.nema)\
**Post date:** [February 5, 2020, 3:15pm UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/6 "2020-02-05T15:15:52Z")

</div>

Hello @spinscale,

Test failed while creating test index. No http request printed in log file. ☹

I doubt with **test framework jar 6.7.2** does not register " **whitespace**" tokenizer. 🤔  
The same request runs properly via kibana with es cluster 6.7.2.

Additionally, _ **this test was working on elasticsearch 6.2.2** _. I'm just upgrading the elasticsearch version and test stopped working.

```
[2020-02-05T11:53:29,400][TRACE][o.e.t.TaskManager] [numberOfShards] register 34 [transport] [indices:admin/create] []
[2020-02-05T11:53:29,400][TRACE][o.e.c.s.MasterService] [node_s0] will process [create-index [test], cause [api]]
[2020-02-05T11:53:29,400][DEBUG][o.e.c.s.MasterService] [node_s0] processing [create-index [test], cause [api]]: execute
[2020-02-05T11:53:29,402][TRACE][o.e.i.IndexSettings] [node_s0] [test] using [tiered] merge mergePolicy with expunge_deletes_allowed[10.0], floor_segment[2mb], max_merge_at_once[10], max_merge_at_once_explicit[30], max_merged_segment[5gb], segments_per_tier[10.0], deletes_pct_allowed[33.0]
[2020-02-05T11:53:29,403][DEBUG][o.e.i.IndicesService] [node_s0] creating Index [[test/zrkt0RkjRIGyy6gTnGhQhw]], shards [1]/[0] - reason [create index]
[2020-02-05T11:53:29,403][DEBUG][o.e.i.c.q.DisabledQueryCache] [node_s0] [test] Using no query cache
[2020-02-05T11:53:29,405][TRACE][o.e.c.s.MasterService] [node_s0] failed to execute cluster state update in [5ms], state:
version [6], source [create-index [test], cause [api]]
nodes: 
   {node_s0}{Qdn2klWERWuMGnfFpiQYVg}{4sIWVhVuRk2SB2FtIhjAhg}{127.0.0.1}{127.0.0.1:63676}, local, master
   {node_s1}{dV9AksWfQqew_k852LizaQ}{U5nUx8VJTZmUxzBIIO7qCg}{127.0.0.1}{127.0.0.1:63675}
routing_table (version 1):
routing_nodes:
-----node_id[dV9AksWfQqew_k852LizaQ][V]
-----node_id[Qdn2klWERWuMGnfFpiQYVg][V]
---- unassigned

java.lang.IllegalArgumentException: Custom Analyzer [my_analyzer] failed to find tokenizer under name [whitespace]
    at org.elasticsearch.index.analysis.CustomAnalyzerProvider.build(CustomAnalyzerProvider.java:58) ~[elasticsearch-6.7.2.jar:6.7.2]
	at org.elasticsearch.index.analysis.AnalysisRegistry.processAnalyzerFactory(AnalysisRegistry.java:553) ~[elasticsearch-6.7.2.jar:6.7.2]
    at org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:477) ~[elasticsearch-6.7.2.jar:6.7.2]
    at org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:167) ~[elasticsearch-6.7.2.jar:6.7.2]
    at org.elasticsearch.index.IndexService.<init>(IndexService.java:164) ~[elasticsearch-6.7.2.jar:6.7.2]
```

---

<div class="post-metadata">

**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\
**Post date:** [February 7, 2020, 2:06pm UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/7 "2020-02-07T14:06:23Z")

</div>

you can enable logging in the client, to have the request printed out, that would be really helpful in this case - also help to check differences between those two versions.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 6, 2020, 2:06pm UTC](https://discuss.elastic.co/t/custom-analyzer-my-analyzer-failed-to-find-tokenizer-under-name-whitespace/217743/8 "2020-03-06T14:06:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.