Unable to apply indextemplate settings for ingest attachment plugin

Elastic Stack Elasticsearch
1

Hello,

I am attempting to integrate the ingest attachment plugin along with ES v 5.2.0, based on the discussion mentioned in https://github.com/elastic/elasticsearch/issues/18073 we no longer support index level settings via the yml, we now have to utilize the index templates API.

ironically i am attempting to push the below setting to all my indices i attempt to create in my cluster

PUT http://server:9200/_template/my_index_template

{"template":"*","settings":{"index.mapping.attachment.indexed_chars":-1,"index.mapping.attachment.detect_language":"true", "index.refresh_interval":-1}}

but I am receiving the following error while invoking this API call

HTTP/1.1 400 Bad Request
content-type: application/json; charset=UTF-8
content-length: 491

{"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"unknown setting [index.mapping.attachment.detect_language] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"}],"type":"illegal_argument_exception","reason":"unknown setting [index.mapping.attachment.detect_language] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}

i've observed the above error for both , although i have the ingest attachment plugin installed & am able to index files using the ingest attachment processor.

"index.mapping.attachment.indexed_chars":-1,"index.mapping.attachment.detect_language":"true"

i am able to put the settings for

"index.refresh_interval":-1

could you let me know if i am missing out on something here.

Thanks,
Vikas.

2

Anyone?

Thanks

3

so the ingest attachment settings cannot be applied via the index template is it ?

4

ingest-attachment and mapper-attachments are 2 different plugins.

You can't use settings provided by the later in the former.

So you did not install mapper-attachments. It means that settings index.mapping.attachment.indexed_chars and index.mapping.attachment.detect_language can not be used.

Look at https://www.elastic.co/guide/en/elasticsearch/plugins/current/using-ingest-attachment.html

You can define indexed_chars as a pipeline setting here but detect_language feature is not available. If you need it, we can probably add it. Can you open a feature request for that?

I think this is something which can come after https://github.com/elastic/elasticsearch/pull/22339 is merged.

Note that FSCrawler project supports lang detection.

HTH

5

I guess i tried it via the same documentation link, seems the documentation got updated :slight_smile: , i have logged a feature request for this.

Thanks,
Vikas.

6

Saw it. But can you update it as per my comment?

7

Done