ES create indexes\reindex are slow when using a synonym file

Elastic Stack Elasticsearch
1

We have synonym file 38M
when we create index with filter

        "dictionary": {
          "expand": false,
          "lenient": true,
          "synonyms_path": "linguistics/expert_20231123/em_dictionary.txt",
          "type": "synonym"
        }

we lose performance 10 times
when we run the reindex, it crashes with an error

        "index" : "prod_expert_reindex01",
        "id" : "189_251388",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/TaP-eTEsQKaiehX-gXkJbg]) within 30s"
        },
        "status" : 503

elasticsearch.yml

cluster.name: expert
cluster.publish.timeout: 120s
cluster.publish.info_timeout: 120s
cluster.routing.allocation.awareness.attributes: rack_id
cluster.routing.use_adaptive_replica_selection: true
node.name: es-master-expert04_1
node.attr.rack_id: es-master-expert04

network.publish_host: _eth0:ipv4_
transport.port: 9311
transport.bind_host: 0.0.0.0
http.port: 9211
http.host: 0.0.0.0
node.roles: [ master ]

path.logs: /var/log/elasticsearch
path.data: ["/var/lib/elasticsearch"]
http.max_content_length: 1024mb
http.max_header_size: 1024k
http.cors.enabled: true
http.cors.allow-origin: "*"

thread_pool:
    generic:
        core: '8'
        max: '32'
    management:
        core: '12'
        max: '32'
    write:
        size: '4'
        queue_size: '400'
    search:
        size: '24'
        queue_size: '1000'
    analyze:
        size: '24'
        queue_size: '1000'
    get:
        size: '12'
        queue_size: '1000'
    force_merge:
        size: '6'
        queue_size: '500'


indices.queries.cache.size: 5%
indices.recovery.max_bytes_per_sec: 90mb

script.painless.regex.enabled: true
script.max_compilations_rate: 100/1m

indices.query.bool.max_clause_count: 262144
bootstrap.memory_lock: true

xpack.security.enabled: false

gateway.recover_after_time: 420s
2

Hi @ryzhovas,

Welcome! Can you give us more information on your cluster (number of nodes and shards)?

I'm not sure if this is specifically a synonym issue, but it might be worth simulating the number of tokens generated using this file for a particular document using the _analyze API.

Otherwise, it might be down to cluster sizing but it's difficult to say. There are some tips in this thread too.

3

Hi @carly.richmond

we have 4 clusters with the same problem
The last one has this configuration
3 master nodes
4CPU 8GB heap
18 date node
12 CPU 14 GB heap

Index 12 shards and replication factor 2
if we delete "dictionary" filter its work perfect, but we need thz file

4

tokens for documents are 1 to 1. i.e. as many as there were during tokenization, the same number after applying the filter (with the exception of subtracting stop words). Exclicit mapping is used.

During the creation of such an index or re-index, only 1 CPU core is always utilized on the master host

5

master_es
master_es1920×1104 277 KB

6

and i have next:

{
  "completed" : true,
  "task" : {
    "node" : "W4Qx3bxeRuyjYVF_1EAqbw",
    "id" : 246392,
    "type" : "transport",
    "action" : "indices:data/write/reindex",
    "status" : {
      "total" : 1118404,
      "updated" : 0,
      "created" : 114,
      "deleted" : 0,
      "batches" : 12,
      "version_conflicts" : 0,
      "noops" : 0,
      "retries" : {
        "bulk" : 0,
        "search" : 0
      },
      "throttled_millis" : 0,
      "requests_per_second" : -1.0,
      "throttled_until_millis" : 0,
      "slices" : [
        {
          "slice_id" : 0,
          "total" : 92865,
          "updated" : 0,
          "created" : 12,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 1,
          "total" : 93336,
          "updated" : 0,
          "created" : 5,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 2,
          "total" : 93279,
          "updated" : 0,
          "created" : 11,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 3,
          "total" : 93193,
          "updated" : 0,
          "created" : 4,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 4,
          "total" : 93154,
          "updated" : 0,
          "created" : 12,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 5,
          "total" : 93299,
          "updated" : 0,
          "created" : 9,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 6,
          "total" : 92921,
          "updated" : 0,
          "created" : 14,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 7,
          "total" : 93412,
          "updated" : 0,
          "created" : 9,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 8,
          "total" : 93402,
          "updated" : 0,
          "created" : 12,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 9,
          "total" : 92691,
          "updated" : 0,
          "created" : 12,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 10,
          "total" : 93487,
          "updated" : 0,
          "created" : 8,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        },
        {
          "slice_id" : 11,
          "total" : 93365,
          "updated" : 0,
          "created" : 6,
          "deleted" : 0,
          "batches" : 1,
          "version_conflicts" : 0,
          "noops" : 0,
          "retries" : {
            "bulk" : 0,
            "search" : 0
          },
          "throttled_millis" : 0,
          "requests_per_second" : -1.0,
          "throttled_until_millis" : 0
        }
      ]
    },
    "description" : "reindex from [prod_expert] to [prod_expert_reindex01]",
    "start_time_in_millis" : 1701938872619,
    "running_time_in_nanos" : 900452499626,
    "cancellable" : true,
    "cancelled" : false,
    "headers" : {
      "trace.id" : "10e410b418dcc11b5b3764b3a52cea44"
    }
  },
  "response" : {
    "took" : 900420,
    "timed_out" : false,
    "total" : 1118404,
    "updated" : 0,
    "created" : 114,
    "deleted" : 0,
    "batches" : 12,
    "version_conflicts" : 0,
    "noops" : 0,
    "retries" : {
      "bulk" : 0,
      "search" : 0
    },
    "throttled" : "0s",
    "throttled_millis" : 0,
    "requests_per_second" : -1.0,
    "throttled_until" : "0s",
    "throttled_until_millis" : 0,
    "slices" : [
      {
        "slice_id" : 0,
        "total" : 92865,
        "updated" : 0,
        "created" : 12,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 1,
        "total" : 93336,
        "updated" : 0,
        "created" : 5,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 2,
        "total" : 93279,
        "updated" : 0,
        "created" : 11,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 3,
        "total" : 93193,
        "updated" : 0,
        "created" : 4,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 4,
        "total" : 93154,
        "updated" : 0,
        "created" : 12,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 5,
        "total" : 93299,
        "updated" : 0,
        "created" : 9,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 6,
        "total" : 92921,
        "updated" : 0,
        "created" : 14,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 7,
        "total" : 93412,
        "updated" : 0,
        "created" : 9,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 8,
        "total" : 93402,
        "updated" : 0,
        "created" : 12,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 9,
        "total" : 92691,
        "updated" : 0,
        "created" : 12,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 10,
        "total" : 93487,
        "updated" : 0,
        "created" : 8,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      },
      {
        "slice_id" : 11,
        "total" : 93365,
        "updated" : 0,
        "created" : 6,
        "deleted" : 0,
        "batches" : 1,
        "version_conflicts" : 0,
        "noops" : 0,
        "retries" : {
          "bulk" : 0,
          "search" : 0
        },
        "throttled" : "0s",
        "throttled_millis" : 0,
        "requests_per_second" : -1.0,
        "throttled_until" : "0s",
        "throttled_until_millis" : 0
      }
    ],
    "failures" : [
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_235182",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_235336",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_235314",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_73327",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_74120",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_70552",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_74658",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_74600",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_77891",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "30_163",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "30_166",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "30_226",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "30_301",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "12_162250",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "12_162253",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "12_162308",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "12_162415",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_60499",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_60546",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_60518",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_60528",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_128951",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_128869",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_129162",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_129361",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_129511",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_129585",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_129628",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_243168",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_251276",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_251388",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_117860",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "85_520181",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "85_517831",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "86_415813",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "86_592534",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "86_605754",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_614785",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "118_51667",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "118_16863",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "118_16825",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "118_28263",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "118_21713",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "118_21959",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_751881",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_751875",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_751792",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_256138",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_256213",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_256240",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1031947",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1031983",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1032275",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1032309",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1032421",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1032521",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "189_1033228",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_140418",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_140688",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_141188",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_141568",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_121127",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_121174",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_121191",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_121320",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      },
      {
        "index" : "prod_expert_reindex01",
        "id" : "16_121349",
        "cause" : {
          "type" : "process_cluster_event_timeout_exception",
          "reason" : "failed to process cluster event (put-mapping [prod_expert_reindex01/85zM-bdKSHWX_E2yINiIBg]) within 30s"
        },
        "status" : 503
      }
    ]
  }
}

on my test cluster

image
image3342×1080 228 KB

POST _reindex?wait_for_completion=false&timeout=15m&slices=auto
{
  "source": {
    "index": "prod_expert",
    "size": 10
  },
  "dest": {
    "index": "prod_expert_reindex01",
    "version_type": "internal", 
    "op_type": "create" 
  },
  "conflicts": "proceed"
}
7

GET _nodes/es-master-expert04_1/hot_threads

::: {es-master-expert04_1}{W4Qx3bxeRuyjYVF_1EAqbw}{V2foHkogQKiIL529jaHp-A}{es-master-expert04_1}{10.108.83.48}{10.108.83.48:9311}{m}{8.11.1}{7000099-8500003}{ml.config_version=11.0.0, rack_id=es-master-expert04, xpack.installed=true, transform.config_version=10.0.0}
   Hot threads at 2023-12-07T09:29:11.104Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:
   
   100.1% [cpu=100.1%, other=0.0%] (500.5ms out of 500ms) cpu usage by thread 'elasticsearch[es-master-expert04_1][masterService#updateTask][T#312]'
     2/10 snapshots sharing following 87 elements
       java.base@21.0.1/java.util.regex.Pattern.lambda$union$3(Pattern.java:5802)
       java.base@21.0.1/java.util.regex.Pattern$$Lambda/0x800000033.is(Unknown Source)
       java.base@21.0.1/java.util.regex.Pattern.lambda$union$3(Pattern.java:5802)
       java.base@21.0.1/java.util.regex.Pattern$$Lambda/0x800000033.is(Unknown Source)
       java.base@21.0.1/java.util.regex.Pattern.lambda$union$3(Pattern.java:5802)
       java.base@21.0.1/java.util.regex.Pattern$$Lambda/0x800000033.is(Unknown Source)
       java.base@21.0.1/java.util.regex.Pattern.lambda$union$3(Pattern.java:5802)
       java.base@21.0.1/java.util.regex.Pattern$$Lambda/0x800000033.is(Unknown Source)
       java.base@21.0.1/java.util.regex.Pattern.lambda$union$3(Pattern.java:5802)
       java.base@21.0.1/java.util.regex.Pattern$$Lambda/0x800000033.is(Unknown Source)
       java.base@21.0.1/java.util.regex.Pattern.lambda$negate$7(Pattern.java:5818)
       java.base@21.0.1/java.util.regex.Pattern$$Lambda/0x800000032.is(Unknown Source)
       java.base@21.0.1/java.util.regex.Pattern$CharProperty.match(Pattern.java:4109)
       java.base@21.0.1/java.util.regex.Pattern$Branch.match(Pattern.java:4914)
       java.base@21.0.1/java.util.regex.Pattern$GroupHead.match(Pattern.java:4969)
       java.base@21.0.1/java.util.regex.Pattern$Behind.match(Pattern.java:5416)
       java.base@21.0.1/java.util.regex.Pattern$GroupHead.match(Pattern.java:4969)
       java.base@21.0.1/java.util.regex.Pattern$GroupHead.match(Pattern.java:4969)
       java.base@21.0.1/java.util.regex.Pattern$Behind.match(Pattern.java:5416)
       java.base@21.0.1/java.util.regex.Pattern$GroupHead.match(Pattern.java:4969)
       java.base@21.0.1/java.util.regex.Pattern$Branch.match(Pattern.java:4914)
       java.base@21.0.1/java.util.regex.Pattern$StartS.match(Pattern.java:3820)
       java.base@21.0.1/java.util.regex.Matcher.search(Matcher.java:1767)
       java.base@21.0.1/java.util.regex.Matcher.find(Matcher.java:787)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.processPattern(PatternReplaceCharFilter.java:94)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:70)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.util.RollingCharBuffer.get(RollingCharBuffer.java:81)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.charfilter.MappingCharFilter.read(MappingCharFilter.java:97)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.charfilter.MappingCharFilter.read(MappingCharFilter.java:178)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternTokenizer.fillBuffer(PatternTokenizer.java:167)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternTokenizer.reset(PatternTokenizer.java:155)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       ru.action.elasticsearch.plugin.delimeter.filter.CustomDelimiterFilter.reset(CustomDelimiterFilter.java:162)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       ru.action.elasticsearch.plugin.shiftingstopwords.filter.PositionShiftingStopFilter.reset(PositionShiftingStopFilter.java:107)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SynonymMap$Parser.analyze(SynonymMap.java:324)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.ESSolrSynonymParser.analyze(ESSolrSynonymParser.java:46)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SolrSynonymParser.addInternal(SolrSynonymParser.java:99)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SolrSynonymParser.parse(SolrSynonymParser.java:71)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.SynonymTokenFilterFactory.buildSynonyms(SynonymTokenFilterFactory.java:147)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.SynonymTokenFilterFactory.getChainAwareTokenFilterFactory(SynonymTokenFilterFactory.java:94)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalyzerComponents.createComponents(AnalyzerComponents.java:82)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.CustomAnalyzerProvider.create(CustomAnalyzerProvider.java:60)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.CustomAnalyzerProvider.build(CustomAnalyzerProvider.java:42)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.produceAnalyzer(AnalysisRegistry.java:707)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:615)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:213)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.IndexModule.newIndexMapperService(IndexModule.java:647)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.indices.IndicesService.createIndexMapperServiceForValidation(IndicesService.java:846)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.metadata.MetadataMappingService$PutMappingExecutor.execute(MetadataMappingService.java:109)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.innerExecuteTasks(MasterService.java:1039)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:1004)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.executeAndPublishBatch(MasterService.java:232)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$$Lambda/0x00007fa6f86ef958.runBatch(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.lambda$run$2(MasterService.java:1626)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor$$Lambda/0x00007fa6f90678d0.accept(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.action.ActionListener.run(ActionListener.java:368)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.run(MasterService.java:1623)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5.lambda$doRun$0(MasterService.java:1237)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5$$Lambda/0x00007fa6f9066898.accept(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.action.ActionListener.run(ActionListener.java:368)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5.doRun(MasterService.java:1216)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:983)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)
       java.base@21.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
       java.base@21.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
       java.base@21.0.1/java.lang.Thread.runWith(Thread.java:1596)
       java.base@21.0.1/java.lang.Thread.run(Thread.java:1583)
     2/10 snapshots sharing following 49 elements
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.fill(PatternReplaceCharFilter.java:67)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternReplaceCharFilter.read(PatternReplaceCharFilter.java:58)
       java.base@21.0.1/java.io.Reader.read(Reader.java:265)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternTokenizer.fillBuffer(PatternTokenizer.java:167)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.pattern.PatternTokenizer.reset(PatternTokenizer.java:155)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       ru.action.elasticsearch.plugin.delimeter.filter.CustomDelimiterFilter.reset(CustomDelimiterFilter.java:162)
       app/org.apache.lucene.core@9.8.0/org.apache.lucene.analysis.TokenFilter.reset(TokenFilter.java:69)
       ru.action.elasticsearch.plugin.shiftingstopwords.filter.PositionShiftingStopFilter.reset(PositionShiftingStopFilter.java:107)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SynonymMap$Parser.analyze(SynonymMap.java:324)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.ESSolrSynonymParser.analyze(ESSolrSynonymParser.java:46)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SolrSynonymParser.addInternal(SolrSynonymParser.java:99)
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SolrSynonymParser.parse(SolrSynonymParser.java:71)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.SynonymTokenFilterFactory.buildSynonyms(SynonymTokenFilterFactory.java:147)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.SynonymTokenFilterFactory.getChainAwareTokenFilterFactory(SynonymTokenFilterFactory.java:94)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalyzerComponents.createComponents(AnalyzerComponents.java:82)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.CustomAnalyzerProvider.create(CustomAnalyzerProvider.java:60)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.CustomAnalyzerProvider.build(CustomAnalyzerProvider.java:42)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.produceAnalyzer(AnalysisRegistry.java:707)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:615)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:213)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.IndexModule.newIndexMapperService(IndexModule.java:647)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.indices.IndicesService.createIndexMapperServiceForValidation(IndicesService.java:846)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.metadata.MetadataMappingService$PutMappingExecutor.execute(MetadataMappingService.java:109)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.innerExecuteTasks(MasterService.java:1039)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:1004)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.executeAndPublishBatch(MasterService.java:232)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$$Lambda/0x00007fa6f86ef958.runBatch(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.lambda$run$2(MasterService.java:1626)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor$$Lambda/0x00007fa6f90678d0.accept(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.action.ActionListener.run(ActionListener.java:368)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.run(MasterService.java:1623)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5.lambda$doRun$0(MasterService.java:1237)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5$$Lambda/0x00007fa6f9066898.accept(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.action.ActionListener.run(ActionListener.java:368)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5.doRun(MasterService.java:1216)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:983)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)
       java.base@21.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
       java.base@21.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
       java.base@21.0.1/java.lang.Thread.runWith(Thread.java:1596)
       java.base@21.0.1/java.lang.Thread.run(Thread.java:1583)
     6/10 snapshots sharing following 30 elements
       app/org.apache.lucene.analysis.common@9.8.0/org.apache.lucene.analysis.synonym.SolrSynonymParser.parse(SolrSynonymParser.java:71)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.SynonymTokenFilterFactory.buildSynonyms(SynonymTokenFilterFactory.java:147)
       org.elasticsearch.analysis.common@8.11.1/org.elasticsearch.analysis.common.SynonymTokenFilterFactory.getChainAwareTokenFilterFactory(SynonymTokenFilterFactory.java:94)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalyzerComponents.createComponents(AnalyzerComponents.java:82)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.CustomAnalyzerProvider.create(CustomAnalyzerProvider.java:60)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.CustomAnalyzerProvider.build(CustomAnalyzerProvider.java:42)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.produceAnalyzer(AnalysisRegistry.java:707)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:615)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:213)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.index.IndexModule.newIndexMapperService(IndexModule.java:647)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.indices.IndicesService.createIndexMapperServiceForValidation(IndicesService.java:846)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.metadata.MetadataMappingService$PutMappingExecutor.execute(MetadataMappingService.java:109)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.innerExecuteTasks(MasterService.java:1039)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:1004)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService.executeAndPublishBatch(MasterService.java:232)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$$Lambda/0x00007fa6f86ef958.runBatch(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.lambda$run$2(MasterService.java:1626)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor$$Lambda/0x00007fa6f90678d0.accept(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.action.ActionListener.run(ActionListener.java:368)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.run(MasterService.java:1623)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5.lambda$doRun$0(MasterService.java:1237)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5$$Lambda/0x00007fa6f9066898.accept(Unknown Source)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.action.ActionListener.run(ActionListener.java:368)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.cluster.service.MasterService$5.doRun(MasterService.java:1216)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:983)
       app/org.elasticsearch.server@8.11.1/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)
       java.base@21.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
       java.base@21.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
       java.base@21.0.1/java.lang.Thread.runWith(Thread.java:1596)
       java.base@21.0.1/java.lang.Thread.run(Thread.java:1583)
8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.