Query in upgrading from 1.7.1 to 2.3.1version of ElasticSearch

Elastic Stack Elasticsearch
1

Currently we are using ElasticSearch 1.7.1, we have planned to upgrade to 2.3.1 and we have done all of the steps as mentioned in the ES 2.3.1 upgrading help documentations.

After we initiated the upgrade, 2.3.1 cluster started and nodes are connected properly, but pending_tasks are increasing consistently. It took more than 4 hours, but still pending_tasks are increasing and those tasks are refresh-mapping [index] fyi.

If anyone done the upgrade to 2.3.1or 2.x versions then can anyone please share your experience about this? Its an usual behaviour?

P.S : We dont have any special configurations in our config file, except basic changes like clustername, nodename, path to logs & data, network.host, unicast nodes.

2

What does hot threads show?

3

Thank you for the reply @warklom, please refer the below content,

Hot threads at 2016-04-20T04:11:48.706Z, interval=500ms, busiestThreads=3, ignoreIdleThreads=true:

95.8% (479.1ms out of 500ms) cpu usage by thread 'elasticsearch[node1][clusterService#updateTask][T#1]'
2/10 snapshots sharing following 18 elements
java.lang.Object.(Object.java:37)
java.util.zip.Deflater.(Deflater.java:168)
org.elasticsearch.common.compress.deflate.DeflateCompressor.streamOutput(DeflateCompressor.java:126)
org.elasticsearch.common.compress.CompressedXContent.(CompressedXContent.java:83)
org.elasticsearch.index.mapper.DocumentMapper.(DocumentMapper.java:209)
org.elasticsearch.index.mapper.DocumentMapper.updateFieldType(DocumentMapper.java:385)
org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:372)
org.elasticsearch.index.mapper.MapperService.merge(MapperService.java:289)
org.elasticsearch.indices.cluster.IndicesClusterStateService.processMapping(IndicesClusterStateService.java:387)
org.elasticsearch.indices.cluster.IndicesClusterStateService.applyMappings(IndicesClusterStateService.java:348)
org.elasticsearch.indices.cluster.IndicesClusterStateService.clusterChanged(IndicesClusterStateService.java:164)
org.elasticsearch.cluster.service.InternalClusterService.runTasksForExecutor(InternalClusterService.java:610)
org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:772)
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231)
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:745)
2/10 snapshots sharing following 22 elements
java.util.zip.CRC32.updateBytes(Native Method)
java.util.zip.CRC32.update(CRC32.java:65)
java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:74)