Upgrade EL 5.6.7 to 6.1.x: need to reindex

[JR_FFM]

Hi,

I want to upgrade my single-node Elasticsearch environment from 5.6.7 to 6.1.x. My first attempt ended in the error that my index needs a reindex before the upgrade to 6.1.x (because I've upgraded from 2.x to 5.x some many month ago and did not reindex).
Because I'm not firm of the Elasticsearch-API and I stopped trying after a couple of unsuccessful attempts, could somebody tell me how I ca reindex my EL-environment?

Here are some information of my environment:

OS: Debian 9.3
Elasticsearch-version: 5.6.7
EL-index (extract):

Blockquote
curl -XGET 'sv00021.samsongroup.intra:9200/_cat/indices?v&pretty'
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
yellow open winlogbeat-2016.05.18 O9vY1mr7Scmln4PPhUqbiw 5 1 3761964 0 1.6gb 1.6gb
yellow open filebeat-2017.11.24 L9ueWehiTgagh2r50hdMdg 5 1 79853 0 31mb 31mb
yellow open winlogbeat-2015.05.19 ujkt5is7QJqtAWOmwua0bQ 5 1 39 0 156.7kb 156.7kb
yellow open filebeat-2016.11.01 8bxQa0s9SMeRwsFUSkSM4g 5 1 3595 0 2.8mb 2.8mb
yellow open winlogbeat-2017.10.05 sBjSEWy-QBKG8NepXO6iSA 5 1 2229327 0 1.3gb 1.3gb
yellow open filebeat-2016.07.01 Bgn_ilFKQ3S1rrKLSY7mmQ 5 1 237218 0 109.9mb 109.9mb
yellow open winlogbeat-2017.08.26 WviNoQzmQAugi2kVsds7hw 5 1 2382636 0 1.6gb 1.6gb
yellow open filebeat-2016.10.25 KTiD-_v_T3e38PJ0aCEiZw 5 1 2674 0 2mb 2mb
yellow open filebeat-2017.08.09 vggSu6WgS8KxpLCxoJKTIQ 5 1 60489 0 17mb 17mb
yellow open winlogbeat-2015.08.09 C11TldWPS0KkKDxjhih63w 5 1 419 0 614.9kb 614.9kb
yellow open filebeat-2018.01.14 BMGmdGqOS22kvOKpNk2IHg 5 1 120175 0 39.1mb 39.1mb
yellow open winlogbeat-2017.06.15 GwY7sxRxS36izvBgq0Itow 5 1 4060771 0 2.6gb 2.6gb
yellow open filebeat-2017.06.23 M5-307RkR1-zM8OAAqm4fw 5 1 41034 0 11.3mb 11.3mb
yellow open winlogbeat-2017.12.23 pSn-fGxrRTuYdQlUwNitpA 5 1 5572528 0 4.3gb 4.3gb
yellow open filebeat-2016.07.27 L3yQrt2_RquIGe62qU87jg 5 1 322562 0 144.8mb 144.8mb
yellow open winlogbeat-2015.09.05 hKtJ-mB9T1y6ZyHRVjMTMA 5 1 188 0 351.3kb 351.3kb
yellow open winlogbeat-2016.04.27 tmxLWhYATCuET0ChilEzkQ 5 1 2552021 0 951.3mb 951.3mb
yellow open winlogbeat-2017.01.31 zwMPLrizQ0KWG-GKSt0CnQ 5 1 4392679 0 2.6gb 2.6gb
yellow open winlogbeat-2016.11.23 uLHT8H90Txy3U2pxn9tnfA 5 1 4177684 0 2.3gb 2.3gb
yellow open winlogbeat-2017.02.23 pdbEgsXbQje_K-GymSrvZg 5 1 4197815 0 2.7gb 2.7gb
yellow open filebeat-2016.06.26 1Z6Lki_DQfWXLoaEg-z2Zg 5 1 7870 0 3mb 3mb
yellow open winlogbeat-2016.05.22 DHiX6crxTaeABNd7wPb0Ow 5 1 3826312 0 1.7gb 1.7gb
yellow open winlogbeat-2017.12.01 cS1WE9ylRvqNgL8_2mmgQg 5 1 3932630 0 2.7gb 2.7gb
yellow open filebeat-2016.06.11 GwCzTKzWTZWQDN83K7oZwQ 5 1 500 0 350.6kb 350.6kb
yellow open winlogbeat-2015.05.09 GSccEpOLRW6Ar3TVj_eJhA 5 1 35 0 177.3kb 177.3kb
yellow open filebeat-2017.08.11 ANZK_Vl-Ri-3hUKvzkyGQg 5 1 65840 0 15.1mb 15.1mb
yellow open filebeat-2017.10.09 X8dyqDpASbqynRkAwPLWKg 5 1 15921 0 3.9mb 3.9mb
yellow open filebeat-2016.09.04 ltRXDRC3TuuxIOSVa2T0hw 5 1 324 0 233.1kb 233.1kb
yellow open filebeat-2016.05.28 gbjZ-Z0xTOWKSpiAIQ9Rgw 5 1 168 0 216.7kb 216.7kb
yellow open winlogbeat-2016.07.30 s9fvNkKbQgOmRnmUuM-Xtg 5 1 1602927 0 717.2mb 717.2mb
yellow open winlogbeat-2015.07.22 Yd9I7aBzRVmUG8rN57I3Kw 5 1 232 0 448.4kb 448.4kb
yellow open winlogbeat-2015.03.05 H-gK4EU8RUS6-xc8OZuylw 5 1 161 0 255.2kb 255.2kb
yellow open winlogbeat-2017.01.20 1Ce8cThTTL-f5H4xzxbhEQ 5 1 4949943 0 2.6gb 2.6gb
yellow open filebeat-2017.12.28 QFaUQQa4Q9q4iMos1NNpDw 5 1 113879 0 35.1mb 35.1mb
yellow open winlogbeat-2017.06.05 KJ91cc9dRd22xAqrkcMcsQ 5 1 3521917 0 2.3gb 2.3gb
yellow open winlogbeat-2015.12.21 oyUfD-FFTuK45l9ZC1YDUw 5 1 499 0 666.4kb 666.4kb
yellow open filebeat-2017.10.12 ecbTJsRcQRug-E6xxRTVnw 5 1 37757 0 10.1mb 10.1mb
yellow open winlogbeat-2016.04.17 g61D2w2iQ8egSzlP5BnxSg 5 1 4722 0 3.4mb 3.4mb
yellow open filebeat-2017.06.19 ptam9KU-RjC9eVoY2z8Wpg 5 1 46855 0 12.6mb 12.6mb
...
Blockquote

[dadoonet (David Pilato)]

You have a built in reindex API and also if you install xpack with its basic license (free), you have the reindex helper in the migration plugin in Kibana.

[JR_FFM]

Hello,

thank you for your answer. Yesterday I've installed the X-Pack-software and had to realize that it jamed my elasticsearch. The elasticsearch.log-file was filled up with following messages:

Blockquote
[2018-01-31T20:39:03,539][WARN ][o.e.x.m.MonitoringService] [fSMAwKI] monitoring execution failed
org.elasticsearch.xpack.monitoring.exporter.ExportException: Exception when closing export bulk
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$1$1.(ExportBulk.java:106) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$1.onFailure(ExportBulk.java:104) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound$1.onResponse(ExportBulk.java:217) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound$1.onResponse(ExportBulk.java:211) ~[?:?]
at org.elasticsearch.xpack.common.IteratingActionListener.onResponse(IteratingActionListener.java:108) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.ExportBulk$Compound.lambda$null$0(ExportBulk.java:175) ~[?:?]
at org.elasticsearch.action.ActionListener$1.onFailure(ActionListener.java:67) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.throwExportException(LocalBulk.java:137) ~[?:?]
at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.lambda$doFlush$0(LocalBulk.java:114) ~[?:?]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:59) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:88) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:84) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.lambda$apply$0(SecurityActionFilter.java:127) ~[?:?]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:59) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.bulk.TransportBulkAction$BulkRequestModifier.lambda$wrapActionListenerIfNeeded$0(TransportBulkAction.java:583) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:59) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation$1.finishHim(TransportBulkAction.java:389) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation$1.onFailure(TransportBulkAction.java:384) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.TransportAction$1.onFailure(TransportAction.java:94) ~[elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.ActionListener$1.onFailure(ActionListener.java:67) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.ContextPreservingActionListener.onFailure(ContextPreservingActionListener.java:50) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.finishAsFailed(TransportReplicationAction.java:857) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.retry(TransportReplicationAction.java:826) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.retryBecauseUnavailable(TransportReplicationAction.java:892) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.retryIfUnavailable(TransportReplicationAction.java:728) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.doRun(TransportReplicationAction.java:681) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase$2.onTimeout(TransportReplicationAction.java:846) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:311) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.cluster.ClusterStateObserver.waitForNextChange(ClusterStateObserver.java:139) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.cluster.ClusterStateObserver.waitForNextChange(ClusterStateObserver.java:111) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.cluster.ClusterStateObserver.waitForNextChange(ClusterStateObserver.java:103) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.retry(TransportReplicationAction.java:832) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.retryBecauseUnavailable(TransportReplicationAction.java:892) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.retryIfUnavailable(TransportReplicationAction.java:728) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.action.support.replication.TransportReplicationAction$ReroutePhase.doRun(TransportReplicationAction.java:681) [elasticsearch-5.6.7.jar:5.6.7]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-5.6.7.jar:5.6.7]
at
...
Blockquote

So I've deinstalled the X-Pack-software again.
And with the reindex-API... we won't be friends.

Could you give me a hint?