Reindex in elasticsearch 7.17 as pre-upgrade to 8.x

Elastic Stack Elasticsearch
1

Elasticsearch team: in need of a guidancee/help

Now am in a upgrade from 6.8 to 8.x(latest)

Progress:

  • Have 6.8 server with 6.8 indices(created in 5.6 and upgraded to 6.8 few years back) with multi-type
  • Reindexed to single-type in 6.8- deleted 5.6 ones
  • Installed 7.17 and booted success as GREEN
  • as preparing to 8.x; trying reindex in 7.17 and failing (processing few 100s only from few million count) on 4 indices of 7(these 4 had multi type in 6 and changed to _doc in 7.17 with reindex)
curl -XPOST http://server:9210/_reindex?wait_for_completion=false \
-u 'user:password' \
-H 'Content-Type: application/json'  \
-d'{
  "conflicts": "proceed",
  "source": {
    "index": "reindex-6"
  },
  "dest": {
    "index": "reindex-7"
  }
}'

Reindex state:

  • "total": 7866333,
  • "updated": 833,
"failures": [

* {
  * "index": "reindex-7",
  * "type": "_doc",
  * "id": "<id>",
  * "cause": {
    * "type": "mapper_parsing_exception",
    * "reason": "failed to parse",
    * "caused_by": {
      * "type": "json_parse_exception",
      * "reason": "Duplicate field 'type' at [Source: (ByteArrayInputStream); line: 1, column: 65]"}},
  * "status": 400}

How to reindex success with 7.17 index having all _doc
An note: Separate 8.9.1 cluster with created single-type indices(we do have 7 indices) working
Above reindexing is for data migration of ~200GB[~90 million docs]

Regards
Indu

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.