# Reindexing 1.7 to 2.4.4 fails

**URL:** https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702
**Category:** Elasticsearch
**Created:** [July 26, 2017, 8:25pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702 "2017-07-26T20:25:45Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![Marjana](https://avatars.discourse-cdn.com/v4/letter/m/6a8cbe/32.png) [@Marjana](https://discuss.elastic.co/u/Marjana)
#### Post date: [July 26, 2017, 8:25pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/1 "2017-07-26T20:25:46Z")

</div>

Hi,  
I am using migration plugin to reindex 1.7.1 indices to 2.4.4, so we can migrate to 5.x.  
I managed to reindex some indices but most of them are failing. New index gets created but reindex fails. I tried to do it manually, copy\>pasting the reindex command from the migration tool (and changing wait\_for\_completion to true).  
Here is an example of one command and the output I get:

> curl -XPOST '[http://elasearch03001.pod01:9201/\_reindex?wait\_for\_completion=true](http://elasearch03001.pod01:9201/_reindex?wait_for_completion=true)' -d '  
> {  
> "source": {  
> "index": "sessions\_org4\_2017\_07\_17",  
> "sort": "\_doc",  
> "size": 1000  
> },  
> "dest": {  
> "index": "sessions\_org4\_2017\_07\_17-2.4.4",  
> "version\_type": "external"  
> }  
> }  
> '

What does this output mean "source is missing"? Both indices are present. One 2.4.4 has 0 docs, while the original has 57794 docs.

{"error":{"root\_cause":[{"type":"action\_request\_validation\_exception","reason":"Validation Failed: 1: source is missing;2: source is missing;3: source is missing;4: source is missing;5: source is missing;6: source is missing;7: source is missing;8: source is missing;9: source is missing;10: source is missing;11: source is missing;12: source is missing;13: source is missing;14:.....source is missing;724: source is missing;725: source is missing;726: source is missing;727: source is missing;"},"status":400}

Thanks

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [July 26, 2017, 9:41pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/2 "2017-07-26T21:41:38Z")

</div>

What does the mapping for the source index look like?

---

<div class="post-metadata">

### Author: ![Marjana](https://avatars.discourse-cdn.com/v4/letter/m/6a8cbe/32.png) [@Marjana](https://discuss.elastic.co/u/Marjana)
#### Post date: [July 26, 2017, 9:53pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/3 "2017-07-26T21:53:19Z")

</div>

`"sessions_org4_2017_07_17":{"mappings":{"_default_":{"_all":{"enabled":false},"_timestamp":{},"dynamic_templates":[{"event":{"mapping":{"index":"not_analyzed","store":false,"type":"integer"},"path_match":"Events.*"}},{"session_attribute":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"SessionAttributes.*"}},{"url_argument":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"screenViews.args.*"}},{"http_header":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"httpHeaders.*"}},{"cookie":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"cookies.*"}},{"dimension":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"match":"Dim*"}},{"generic":{"mapping":{"index":"no","store":false,"type":"{dynamic_type}"},"match":"@&~((Events|SessionAttributes)\\.*)","match_pattern":"regex"}}]},"freetexthit":{"_all":{"enabled":false},"_parent":{"type":"hit"},"_routing":{"required":true},"_source":{"enabled":false},"_timestamp":{},"dynamic_templates":[{"event":{"mapping":{"index":"not_analyzed","store":false,"type":"integer"},"path_match":"Events.*"}},{"session_attribute":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"SessionAttributes.*"}},{"url_argument":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"screenViews.args.*"}},{"http_header":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"httpHeaders.*"}},{"cookie":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"cookies.*"}},{"dimension":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"match":"Dim*"}},{"generic":{"mapping":{"index":"no","store":false,"type":"{dynamic_type}"},"match":"@&~((Events|SessionAttributes)\\.*)","match_pattern":"regex"}}],"properties":{"OrgCode":{"type":"string","analyzer":"custom_lowercase"},"freeText":{"type":"string","analyzer":"standard"}}},"hit":{"_all":{"enabled":false},"_parent":{"type":"session"},"_routing":{"required":true},"_timestamp":{},"dynamic_templates":[{"event":{"mapping":{"index":"not_analyzed","store":false,"type":"integer"},"path_match":"Events.*"}},{"session_attribute":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"SessionAttributes.*"}},{"url_argument":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"screenViews.args.*"}},{"http_header":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"httpHeaders.*"}},{"cookie":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"cookies.*"}},{"dimension":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"match":"Dim*"}},{"generic":{"mapping":{"index":"no","store":false,"type":"{dynamic_type}"},"match":"@&~((Events|SessionAttributes)\\.*)","match_pattern":"regex"}}],"properties":{"CollectorDCName":{"type":"string","index":"no"},"CollectorNodeID":{"type":"string","index":"no"},"Cookies":{"type":"nested","properties":{"Name":{"type":"string","index":"not_analyzed"},"Value":{"type":"string","analyzer":"custom_lowercase"}}},"HitDataType":{"type":"string","index":"no"},"HitNumber":{"type":"long"},"HitSource":{"type":"string","index":"no"},"HitTime":{"type":"long"},"HttpHeaders":{"type":"nested","properties":{"Name":{"type":"string","index":"not_analyzed"},"Value":{"type":"string","analyzer":"custom_lowercase"}}},"KafkaOffset":{"type":"long"},"KafkaPartition":{"type":"integer"},"KafkaTopic":{"type":"string","index":"not_analyzed"},"OrgCode":{"type":"string","analyzer":"custom_lowercase"},"ProcID":{"type":"integer"},"ProcServerID":{"type":"integer"},"ScreenViewCount":{"type":"integer"},"ScreenViewSources":{"properties":{"Count":{"type":"integer"},"Name":{"type":"string","index":"no"}}},"TLTHID":{"type":"string","index":"not_analyzed"},"TLTSID":{"type":"string","analyzer":"custom_lowercase"},"TimeBlock":{"properties":{"DAY_OF_MONTH":{"type":"byte"},"DAY_OF_WEEK":{"type":"byte"},"DAY_OF_YEAR":{"type":"short"},"HOUR_OF_DAY":{"type":"byte"},"MONTH":{"type":"byte"},"QUARTER":{"type":"byte"},"WEEK_OF_YEAR":{"type":"byte"},"YEAR":{"type":"short"}}},"facts":{"type":"nested","properties":{"Dimensions":{"type":"nested","properties":{"ID":{"type":"integer"},"Value":{"type":"string","analyzer":"custom_lowercase"}}},"EventID":{"type":"long"},"NumericValue":{"type":"double"},"StepNumber":{"type":"long"},"Value":{"type":"string","analyzer":"custom_lowercase"}}},"freeText":{"type":"string","analyzer":"standard"},"screenViews":{"properties":{"arguments":{"type":"nested","properties":{"Name":{"type":"string","index":"not_analyzed"},"Value":{"type":"string","analyzer":"custom_lowercase"}}},"fragment":{"type":"string","analyzer":"custom_lowercase"},"name":{"type":"string","analyzer":"custom_url"},"queryString":{"type":"string"}}}}},"session":{"_all":{"enabled":false},"_timestamp":{},"dynamic_templates":[{"event":{"mapping":{"index":"not_analyzed","store":false,"type":"integer"},"path_match":"Events.*"}},`

---

<div class="post-metadata">

### Author: ![Marjana](https://avatars.discourse-cdn.com/v4/letter/m/6a8cbe/32.png) [@Marjana](https://discuss.elastic.co/u/Marjana)
#### Post date: [July 26, 2017, 9:53pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/4 "2017-07-26T21:53:30Z")

</div>

`{"session_attribute":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"SessionAttributes.*"}},{"url_argument":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"screenViews.args.*"}},{"http_header":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"httpHeaders.*"}},{"cookie":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"path_match":"cookies.*"}},{"dimension":{"mapping":{"index":"analyzed","store":false,"analyzer":"custom_lowercase","type":"string"},"match":"Dim*"}},{"generic":{"mapping":{"index":"no","store":false,"type":"{dynamic_type}"},"match":"@&~((Events|SessionAttributes)\\.*)","match_pattern":"regex"}}],"properties":{"Active":{"type":"boolean"},"AppKey":{"type":"string","analyzer":"custom_lowercase"},"BrowserName":{"type":"string","analyzer":"custom_lowercase"},"BrowserUserAgent":{"type":"string","analyzer":"custom_lowercase"},"BrowserVersion":{"type":"string","analyzer":"custom_lowercase"},"City":{"type":"string","index":"not_analyzed"},"ClientDuration":{"type":"long"},"CloseEventSource":{"type":"string","index":"no"},"CloseReason":{"type":"string","index":"no"},"CollectorDCName":{"type":"string","index":"no"},"CollectorNodeID":{"type":"string","index":"no"},"Continent":{"type":"string","index":"not_analyzed"},"Country":{"type":"string","index":"not_analyzed"},"CountryCode":{"type":"string","index":"not_analyzed"},"DOMCaptureMissingDCIDs":{"type":"integer"},"Device":{"type":"string","analyzer":"custom_lowercase"},"DeviceManufacturer":{"type":"string","analyzer":"custom_lowercase"},"DeviceMarketingName":{"type":"string","analyzer":"custom_lowercase"},"DeviceModel":{"type":"string","analyzer":"custom_lowercase"},"DeviceTablet":{"type":"boolean"},"DeviceTouchScreen":{"type":"boolean"},"DeviceVendor":{"type":"string","analyzer":"custom_lowercase"},"DeviceYearReleased":{"type":"integer"},"DiscardEventSource":{"type":"string","index":"no"},"DiscardHitNumber":{"type":"integer"},"Discarded":{"type":"boolean"},"DiscardedAnonUBXEvents":{"type":"integer"},"Duration":{"type":"long"},"EventCount":{"type":"integer"},"FactCount":{"type":"integer"},"FirstHitEpoch":{"type":"long"},"FirstScreenView":{"type":"string","analyzer":"custom_lowercase"},"Gestures":{"type":"integer"},"HitContentTypes":{"properties":{"Count":{"type":"integer"},"Name":{"type":"string","index":"no"}}},"HitCount":{"type":"integer"},"HitDataTypes":{"properties":{"Count":{"type":"integer"},"Name":{"type":"string","index":"no"}}},"HitSources":{"properties":{"Count":{"type":"integer"},"Name":{"type":"string","index":"no"}}},"IP":{"type":"string","index":"not_analyzed"},"InitialMobileBatteryLife":{"type":"integer"},"KafkaOffset":{"type":"long"},"KafkaPartition":{"type":"integer"},"KafkaTopic":{"type":"string","index":"not_analyzed"},"KeyboardUses":{"type":"integer"},"Language":{"type":"string","analyzer":"custom_lowercase"},"LastHitEpoch":{"type":"long"},"LastKafkaOffset":{"type":"long"},"LastScreenView":{"type":"string","analyzer":"custom_lowercase"},"MobileAppName":{"type":"string","analyzer":"custom_lowercase"},"MobileAppVersion":{"type":"string","analyzer":"custom_lowercase"},"MobileBatteryLife":{"type":"integer"},"MobileBatteryLifeDelta":{"type":"integer"},"MobileCarrier":{"type":"string","analyzer":"custom_lowercase"},"MobileDevice":{"type":"boolean"},"MobileExceptions":{"type":"integer"},"MobileNetworkReachability":{"type":"string","analyzer":"custom_lowercase"},"MobilePhone":{"type":"boolean"},"NetworkScreenViewContentTypes":{"properties":{"Count":{"type":"integer"},"Name":{"type":"string","index":"no"}}},"OS":{"type":"string","analyzer":"custom_lowercase"},"OSVersion":{"type":"string","analyzer":"custom_lowercase"},"OrgCode":{"type":"string","analyzer":"custom_lowercase"},"OrientationChanges":{"type":"integer"},"OrientationDominant":{"type":"string","analyzer":"custom_lowercase"},"Platform":{"type":"string","analyzer":"custom_lowercase"},"PostalCode":{"type":"string","index":"not_analyzed"},"ProcID":{"type":"integer"},"ProcServerID":{"type":"integer"},"SDKMissingFirstSerialNumbers":{"type":"integer"},"SDKMissingSerialNumbers":{"type":"integer"},"ScreenViewCount":{"type":"integer"},"ScreenViewSources":{"properties":{"Count":{"type":"integer"},"Name":{"type":"string","index":"no"}}},"Size":{"type":"long"},"State":{"type":"string","index":"not_analyzed"},"StruggleScore":{"type":"double"},"TLTSID":{"type":"string","analyzer":"custom_lowercase"},"TealeafSDKType":{"type":"string","analyzer":"custom_lowercase"},"TealeafSDKVersion":{"type":"string","analyzer":"custom_lowercase"},"UBXEventCount":{"type":"integer"},"UBXIdentities":{"type":"nested","properties":{"Name":{"type":"string","index":"not_analyzed"},"Value":{"type":"string","analyzer":"custom_lowercase"}}},"UnresponsiveGestures":{"type":"integer"},"events":{"properties":{"Count":{"type":"integer"},"ID":{"type":"integer"}}},"sessionAttributes":{"type":"nested","properties":{"Name":{"type":"string","index":"not_analyzed"},"Value":{"type":"string","analyzer":"custom_lowercase"}}}}}}}}`

---

<div class="post-metadata">

### Author: ![Marjana](https://avatars.discourse-cdn.com/v4/letter/m/6a8cbe/32.png) [@Marjana](https://discuss.elastic.co/u/Marjana)
#### Post date: [July 26, 2017, 9:54pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/5 "2017-07-26T21:54:46Z")

</div>

too long to place it in one post, had to break it in two.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [July 26, 2017, 11:05pm UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/6 "2017-07-26T23:05:51Z")

</div>

Please format it with code tags 🙂

---

<div class="post-metadata">

### Author: ![Marjana](https://avatars.discourse-cdn.com/v4/letter/m/6a8cbe/32.png) [@Marjana](https://discuss.elastic.co/u/Marjana)
#### Post date: [July 27, 2017, 10:29am UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/7 "2017-07-27T10:29:28Z")

</div>

Sorry about that, it looks better now.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [July 27, 2017, 10:33am UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/8 "2017-07-27T10:33:45Z")

</div>

> [@Marjana](#):
>
> "\_source":{"enabled":false}

It is still hard to read, but there seems to be something in your index that has `_source` disabled, which will prevent it from being reindexed.

---

<div class="post-metadata">

### Author: ![Marjana](https://avatars.discourse-cdn.com/v4/letter/m/6a8cbe/32.png) [@Marjana](https://discuss.elastic.co/u/Marjana)
#### Post date: [July 27, 2017, 10:44am UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/9 "2017-07-27T10:44:40Z")

</div>

Yes, I see it too now, freetexthit field.  
Thank you Christian.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [August 24, 2017, 10:44am UTC](https://discuss.elastic.co/t/reindexing-1-7-to-2-4-4-fails/94702/10 "2017-08-24T10:44:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
