# Reindex - total vs. created

**URL:** <https://discuss.elastic.co/t/reindex-total-vs-created/88569>\
**Category:** Elasticsearch\
**Created:** [June 7, 2017, 11:48am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569 "2017-06-07T11:48:15Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![mitabrev](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@mitabrev](https://discuss.elastic.co/u/mitabrev)\
**Post date:** [June 7, 2017, 11:48am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/1 "2017-06-07T11:48:15Z")

</div>

Hi helpers,

I have some field mapping conflicts on one of my indices and would like to reindex it.

So I printed out the correct index, copyed/corrected the mapping structure, created a new index and tried to reindex data from old to new index. The problem is, not all data is reindexed. What am I doing wrong?

The printout:

```
curl -XPOST 'localhost:9200/_reindex?&pretty' -d '{
> "conflicts": "proceed",
> "source" : {
> "index" : "mmsc-2017.06.05"
> },
> "dest" : {
> "index" : "mmsc-2017.06.05_new",
> "version_type": "external"
> }
> }'
{
  "took" : 12500,
  "timed_out" : false,
  "total" : 133724,
  "updated" : 0,
  "created" : 17996,
  "deleted" : 0,
  "batches" : 18,
  "version_conflicts" : 0,
  "noops" : 0,
  "retries" : {
    "bulk" : 0,
    "search" : 0
  },
  "throttled_millis" : 0,
  "requests_per_second" : -1.0,
  "throttled_until_millis" : 0,
  "failures" : [

```

So you see, **"total" : 133724 and "created" : 17996**.

Thank you!

---

<div class="post-metadata">

**Author:** ![mitabrev](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@mitabrev](https://discuss.elastic.co/u/mitabrev)\
**Post date:** [June 13, 2017, 12:01pm UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/2 "2017-06-13T12:01:54Z")

</div>

Any ideas?

tnx

---

<div class="post-metadata">

**Author:** ![mitabrev](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@mitabrev](https://discuss.elastic.co/u/mitabrev)\
**Post date:** [July 5, 2017, 9:14am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/3 "2017-07-05T09:14:17Z")

</div>

No ideas? Anyone?

---

<div class="post-metadata">

**Author:** ![jpountz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jpountz/32/45836_2.png) [@jpountz](https://discuss.elastic.co/u/jpountz)\
**Post date:** [July 5, 2017, 1:53pm UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/4 "2017-07-05T13:53:41Z")

</div>

Do you have any failures in the response?

---

<div class="post-metadata">

**Author:** ![mitabrev](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@mitabrev](https://discuss.elastic.co/u/mitabrev)\
**Post date:** [July 6, 2017, 7:21am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/5 "2017-07-06T07:21:09Z")

</div>

failures are like the ones in this topic:

> [@Error parsing csv](https://discuss.elastic.co/t/error-parsing-csv/87893/2):
>
> Any ideas here? Do you need any more info? Thanks! Mario

but as mentioned, i don't see any problems in the input data, shouldn't be any problems parsing...  
maybe too much data?

---

<div class="post-metadata">

**Author:** ![jpountz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jpountz/32/45836_2.png) [@jpountz](https://discuss.elastic.co/u/jpountz)\
**Post date:** [July 6, 2017, 7:41am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/6 "2017-07-06T07:41:36Z")

</div>

This looks like a logstash failure. I'm more after having the entire response of the reindex call, which should include a `failures` array with useful information.

---

<div class="post-metadata">

**Author:** ![mitabrev](https://avatars.discourse-cdn.com/v4/letter/m/a88e57/32.png) [@mitabrev](https://discuss.elastic.co/u/mitabrev)\
**Post date:** [July 6, 2017, 7:53am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/7 "2017-07-06T07:53:52Z")

</div>

The whole response:

```
  "took" : 3472,
  "timed_out" : false,
  "total" : 136590,
  "updated" : 0,
  "created" : 0,
  "deleted" : 0,
  "batches" : 18,
  "version_conflicts" : 17996,
  "noops" : 0,
  "retries" : {
    "bulk" : 0,
    "search" : 0
  },
  "throttled_millis" : 0,
  "requests_per_second" : -1.0,
  "throttled_until_millis" : 0,
  "failures" : [
    {
      "index" : "mmsc-2017.06.05_new",
      "type" : "logs",
      "id" : "AVxdbFicS2Lv19EFCcix",
      "cause" : {
        "type" : "mapper_parsing_exception",
        "reason" : "failed to parse [expiry_time]",
        "caused_by" : {
          "type" : "illegal_argument_exception",
          "reason" : "Invalid format: \"38641620603:2057ADC5:\" is malformed at \"1620603:2057ADC5:\""
        }
      },
      "status" : 400
    },
    {
      "index" : "mmsc-2017.06.05_new",
      "type" : "logs",
      "id" : "AVxdlY6RS2Lv19EFDf_v",
      "cause" : {
        "type" : "mapper_parsing_exception",
        "reason" : "failed to parse [expiry_time]",
        "caused_by" : {
          "type" : "illegal_argument_exception",
          "reason" : "Invalid format: \"38631774539:153CFFFF:\" is malformed at \"1774539:153CFFFF:\""
        }
      },
      "status" : 400
    },
    {
      "index" : "mmsc-2017.06.05_new",
      "type" : "logs",
      "id" : "AVxcAbZ_S2Lv19EF9yV-",
      "cause" : {
        "type" : "mapper_parsing_exception",
        "reason" : "failed to parse [expiry_time]",
        "caused_by" : {
          "type" : "illegal_argument_exception",
          "reason" : "Invalid format: \"38631774539:141382D6:\" is malformed at \"1774539:141382D6:\""
        }
      },
      "status" : 400
    },
    {
      "index" : "mmsc-2017.06.05_new",
      "type" : "logs",
      "id" : "AVxb8VuGS2Lv19EF9vE4",
      "cause" : {
        "type" : "mapper_parsing_exception",
        "reason" : "failed to parse [expiry_time]",
        "caused_by" : {
          "type" : "illegal_argument_exception",
          "reason" : "Invalid format: \"38631774539:13C38316:\" is malformed at \"1774539:13C38316:\""
        }
      },
      "status" : 400
    }
  ]
}

```

Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 3, 2017, 7:54am UTC](https://discuss.elastic.co/t/reindex-total-vs-created/88569/8 "2017-08-03T07:54:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.