# Migrating daily indices to monthly

**URL:** https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636
**Category:** Logstash
**Created:** [October 4, 2017, 12:57am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636 "2017-10-04T00:57:00Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![niraj\_kumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/niraj_kumar/32/4130_2.png) [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)
#### Post date: [October 4, 2017, 12:57am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/1 "2017-10-04T00:57:00Z")

</div>

Hi,

I am trying to collapse daily indices to monthly but when i try to match the count of both old and new indices, it does not match.

This is my current logstash config look like.

```
input {
  elasticsearch {
    hosts => ["xx.xx.xx.xx"]
    index => "aws-prod-2017.09.*"
    size => 1000
    scroll => "5m"
    docinfo => true
  }
}
output {
  elasticsearch {
    hosts => ["xx.xx.xx.xx"]
    index => "%{[@metadata][_type]}-%{+YYYY-MM}"
    document_type => "%{[@metadata][_type]}"
    document_id => "%{[@metadata][_id]}"
  }
  stdout {
    codec => "dots"
  }
}

```

The counts seems to be off by 200-400. What am i doing wrong here? Any other way to do this?

--  
Niraj

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [October 4, 2017, 5:34am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/2 "2017-10-04T05:34:45Z")

</div>

> [@niraj\_kumar](#):
>
> The counts seems to be off by 200-400

The count of what? Are you trying to do a reindex with this config?

---

<div class="post-metadata">

### Author: ![niraj\_kumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/niraj_kumar/32/4130_2.png) [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)
#### Post date: [October 4, 2017, 5:50am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/3 "2017-10-04T05:50:55Z")

</div>

> [@warkolm](#):
>
> The counts seems to be off by 200-400
> 
> The count of what? Are you trying to do a reindex with this config?

@warkolm I am using the count API to count the docs in it. I am trying to create monthly indices from daily indices for a particular month

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [October 4, 2017, 6:04am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/4 "2017-10-04T06:04:07Z")

</div>

Why not use the [reindex API](https://www.elastic.co/guide/en/elasticsearch/reference/5.6/docs-reindex.html) instead?

---

<div class="post-metadata">

### Author: ![niraj\_kumar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/niraj_kumar/32/4130_2.png) [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)
#### Post date: [October 4, 2017, 6:14am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/5 "2017-10-04T06:14:21Z")

</div>

@Christian_Dahlqvist Can you give me an example for it.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [October 4, 2017, 6:47am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/6 "2017-10-04T06:47:17Z")

</div>

Does the examples provided in the documentation not work?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 1, 2017, 6:47am UTC](https://discuss.elastic.co/t/migrating-daily-indices-to-monthly/102636/7 "2017-11-01T06:47:40Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
