# Cant append documents on existing index

**URL:** https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099
**Category:** Logstash
**Created:** [May 17, 2017, 12:13pm UTC](https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099 "2017-05-17T12:13:23Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![nishant2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nishant2/32/18300_2.png) [@nishant2](https://discuss.elastic.co/u/nishant2)
#### Post date: [May 17, 2017, 12:13pm UTC](https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099/1 "2017-05-17T12:13:23Z")

</div>

Hello

We are using logstash to sink kafka data to elastic search.

When we are trying to insert docs on a non-existing index on elastic search, then logstash creates the index and starts docs there.  
But when we try to do the same on an already existing index, then nothing happens. No error on logstash console. Keeps on sending "2017-05-17T12:03:50.997Z %{host} %{message}" message with different timestamps.

Do we have add some tag for such requirement?

---

<div class="post-metadata">

### Author: ![nishant2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nishant2/32/18300_2.png) [@nishant2](https://discuss.elastic.co/u/nishant2)
#### Post date: [May 19, 2017, 3:33am UTC](https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099/2 "2017-05-19T03:33:36Z")

</div>

This is what I noticed in recent run. No flush size is defined in my conf file

On existing index, doc append is going very slow.  
If index does not exist and logstash creates one, then doc add is very fast.

How can I increase the performance of doc append on existing index?

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 19, 2017, 3:55am UTC](https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099/3 "2017-05-19T03:55:03Z")

</div>

Can we see your config?

---

<div class="post-metadata">

### Author: ![nishant2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nishant2/32/18300_2.png) [@nishant2](https://discuss.elastic.co/u/nishant2)
#### Post date: [May 23, 2017, 6:33am UTC](https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099/4 "2017-05-23T06:33:13Z")

</div>

input {  
kafka {  
bootstrap\_servers =\> "1.2.4.14:9092,1.2.4.18:9092"  
topics =\> "live2"  
codec =\> "plain"  
}  
}

filter {  
csv {  
separator =\> ";"  
columns =\> ["NAME","EMPLOYEEID","DEPT","DESIGNATION","ID","GOC","PROJ","PM","DM","TL","PFC","BS","BoA","TA","LA","DA","MA","TLA","GS"]  
}

mutate {  
remove\_field =\> ["message"]  
}  
}

output {  
elasticsearch { hosts =\> ["[http://1.2.4.13:9200](http://1.2.4.13:9200)"]  
index =\> "live"  
}  
stdout {}  
}

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 20, 2017, 6:33am UTC](https://discuss.elastic.co/t/cant-append-documents-on-existing-index/86099/5 "2017-06-20T06:33:29Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
