# Logstash is importing more data than supposed

**URL:** https://discuss.elastic.co/t/logstash-is-importing-more-data-than-supposed/104920
**Category:** Logstash
**Created:** [October 23, 2017, 3:23pm UTC](https://discuss.elastic.co/t/logstash-is-importing-more-data-than-supposed/104920 "2017-10-23T15:23:09Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![afonso.ribeiro](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@afonso.ribeiro](https://discuss.elastic.co/u/afonso.ribeiro)
#### Post date: [October 23, 2017, 3:23pm UTC](https://discuss.elastic.co/t/logstash-is-importing-more-data-than-supposed/104920/1 "2017-10-23T15:23:09Z")

</div>

Hello guys,

I'm currently importing data from csv through logstash to elasticsearch.

I'm importing 26595 lines but logstash seems to be importing or more than 26595 or less lines.

Is there any explanation for this?

Thank you very much,

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [October 23, 2017, 8:24pm UTC](https://discuss.elastic.co/t/logstash-is-importing-more-data-than-supposed/104920/2 "2017-10-23T20:24:57Z")

</div>

Without further details it's impossible to help. So are lines being duplicated? Which ones? How many lines do you end up with in ES? Was the index really empty when you started the import?

> I'm importing 26595 lines but logstash seems to be importing or more than 26595 or less lines.

I can't parse this sentence.

---

<div class="post-metadata">

### Author: ![afonso.ribeiro](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@afonso.ribeiro](https://discuss.elastic.co/u/afonso.ribeiro)
#### Post date: [October 24, 2017, 1:59pm UTC](https://discuss.elastic.co/t/logstash-is-importing-more-data-than-supposed/104920/3 "2017-10-24T13:59:18Z")

</div>

> [@magnusbaeck](#):
>
> as the index really empty when you started the import?
> 
> I'm importing 26595 lines but logstash se

Hi magnusbaeck,

Thanks for the answer.

It is difficult to answer all that question because I can't figure it out the lines that are being duplicated because there are many duplicated lines in the excel. So in elasticsearch I can't really distinguish.

Relatively to your second question. It depends, I have done some tests and sometimes puts more 10 lines than supposed, sometimes more 2 lines.

Yes, I ensure that the index was empty before importing.

You don't have any problem when importing this much data to elasticsearch from logstash?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 21, 2017, 1:59pm UTC](https://discuss.elastic.co/t/logstash-is-importing-more-data-than-supposed/104920/4 "2017-11-21T13:59:22Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
