# Filebeat harvesting a csv file failing

**URL:** https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936
**Category:** Beats
**Tags:** filebeat
**Created:** [March 17, 2020, 1:36pm UTC](https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936 "2020-03-17T13:36:19Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![ankitagarwal10k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ankitagarwal10k/32/64579_2.png) [@ankitagarwal10k](https://discuss.elastic.co/u/ankitagarwal10k)
#### Post date: [March 17, 2020, 1:36pm UTC](https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936/1 "2020-03-17T13:36:19Z")

</div>

When I try using a csv file, the harvesting fails.

below is the log from Filebeat:

> Mar 17 19:03:26 issi01 filebeat[3989]: 2020-03-17T19:03:26.282+0530 INFO log/harvester.go:316 File was removed: /var/log/ghnlan/multimactest/00\_17\_41\_41\_00\_13--17-03-2020\_12-46-21\_PM.csv. Closing because close\_removed is enabled.  
> Mar 17 19:03:31 issi01 filebeat[3989]: 2020-03-17T19:03:31.276+0530 INFO log/harvester.go:297 Harvester started for file: /var/log/ghnlan/multimactest/00\_17\_41\_41\_00\_1f--13-03-2020\_04-56-11\_PM.csv  
> Mar 17 19:03:32 issi01 filebeat[3989]: 2020-03-17T19:03:32.283+0530 ERROR logstash/async.go:256 Failed to publish events caused by: write tcp 127.0.0.1:55206-\>127.0.0.1:5044: write: connection reset by peer  
> Mar 17 19:03:33 issi01 filebeat[3989]: 2020-03-17T19:03:33.360+0530 ERROR pipeline/output.go:121 Failed to publish events: write tcp 127.0.0.1:55206-\>127.0.0.1:5044: write: connection reset by peer  
> Mar 17 19:03:33 issi01 filebeat[3989]: 2020-03-17T19:03:33.360+0530 INFO pipeline/output.go:95 Connecting to backoff(async(tcp://127.0.0.1:5044))  
> Mar 17 19:03:33 issi01 filebeat[3989]: 2020-03-17T19:03:33.360+0530 INFO pipeline/output.go:105 Connection to backoff(async(tcp://127.0.0.1:5044)) established

below is the log from logstash:

> [2020-03-17T19:03:33,691][WARN][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=\>400, :action=\>["index", {:\_id=\>nil, :\_index=\>"issi\_plots-2020.03.17", :routing=\>nil, :\_type=\>"\_doc"}, #LogStash::Event:0x5d815b21], :response=\>{"index"=\>{"\_index"=\>"issi\_plots-2020.03.17", "\_type"=\>"\_doc", "\_id"=\>"g7Oz6HABNb5UYHxsDsEI", "status"=\>400, "error"=\>{"type"=\>"mapper\_parsing\_exception", "reason"=\>"failed to parse field [TimeStamp] of type [date] in document with id 'g7Oz6HABNb5UYHxsDsEI'. Preview of field's value: 'TimeStamp'", "caused\_by"=\>{"type"=\>"illegal\_argument\_exception", "reason"=\>"failed to parse date field [TimeStamp] with format [strict\_date\_optional\_time||epoch\_millis]", "caused\_by"=\>{"type"=\>"date\_time\_parse\_exception", "reason"=\>"Failed to parse with all enclosed parsers"}}}}}}

can anyone please help fixing this ?

---

<div class="post-metadata">

### Author: ![kvch](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kvch/32/72058_2.png) [@kvch](https://discuss.elastic.co/u/kvch)
#### Post date: [March 17, 2020, 6:54pm UTC](https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936/2 "2020-03-17T18:54:36Z")

</div>

Could you please share the debug logs of Filebeat (`./filebeat -e -d "*"`), example lines from your CSV and the configuration formatted using `</>`?

---

<div class="post-metadata">

### Author: ![ankitagarwal10k](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ankitagarwal10k/32/64579_2.png) [@ankitagarwal10k](https://discuss.elastic.co/u/ankitagarwal10k)
#### Post date: [March 18, 2020, 6:37am UTC](https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936/3 "2020-03-18T06:37:05Z")

</div>

i am completely new to this and unaware as to where would i find the filebeat logs...  
Can you please help where can I find those logs ?

---

<div class="post-metadata">

### Author: ![kvch](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kvch/32/72058_2.png) [@kvch](https://discuss.elastic.co/u/kvch)
#### Post date: [March 19, 2020, 1:05pm UTC](https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936/4 "2020-03-19T13:05:18Z")

</div>

The output of the command i sent you prints the logs to the standard output.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [April 16, 2020, 1:05pm UTC](https://discuss.elastic.co/t/filebeat-harvesting-a-csv-file-failing/223936/5 "2020-04-16T13:05:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
