# Can't upload CSV file to elastic search via logstash

**URL:** <https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361>\
**Category:** Logstash\
**Created:** [September 13, 2019, 6:08am UTC](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361 "2019-09-13T06:08:55Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![vedansh](https://avatars.discourse-cdn.com/v4/letter/v/73ab20/32.png) [@vedansh](https://discuss.elastic.co/u/vedansh)\
**Post date:** [September 13, 2019, 6:08am UTC](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361/1 "2019-09-13T06:08:55Z")

</div>

logstash-car.conf

I will go through all the question related to this topic but didn't find the solution yet  
input {  
file {  
path =\> "C:\Users\vedansh.p\Desktop\ELK\CSVLogsDemo\cars.csv"  
start\_position =\> "beginning"  
sincedb\_path =\> "NUL"  
codec =\> "plain"  
}  
}  
filter {  
csv {  
separator =\> ","  
columns =\> ["maker","model","mileage","manufacture\_year","engine\_displacement","engine\_power","body\_type","color\_slug","stk\_year","transmission","door\_count","seat\_count","fuel\_type","date\_created","date\_last\_seen","price\_eur"]  
}   
mutate {convert =\> ["mileage", "integer"]}  
mutate {convert =\> ["price\_eur", "float"]}  
mutate {convert =\> ["engine\_power", "integer"]}  
mutate {convert =\> ["door\_count", "integer"]}  
mutate {convert =\> ["seat\_count", "integer"]}  
}  
output {  
elasticsearch{  
hosts =\> "[http://localhost:9200](http://localhost:9200)"  
index =\> "cars"  
}  
stdout {}  
}

-----------------------------------------------------OUT PUT-------------------------------------------------------------

Sending Logstash logs to C:/Users/vedansh.p/Desktop/ELK/logstash-7.3.1/logstash-7.3.1/logs which is now configured via log4j2.properties  
[2019-09-13T11:27:33,147][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified  
[2019-09-13T11:27:33,414][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.3.1"}  
[2019-09-13T11:27:39,960][INFO][org.reflections.Reflections] Reflections took 240 ms to scan 1 urls, producing 19 keys and 39 values  
[2019-09-13T11:27:51,446][INFO][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=\>{:removed=\>, :added=\>[[http://localhost:9200/](http://localhost:9200/)]}}  
[2019-09-13T11:34:55,983][WARN][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=\>"[http://localhost:9200/](http://localhost:9200/)"}  
[2019-09-13T11:34:57,350][INFO][logstash.outputs.elasticsearch] ES Output version determined {:es\_version=\>7}  
[2019-09-13T11:34:57,570][WARN][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document \_type {:es\_version=\>7}  
[2019-09-13T11:34:57,934][INFO][logstash.outputs.elasticsearch] New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>["[http://localhost:9200](http://localhost:9200)"]}  
[2019-09-13T11:34:58,158][INFO][logstash.outputs.elasticsearch] Using default mapping template  
[2019-09-13T11:34:58,694][WARN][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been create for key: cluster\_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.  
[2019-09-13T11:34:58,890][INFO][logstash.javapipeline] Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>4, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50, "pipeline.max\_inflight"=\>500, :thread=\>"#\<Thread:0x1a2571ed run\>"}  
[2019-09-13T11:34:59,298][INFO][logstash.outputs.elasticsearch] Attempting to install template {:manage\_template=\>{"index\_patterns"=\>"logstash-_", "version"=\>60001, "settings"=\>{"index.refresh\_interval"=\>"5s", "number\_of\_shards"=\>1}, "mappings"=\>{"dynamic\_templates"=\>[{"message\_field"=\>{"path\_match"=\>"message", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false}}}, {"string\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false, "fields"=\>{"keyword"=\>{"type"=\>"keyword", "ignore\_above"=\>256}}}}}], "properties"=\>{"@timestamp"=\>{"type"=\>"date"}, "@version"=\>{"type"=\>"keyword"}, "geoip"=\>{"dynamic"=\>true, "properties"=\>{"ip"=\>{"type"=\>"ip"}, "location"=\>{"type"=\>"geo\_point"}, "latitude"=\>{"type"=\>"half\_float"}, "longitude"=\>{"type"=\>"half\_float"}}}}}}}  
[2019-09-13T11:35:15,048][INFO][logstash.javapipeline] Pipeline started {"pipeline.id"=\>"main"}  
[2019-09-13T11:35:15,251][INFO][filewatch.observingtail] START, creating Discoverer, Watch with file and sincedb collections  
[2019-09-13T11:35:15,486][INFO][logstash.agent] Pipelines running {:count=\>1, :running\_pipelines=\>[:main], :non\_running\_pipelines=\>}  
[2019-09-13T11:35:16,923][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600}

-----------------------------------Output ------------------------IN debug mode got into the loop----------------------------------------------------------

[2019-09-13T11:11:12,628][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu  
[2019-09-13T11:11:13,080][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=\>"ParNew"}  
[2019-09-13T11:11:13,080][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=\>"ConcurrentMarkSweep"}  
[2019-09-13T11:11:14,722][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.  
[2019-09-13T11:11:17,632][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu  
[2019-09-13T11:11:18,093][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=\>"ParNew"}  
[2019-09-13T11:11:18,093][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=\>"ConcurrentMarkSweep"}  
[2019-09-13T11:11:19,722][DEBUG][org.logstash.execution.PeriodicFlush] Pushing flush onto pipeline.  
[2019-09-13T11:11:22,737][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [September 13, 2019, 12:50pm UTC](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361/2 "2019-09-13T12:50:14Z")

</div>

Do not use backslash in the path option of a file input, use forward slash.

---

<div class="post-metadata">

**Author:** ![vedansh](https://avatars.discourse-cdn.com/v4/letter/v/73ab20/32.png) [@vedansh](https://discuss.elastic.co/u/vedansh)\
**Post date:** [September 15, 2019, 1:14pm UTC](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361/3 "2019-09-15T13:14:04Z")

</div>

Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 13, 2019, 1:14pm UTC](https://discuss.elastic.co/t/cant-upload-csv-file-to-elastic-search-via-logstash/199361/4 "2019-10-13T13:14:13Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
