# Unable to ingest CSV file into Elasticsearch through Logstash **URL:** \ **Category:** Logstash\ **Created:** [August 21, 2019, 4:38am UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036 "2019-08-21T04:38:41Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Ramya\_Tanikanti](https://avatars.discourse-cdn.com/v4/letter/r/9de053/32.png) [@Ramya\_Tanikanti](https://discuss.elastic.co/u/Ramya_Tanikanti)\ **Post date:** [August 21, 2019, 4:38am UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036/1 "2019-08-21T04:38:41Z")
C:\Users\ramya.t\logstash-7.3.0\bin\>logstash -f C:\Users\ramya.t\logstash-7.3.0\bin\log.conf Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.jruby.runtime.encoding.EncodingService (file:/C:/Users/ramya.t/logstash-7.3.0/logstash-core/lib/jars/jruby-complete-9.2.7.0.jar) to field java.io.Console.cs WARNING: Please consider reporting this to the maintainers of org.jruby.runtime.encoding.EncodingService WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Thread.exclusive is deprecated, use Thread::Mutex Sending Logstash logs to C:/Users/ramya.t/logstash-7.3.0/logs which is now configured via log4j2.properties [2019-08-21T09:53:15,473][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified [2019-08-21T09:53:15,493][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.3.0"} [2019-08-21T09:53:17,020][INFO][org.reflections.Reflections] Reflections took 51 ms to scan 1 urls, producing 19 keys and 39 values [2019-08-21T09:53:22,670][INFO][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=\>{:removed=\>, :added=\>[[http://localhost:9200/](http://localhost:9200/)]}} [2019-08-21T09:53:22,988][WARN][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=\>"[http://localhost:9200/](http://localhost:9200/)"} [2019-08-21T09:53:23,032][INFO][logstash.outputs.elasticsearch] ES Output version determined {:es\_version=\>7} [2019-08-21T09:53:23,034][WARN][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document \_type {:es\_version=\>7} [2019-08-21T09:53:23,048][INFO][logstash.outputs.elasticsearch] New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>["[//localhost](https://localhost)"]} [2019-08-21T09:53:23,082][INFO][logstash.outputs.elasticsearch] Using default mapping template [2019-08-21T09:53:23,114][WARN][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been create for key: cluster\_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team. [2019-08-21T09:53:23,117][INFO][logstash.javapipeline] Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>4, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50, "pipeline.max\_inflight"=\>500, :thread=\>"#\"} [2019-08-21T09:53:23,142][INFO][logstash.outputs.elasticsearch] Attempting to install template {:manage\_template=\>{"index\_patterns"=\>"logstash-_", "version"=\>60001, "settings"=\>{"index.refresh\_interval"=\>"5s", "number\_of\_shards"=\>1}, "mappings"=\>{"dynamic\_templates"=\>[{"message\_field"=\>{"path\_match"=\>"message", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false}}}, {"string\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"text", "norms"=\>false, "fields"=\>{"keyword"=\>{"type"=\>"keyword", "ignore\_above"=\>256}}}}}], "properties"=\>{"@timestamp"=\>{"type"=\>"date"}, "@version"=\>{"type"=\>"keyword"}, "geoip"=\>{"dynamic"=\>true, "properties"=\>{"ip"=\>{"type"=\>"ip"}, "location"=\>{"type"=\>"geo\_point"}, "latitude"=\>{"type"=\>"half\_float"}, "longitude"=\>{"type"=\>"half\_float"}}}}}}} [2019-08-21T09:53:24,185][INFO][logstash.inputs.file] No sincedb\_path set, generating one based on the "path" setting {:sincedb\_path=\>"C:/Users/ramya.t/logstash-7.3.0/data/plugins/inputs/file/.sincedb\_51b5ce8e600f3c006b65b5802f40752e", :path=\>["C:\Users\ramya.t\Downloads\ELK\AB\_FINAL.csv"]} [2019-08-21T09:53:24,228][INFO][logstash.javapipeline] Pipeline started {"pipeline.id"=\>"main"} [2019-08-21T09:53:24,276][INFO][filewatch.observingtail] START, creating Discoverer, Watch with file and sincedb collections [2019-08-21T09:53:24,300][INFO][logstash.agent] Pipelines running {:count=\>1, :running\_pipelines=\>[:main], :non\_running\_pipelines=\>} [2019-08-21T09:53:24,766][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600} **This is what I am getting in the command prompt** New to ELK Stack. Kindly Help. ---
**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\ **Post date:** [August 21, 2019, 12:10pm UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036/2 "2019-08-21T12:10:39Z")
That looks normal. What is your issue and what does your configuration look like? ---
**Author:** ![Ramya\_Tanikanti](https://avatars.discourse-cdn.com/v4/letter/r/9de053/32.png) [@Ramya\_Tanikanti](https://discuss.elastic.co/u/Ramya_Tanikanti)\ **Post date:** [August 21, 2019, 12:17pm UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036/3 "2019-08-21T12:17:25Z")
**Went to Kibana to check if the index was created. It wasn't created.** My config file 👇 input { file { path =\> "C:\Users\ramya.t\Downloads\ELK\AB\_FINAL.csv" start\_position =\> "beginning" } } filter { csv { separator =\> "," columns =\> [ "USERNAME", "SEQUENCEID", "REQUEST\_TIMESTAMP", "A\_FLOORSUITE", "A\_BUILDINGNAME", "A\_PREMISESNUMBER", "A\_STREETNAME", "A\_CITYTOWN", "A\_STATE", "A\_POSTALZIPCODE", "A\_LATITUDE", "A\_LONGITUDE", "A\_LONGADDRESS", "A\_SITETELEPHONENUMBER", "A\_RADIUS", "A\_ISHUB", "A\_COLTOPERATINGCOUNTRY", "A\_REQUIREDPRODUCT", "A\_BANDWIDTH", "A\_CONNECTIVITYTYPE1", "A\_CONNECTIVITYTYPE2", "A\_CONNECTIVITYTYPE3", "A\_CONNECTIVITYTYPE4", "B\_FLOORSUITE", "B\_BUILDINGNAME", "B\_PREMISESNUMBER", "B\_STREETNAME", "B\_CITYTOWN", "B\_STATE", "B\_POSTALZIPCODE", "B\_LATITUDE", "B\_LONGITUDE", "B\_LONGADDRESS", "B\_SITETELEPHONENUMBER", "B\_RADIUS", "B\_ISHUB", "B\_COLTOPERATINGCOUNTRY", "B\_REQUIREDPRODUCT", "B\_BANDWIDTH", "B\_CONNECTIVITYTYPE1", "B\_CONNECTIVITYTYPE2", "B\_CONNECTIVITYTYPE3", "B\_CONNECTIVITYTYPE4", "SCHEMAVERSION", "REQUESTTYPE", "RESPONSE", "RESP\_ERRORTYPE", "RESP\_ERRORCODE", "STATUS", "NEARNETSTATUS\_AENDRESULT\_STATUS", "NEARNETSTATUS\_BENDRESULT\_STATUS"] } } output { elasticsearch { hosts =\> "localhost" index =\> "ebonding" } stdout {} } ---
**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\ **Post date:** [August 21, 2019, 12:27pm UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036/4 "2019-08-21T12:27:33Z")
Do not use backslash in the path option of a file input, use forward slash. ---
**Author:** ![Ramya\_Tanikanti](https://avatars.discourse-cdn.com/v4/letter/r/9de053/32.png) [@Ramya\_Tanikanti](https://discuss.elastic.co/u/Ramya_Tanikanti)\ **Post date:** [August 22, 2019, 3:58am UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036/5 "2019-08-22T03:58:52Z")
Thank youu!! It's working : ) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 19, 2019, 4:09am UTC](https://discuss.elastic.co/t/unable-to-ingest-csv-file-into-elasticsearch-through-logstash/196036/6 "2019-09-19T04:09:32Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.