# Logstash not creating indexes for csv file input

**URL:** https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820
**Category:** Logstash
**Created:** [November 22, 2018, 8:22am UTC](https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820 "2018-11-22T08:22:27Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![emile1](https://avatars.discourse-cdn.com/v4/letter/e/e95f7d/32.png) [@emile1](https://discuss.elastic.co/u/emile1)
#### Post date: [November 22, 2018, 8:22am UTC](https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820/1 "2018-11-22T08:22:27Z")

</div>

Hi All

I'm at a loss I'm trying to process a csv file via logstash. My Config below is not creating any indexes in ES. Looking at the logstash logs it does not look like their is an error in my config. Im adding my config and error log below as i can't seem to spot my error. It would be much appreciated if some with some fresh eye can have a look.

Regards  
Emile

My config are as follow:

```
input {
  # server logs
  # Capacity csv dump

  file {
    path => "/root/grok/ServerCapacity.csv"
    start_position => "beginning"
    sincedb_path => "/dev/null"
  }

}

filter {
     csv {
        columns => ["ID","Host","IPAddress","ServerDate","UserPercentage","SysPercentage","WaitPercentage","IdlePercentage","CPUPercentage","PhysicalCPUs","HomeUsage","UsrUsage","VarUsage","TmpUsage","SrvUsage","WeblogicUsage","MercuryUsage","OraclecoreUsage","WebSphereUsage","IBMCoreUsage","MemoryPercentage","RealMemory","MemoryGB","EnsWrite","Environment","ServerMonth","ServerYear"]
        separator => ";"
     }
}

output {
      elasticsearch {
        action => "index"
        hosts => ["telk001zadprh","telk002zadprh","telk003zadprh"]
        index => "logstash-capacity-server-%{+YYYY.MM.dd}"
      }
}

```

Debug Error log:

```
[2018-11-22T07:44:05,165][INFO][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"template"=>"logstash-*", "version"=>50001, "settings"=>{"index.refresh_interval"=>"5s"}, "mappings"=>{"_default_"=>{"_all"=>{"enabled"=>true, "norms"=>false}, "dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date", "include_in_all"=>false}, "@version"=>{"type"=>"keyword", "include_in_all"=>false}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}}
[2018-11-22T07:44:05,305][DEBUG][logstash.outputs.elasticsearch] Found existing Elasticsearch template. Skipping template management {:name=>"logstash"}
[2018-11-22T07:44:05,689][INFO][logstash.pipeline] Pipeline started successfully {:pipeline_id=>"main", :thread=>"#<Thread:0x774fa6bc run>"}
[2018-11-22T07:44:05,833][INFO][logstash.agent] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2018-11-22T07:44:05,919][INFO][filewatch.observingtail] START, creating Discoverer, Watch with file and sincedb collections
[2018-11-22T07:44:05,936][DEBUG][logstash.agent] Starting puma
[2018-11-22T07:44:05,973][DEBUG][logstash.agent] Trying to start WebServer {:port=>9600}
[2018-11-22T07:44:06,055][DEBUG][logstash.api.service] [api-service] start
[2018-11-22T07:44:06,294][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=>9600}
[2018-11-22T07:44:09,944][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2018-11-22T07:44:09,945][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2018-11-22T07:44:10,739][DEBUG][logstash.pipeline] Pushing flush onto pipeline {:pipeline_id=>"main", :thread=>"#<Thread:0x774fa6bc sleep>"}
[2018-11-22T07:44:14,952][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2018-11-22T07:44:14,962][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2018-11-22T07:44:15,743][DEBUG][logstash.pipeline] Pushing flush onto pipeline {:pipeline_id=>"main", :thread=>"#<Thread:0x774fa6bc sleep>"}
[2018-11-22T07:44:19,970][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2018-11-22T07:44:19,972][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2018-11-22T07:44:20,745][DEBUG][logstash.pipeline] Pushing flush onto pipeline {:pipeline_id=>"main", :thread=>"#<Thread:0x774fa6bc sleep>"}
[2018-11-22T07:44:24,978][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2018-11-22T07:44:24,981][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2018-11-22T07:44:25,746][DEBUG][logstash.pipeline] Pushing flush onto pipeline {:pipeline_id=>"main", :thread=>"#<Thread:0x774fa6bc sleep>"}
[2018-11-22T07:44:29,985][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2018-11-22T07:44:29,991][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
```

---

<div class="post-metadata">

### Author: ![balumurari1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/balumurari1/32/39203_2.png) [@balumurari1](https://discuss.elastic.co/u/balumurari1)
#### Post date: [November 22, 2018, 8:36am UTC](https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820/2 "2018-11-22T08:36:48Z")

</div>

Hello,

i think you to change separator =\> ";" to separator =\> ","

hope this helps you,

> [@Load csv file in logstash](https://discuss.elastic.co/t/load-csv-file-in-logstash/151319/3):
>
> Thanks for reply,hope this works fine, input { file { path =\> "D:/Balu/ELK-stack/csvfile.csv" start\_position =\> "beginning" sincedb\_path =\> "NUL" } } filter { csv { separator =\> "," columns =\> ["open","high","low","close","volume"] } } output { elasticsearch { hosts =\> "[http://localhost:9200](http://localhost:9200)" index =\> "wallet-address-index" } stdout { codec =\> rubydebug } }

---

<div class="post-metadata">

### Author: ![emile1](https://avatars.discourse-cdn.com/v4/letter/e/e95f7d/32.png) [@emile1](https://discuss.elastic.co/u/emile1)
#### Post date: [November 26, 2018, 7:49am UTC](https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820/3 "2018-11-26T07:49:33Z")

</div>

Thanks for the help.

I got it working.

Kind Regards  
Emile

---

<div class="post-metadata">

### Author: ![balumurari1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/balumurari1/32/39203_2.png) [@balumurari1](https://discuss.elastic.co/u/balumurari1)
#### Post date: [November 26, 2018, 7:51am UTC](https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820/4 "2018-11-26T07:51:55Z")

</div>

Great, Please mark your answer as solution.

Regards,  
Balu

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 24, 2018, 7:51am UTC](https://discuss.elastic.co/t/logstash-not-creating-indexes-for-csv-file-input/157820/5 "2018-12-24T07:51:59Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
