# Logstash Config works fine but data not populated in elasticsearch

**URL:** https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148
**Category:** Logstash
**Created:** [September 9, 2016, 9:17am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148 "2016-09-09T09:17:27Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![karthikvalluri85](https://avatars.discourse-cdn.com/v4/letter/k/a88e57/32.png) [@karthikvalluri85](https://discuss.elastic.co/u/karthikvalluri85)
#### Post date: [September 9, 2016, 9:17am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/1 "2016-09-09T09:17:27Z")

</div>

## I'm configuring a csv file via logstash and need the ouptut loaded in elasticsearch. Please see below config file details also the commands executed so far.. The terminal gets stuck after "Logsatsh startup completed"..

## root@karthikvalluri:/opt/logstash# bin/logstash --configtest -f Appletest.conf Configuration OK root@karthikvalluri:/opt/logstash# opt/bin/logstash -f Appletest.conf-bash: opt/bin/logstash: No such file or directory root@karthikvalluri:/opt/logstash# bin/logstash -f Appletest.conf Settings: Default pipeline workers: 4 Logstash startup completed

Config File:-  
input {  
file {  
path =\> "/opt/logstash/yahoostock.csv"  
type =\> "core2"  
start\_position =\> "beginning"  
ignore\_older =\> 0  
}  
}  
filter {  
csv {  
columns =\> ["Date","Open","High","Low","Close","Volume","Adj Close"]  
separator =\> ","  
}

mutate{  
convert =\> { "High" =\> "float"}  
convert =\> { "Open" =\> "float"}  
convert =\> { "Low" =\> "float"}  
convert =\> { "Close" =\> "float"}  
convert =\> { "Volume" =\> "float"}  
}

}

output {

```
elasticsearch {

    action => "index"
    hosts => "localhost"
    index => "Yahoo"
    workers => 4

```

}  
}

I tried searching for older posts but without any success.

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [September 9, 2016, 9:39am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/2 "2016-09-09T09:39:55Z")

</div>

Logstash is probably tailing yahoostock.csv and waiting for new data to be added. Read up on sincedb in the file input documentation and the dozens and dozens of threads here that cover this topic.

---

<div class="post-metadata">

### Author: ![karthikvalluri85](https://avatars.discourse-cdn.com/v4/letter/k/a88e57/32.png) [@karthikvalluri85](https://discuss.elastic.co/u/karthikvalluri85)
#### Post date: [September 9, 2016, 10:51am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/3 "2016-09-09T10:51:51Z")

</div>

I tried adding the lines:-  
sincedb\_path =\> "/persistent/log"  
sincedb\_write\_interval =\> 10  
The data loads now but again gets stuck...see screenshot.

 ![](https://us1.discourse-cdn.com/elastic/original/2X/3/343ffd646068e62e6e8d8f93fcf928e1a8f520e1.png)

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [September 9, 2016, 10:58am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/4 "2016-09-09T10:58:57Z")

</div>

Please don't post screenshots when you can copy & paste.

Has all data been loaded? Logstash will not quit just because it reaches the end of the input file.

---

<div class="post-metadata">

### Author: ![karthikvalluri85](https://avatars.discourse-cdn.com/v4/letter/k/a88e57/32.png) [@karthikvalluri85](https://discuss.elastic.co/u/karthikvalluri85)
#### Post date: [September 9, 2016, 11:25am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/5 "2016-09-09T11:25:07Z")

</div>

Ok..No when i refresh head ([http://localhost:9200/\_plugin/head/](http://localhost:9200/_plugin/head/)) i do not see my index..

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [September 9, 2016, 11:36am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/6 "2016-09-09T11:36:04Z")

</div>

What does your configuration look like? The configuration you posted earlier can't be what you're using now since your screenshot indicates that you're using a stdout output.

---

<div class="post-metadata">

### Author: ![karthikvalluri85](https://avatars.discourse-cdn.com/v4/letter/k/a88e57/32.png) [@karthikvalluri85](https://discuss.elastic.co/u/karthikvalluri85)
#### Post date: [September 9, 2016, 11:39am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/7 "2016-09-09T11:39:01Z")

</div>

input {  
file {  
path =\> "/opt/logstash/yahoostock.csv"  
type =\> "core2"  
start\_position =\> "beginning"  
ignore\_older =\> 0  
sincedb\_path =\> "/persistent/log"  
sincedb\_write\_interval =\> 10  
}  
}  
filter {  
csv {  
columns =\> ["Date","Open","High","Low","Close","Volume","Adj Close"]  
separator =\> ","  
}

mutate{  
convert =\> { "High" =\> "float"}  
convert =\> { "Open" =\> "float"}  
convert =\> { "Low" =\> "float"}  
convert =\> { "Close" =\> "float"}  
convert =\> { "Volume" =\> "float"}  
}

}

output {

```
elasticsearch {

    action => "index"
    hosts => "localhost"
    index => "Yahoo"
    workers => 4

```

}  
stdout{}  
}

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [September 9, 2016, 11:44am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/8 "2016-09-09T11:44:13Z")

</div>

I think index names have to be lowercase-only.

---

<div class="post-metadata">

### Author: ![karthikvalluri85](https://avatars.discourse-cdn.com/v4/letter/k/a88e57/32.png) [@karthikvalluri85](https://discuss.elastic.co/u/karthikvalluri85)
#### Post date: [September 9, 2016, 11:52am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/9 "2016-09-09T11:52:23Z")

</div>

Thanks a lot.. 🙂 It works. I see the data in head.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 4:39am UTC](https://discuss.elastic.co/t/logstash-config-works-fine-but-data-not-populated-in-elasticsearch/60148/10 "2017-07-06T04:39:06Z")

</div>


