# Logstash: Problem regarding inout plugin, Logstash startup completed does not get dislayed

**URL:** https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979
**Category:** Logstash
**Created:** [May 25, 2016, 7:16pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979 "2016-05-25T19:16:58Z")
**Posts on this page:** 15
**Page:** 1

<div class="post-metadata">

### Author: ![Piyush\_Paritosh](https://avatars.discourse-cdn.com/v4/letter/p/b5ac83/32.png) [@Piyush\_Paritosh](https://discuss.elastic.co/u/Piyush_Paritosh)
#### Post date: [May 25, 2016, 7:16pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/1 "2016-05-25T19:16:59Z")

</div>

I am using Macbook and trying to use Logstash. I am using the following config file:

input {  
file {  
path =\> "/Desktop/data.csv"  
type =\> "core2"  
start\_position =\> "beginning"  
}  
}  
filter {  
csv {  
separator =\> ","  
columns =\> ["Date","Open","High","Low","Close","Volume","Adj Close"]  
}  
mutate {convert =\> ["High", "float"]}  
mutate {convert =\> ["Open", "float"]}  
mutate {convert =\> ["Low", "float"]}  
mutate {convert =\> ["Close", "float"]}  
mutate {convert =\> ["Volume", "float"]}  
}  
output {  
elasticsearch {  
action =\> "index"  
hosts =\> "localhost"  
index =\> "stock"  
workers =\> 1  
}  
stdout {}  
}

After this I run $ bin/logstash -f logstash1.conf

And this is what I get:

Settings: Default pipeline workers: 4  
Pipeline main started

I am stuck after this. Lostash startup complete mesage doesn't get displayed. Kindly help me.

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [May 25, 2016, 8:28pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/2 "2016-05-25T20:28:39Z")

</div>

Is the modification time of data.csv older than 24 hours? Adjust the file input's `ignore_older` option.

If not Logstash is probably tailing the file. Read about sincedb and check out the archives for details. It's an _extremely_ common issue.

---

<div class="post-metadata">

### Author: ![Piyush\_Paritosh](https://avatars.discourse-cdn.com/v4/letter/p/b5ac83/32.png) [@Piyush\_Paritosh](https://discuss.elastic.co/u/Piyush_Paritosh)
#### Post date: [May 26, 2016, 5:57am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/3 "2016-05-26T05:57:21Z")

</div>

685b358426d6:logstash-2.3.2 paritp$ ./bin/logstash -f logstash1.conf -v  
starting agent {:level=\>:info}  
starting pipeline {:id=\>"main", :level=\>:info}  
Settings: Default pipeline workers: 4  
Registering file input {:path=\>["/Desktop/data.csv"], :level=\>:info}  
No sincedb\_path set, generating one based on the file path {:sincedb\_path=\>"/Users/paritp/.sincedb\_e51202a64a3aa13dd9ce7c8b25992f3b", :path=\>["/Desktop/data.csv"], :level=\>:info}  
Using mapping template from {:path=\>nil, :level=\>:info}  
Attempting to install template {:manage\_template=\>{"template"=\>"logstash-_", "settings"=\>{"index.refresh\_interval"=\>"5s"}, "mappings"=\>{"default"=\>{"\_all"=\>{"enabled"=\>true, "omit\_norms"=\>true}, "dynamic\_templates"=\>[{"message\_field"=\>{"match"=\>"message", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"string", "index"=\>"analyzed", "omit\_norms"=\>true, "fielddata"=\>{"format"=\>"disabled"}}}}, {"string\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"string", "index"=\>"analyzed", "omit\_norms"=\>true, "fielddata"=\>{"format"=\>"disabled"}, "fields"=\>{"raw"=\>{"type"=\>"string", "index"=\>"not\_analyzed", "ignore\_above"=\>256}}}}}], "properties"=\>{"@timestamp"=\>{"type"=\>"date"}, "@version"=\>{"type"=\>"string", "index"=\>"not\_analyzed"}, "geoip"=\>{"dynamic"=\>true, "properties"=\>{"ip"=\>{"type"=\>"ip"}, "location"=\>{"type"=\>"geo\_point"}, "latitude"=\>{"type"=\>"float"}, "longitude"=\>{"type"=\>"float"}}}}}}}, :level=\>:info}  
New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>["localhost"], :level=\>:info}  
Starting pipeline {:id=\>"main", :pipeline\_workers=\>4, :batch\_size=\>125, :batch\_delay=\>5, :max\_inflight=\>500, :level=\>:info}  
Pipeline main started

This is what I get when I run it on verbose, please tell me what to do next.  
I have installed the input file plugin also and the following is my config file:

input {  
file {  
path =\> "/Desktop/data.csv"  
type =\> "core2"  
start\_position =\> "beginning"  
ignore\_older =\> 0  
}  
}  
filter {  
csv {  
separator =\> ","  
columns =\> ["Date","Open","High","Low","Close","Volume","Adj Close"]  
}  
mutate {convert =\> ["High", "float"]}  
mutate {convert =\> ["Open", "float"]}  
mutate {convert =\> ["Low", "float"]}  
mutate {convert =\> ["Close", "float"]}  
mutate {convert =\> ["Volume", "float"]}  
}  
output {  
elasticsearch {  
action =\> "index"  
hosts =\> "localhost"  
index =\> "stock"  
workers =\> 1  
}  
stdout {}  
}

---

<div class="post-metadata">

### Author: ![Piyush\_Paritosh](https://avatars.discourse-cdn.com/v4/letter/p/b5ac83/32.png) [@Piyush\_Paritosh](https://discuss.elastic.co/u/Piyush_Paritosh)
#### Post date: [May 26, 2016, 6:25am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/4 "2016-05-26T06:25:45Z")

</div>

earlier I was making a mistake, there was some discrepancy with the path I guess. Now I am able to see the the output on the console, but still for some reason, Logstash does not get completed.

I dont get the response :  
Logstash startup completed

Please help.

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [May 26, 2016, 7:46am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/5 "2016-05-26T07:46:23Z")

</div>

That's expected. The file input plugin is waiting for more data. Its main use case is continuous monitoring of log files.

---

<div class="post-metadata">

### Author: ![Piyush\_Paritosh](https://avatars.discourse-cdn.com/v4/letter/p/b5ac83/32.png) [@Piyush\_Paritosh](https://discuss.elastic.co/u/Piyush_Paritosh)
#### Post date: [May 26, 2016, 12:12pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/6 "2016-05-26T12:12:39Z")

</div>

Currently, I always have to go back to the directory containing .sincedb file and delete it. after that only the output gets displayed on the console. Is there a way to avoid this doing repetitively?

And I read earlier in some discussion where some guy was also using the input plugin. But in his case "Logstash startup complete" was getting displayed. Could you please help me?

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [May 26, 2016, 1:30pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/7 "2016-05-26T13:30:55Z")

</div>

> Currently, I always have to go back to the directory containing .sincedb file and delete it. after that only the output gets displayed on the console. Is there a way to avoid this doing repetitively?

Setting the file input's `sincedb_path` parameter to /dev/null (assuming you're on a Unix-like OS) will effectively disable sincedb.

---

<div class="post-metadata">

### Author: ![Piyush\_Paritosh](https://avatars.discourse-cdn.com/v4/letter/p/b5ac83/32.png) [@Piyush\_Paritosh](https://discuss.elastic.co/u/Piyush_Paritosh)
#### Post date: [May 27, 2016, 7:13am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/8 "2016-05-27T07:13:10Z")

</div>

thanks a lot Magnus. Really appreciate your help. 🙂

Could you also resolve the other problem of "Logstash startup complete" not getting resolved also.

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [May 27, 2016, 11:30am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/9 "2016-05-27T11:30:15Z")

</div>

Logstash 2.3 and later doesn't say "Logstash startup completed" but "Pipeline main started". I've filed [https://github.com/elastic/logstash/issues/5372](https://github.com/elastic/logstash/issues/5372) to fix the documentation.

---

<div class="post-metadata">

### Author: ![spark\_pan](https://avatars.discourse-cdn.com/v4/letter/s/db5fbb/32.png) [@spark\_pan](https://discuss.elastic.co/u/spark_pan)
#### Post date: [May 28, 2016, 12:22am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/10 "2016-05-28T00:22:47Z")

</div>

I have the exactly the same issue with you - no any output and can not view by Kibana . Can you show m your latest configuraiton file?

Below is my logstash conf file:  
input {  
file {  
path =\> "/test/table.csv"  
start\_position =\> "beginning"  
ignore\_older =\> 0  
type =\> "core2"  
sincedb\_path =\> "/dev/null"  
}  
}

filter {  
csv {  
separator =\> ","  
columns =\> ["Date", "Open", "High", "Low", "Close", "Volume", "Adj Closee"]  
}

mutate { convert =\> ["High", "float"] }  
mutate { convert =\> ["Open", "float"] }  
mutate { convert =\> ["Low", "float"] }  
mutate { convert =\> ["Close", "float"]}  
mutate { convert =\> ["Volume", "float"] }

}

output {  
elasticsearch {  
action =\> "index"  
hosts =\> "localhost"  
index =\> "stock"  
workers =\> 1

}

stdout { }

}

console:  
spark:bin imsparkpan$ ./logstash -f logstash-file.conf -v  
starting agent {:level=\>:info}  
starting pipeline {:id=\>"main", :level=\>:info}  
Settings: Default pipeline workers: 4  
Registering file input {:path=\>["/test/table.csv"], :level=\>:info}  
Using mapping template from {:path=\>nil, :level=\>:info}  
Attempting to install template {:manage\_template=\>{"template"=\>"logstash-_", "settings"=\>{"index.refresh\_interval"=\>"5s"}, "mappings"=\>{"default"=\>{"\_all"=\>{"enabled"=\>true, "omit\_norms"=\>true}, "dynamic\_templates"=\>[{"message\_field"=\>{"match"=\>"message", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"string", "index"=\>"analyzed", "omit\_norms"=\>true, "fielddata"=\>{"format"=\>"disabled"}}}}, {"string\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"string", "mapping"=\>{"type"=\>"string", "index"=\>"analyzed", "omit\_norms"=\>true, "fielddata"=\>{"format"=\>"disabled"}, "fields"=\>{"raw"=\>{"type"=\>"string", "index"=\>"not\_analyzed", "doc\_values"=\>true, "ignore\_above"=\>256}}}}}, {"float\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"float", "mapping"=\>{"type"=\>"float", "doc\_values"=\>true}}}, {"double\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"double", "mapping"=\>{"type"=\>"double", "doc\_values"=\>true}}}, {"byte\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"byte", "mapping"=\>{"type"=\>"byte", "doc\_values"=\>true}}}, {"short\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"short", "mapping"=\>{"type"=\>"short", "doc\_values"=\>true}}}, {"integer\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"integer", "mapping"=\>{"type"=\>"integer", "doc\_values"=\>true}}}, {"long\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"long", "mapping"=\>{"type"=\>"long", "doc\_values"=\>true}}}, {"date\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"date", "mapping"=\>{"type"=\>"date", "doc\_values"=\>true}}}, {"geo\_point\_fields"=\>{"match"=\>"_", "match\_mapping\_type"=\>"geo\_point", "mapping"=\>{"type"=\>"geo\_point", "doc\_values"=\>true}}}], "properties"=\>{"@timestamp"=\>{"type"=\>"date", "doc\_values"=\>true}, "@version"=\>{"type"=\>"string", "index"=\>"not\_analyzed", "doc\_values"=\>true}, "geoip"=\>{"type"=\>"object", "dynamic"=\>true, "properties"=\>{"ip"=\>{"type"=\>"ip", "doc\_values"=\>true}, "location"=\>{"type"=\>"geo\_point", "doc\_values"=\>true}, "latitude"=\>{"type"=\>"float", "doc\_values"=\>true}, "longitude"=\>{"type"=\>"float", "doc\_values"=\>true}}}}}}}, :level=\>:info}  
New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>["localhost"], :level=\>:info}  
Starting pipeline {:id=\>"main", :pipeline\_workers=\>4, :batch\_size=\>125, :batch\_delay=\>5, :max\_inflight=\>500, :level=\>:info}  
Pipeline main started

---

<div class="post-metadata">

### Author: ![GregMeadows](https://avatars.discourse-cdn.com/v4/letter/g/b5e925/32.png) [@GregMeadows](https://discuss.elastic.co/u/GregMeadows)
#### Post date: [March 7, 2017, 8:50pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/11 "2017-03-07T20:50:16Z")

</div>

I am digging through the forums and keep seeing this error "attempting to install template" and unable to load files. I have posted (another) thread for same issue, was this resolved?

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [March 9, 2017, 1:30pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/12 "2017-03-09T13:30:02Z")

</div>

The "attempting to install template" message is totally normal and had nothing to do with the problems described in this thread.

---

<div class="post-metadata">

### Author: ![GregMeadows](https://avatars.discourse-cdn.com/v4/letter/g/b5e925/32.png) [@GregMeadows](https://discuss.elastic.co/u/GregMeadows)
#### Post date: [March 9, 2017, 4:09pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/13 "2017-03-09T16:09:20Z")

</div>

thanks for clarifying @magnusbaeck - so this is not a template file I need to locate? (main issue is solved in the other thread)

---

<div class="post-metadata">

### Author: ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [March 9, 2017, 4:11pm UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/14 "2017-03-09T16:11:18Z")

</div>

No, there's no file for you to locate.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 4:27am UTC](https://discuss.elastic.co/t/logstash-problem-regarding-inout-plugin-logstash-startup-completed-does-not-get-dislayed/50979/15 "2017-07-06T04:27:59Z")

</div>


