# Setup questions for custom logs from application into logstash
**URL:** https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466
**Category:** Logstash
**Created:** [May 30, 2019, 5:35am UTC](https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466 "2019-05-30T05:35:45Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@TsuWeiQuan](https://discuss.elastic.co/u/TsuWeiQuan)
#### Post date: [May 30, 2019, 5:35am UTC](https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466/1 "2019-05-30T05:35:45Z")
Hello,
I am very new to ELK stack and have successfully setup one. Currently, i am learning how to parse custom application logs into Logstash pipeline then to elasticsearch and hope to see these data on kibana.
Hence I have a few questions if my process/way of implementing is ideal/correct.
Just for reference, one of my sample log data is:
> 2019-05-28 04:19:01.355 DEBUG - [SPLOC, 00082] [common\_template.c,App\_endTransaction,822] [Time to Commit Trans=1.223000]
> 2019-05-28 04:19:01.355 INFO - [SPLOC, 00082] [common\_msg\_hdlr.c,CommonMsgHdlr,153] [END\_TRANS, Status: STATUS\_OK]
> 2019-05-28 04:19:01.355 INFO - [SPLOC, 00082] [common\_msg\_hdlr.c,CommonMsgHdlr,212] End transaction. [Time Taken=1.764000].
Please advice/correct me if i am wrong.
1. Create a pipeline on logstash
2. Filebeat this file from an host into logstash with the same port as the pipeline in (1)
3. At /usr/share/logstash/config/conf.d/test.conf, configure the filter to grok the data in
4. Output to elasticsearch host with an index
However i am stuck at step 3. I am unable to start my pipeline (`testpipe`). Starting the logstash service always creates the default `main` pipeline.
How can i start my customized pipeline?
What i did:
Edit pipelines.yml
```
- pipeline.id: testpipe
path.config: "/usr/share/logstash/config/conf.d/test.conf"
```
Edit test.conf (this configuration is wrong but i am unable to start this pipe)
```
input {
stdin {}
#beats {
# port => 5044
#}
}
# The filter part of this file is commented out to indicate that it is
# optional.
filter {
grok {
match => { "message" => "%{COMBINEDAPACHELOG}" }
remove_field => "message"
}
date {
match => ["timestamp", "dd/MMM/YYYY:HH:mm:ss Z"]
locale => en
remove_field => ["timestamp"]
}
geoip {
source => "clientip"
}
useragent {
source => "agent"
target => "useragent"
}
}
output {
stdout { codec => rubydebug }
elasticsearch {
hosts => ["http://esnode1:9200", "http://esnode2:9200", "http://esnode3:9200"]
index => "testpipe-%{+YYYY.MM.dd}"
}
}
```
then i ran this
```
../bin/logstash -f conf.d/test.conf --config.test_and_exit
../bin/logstash -f conf.d/test.conf --config.reload.automatic
```
---
### Author:  [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 30, 2019, 5:46am UTC](https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466/2 "2019-05-30T05:46:59Z")
Rather than deleting your question, it would be better if you could share your solution, as it may help others in the future with a similar problem 🙂
---
### Author:  [@TsuWeiQuan](https://discuss.elastic.co/u/TsuWeiQuan)
#### Post date: [May 30, 2019, 6:31am UTC](https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466/3 "2019-05-30T06:31:51Z")
Sure!
The solution to starting my own pipe is to place the pipeline configuration file at `/etc/logstash/conf.d/`
My mistake was that i place it at the` /usr/share/logstash/` directory.
I found this solution after carefully reading the documentation [here](https://www.elastic.co/guide/en/logstash/current/config-setting-files.html)
> On deb and rpm, you place the pipeline configuration files in the `/etc/logstash/conf.d` directory. Logstash tries to load only files with `.conf` extension in the `/etc/logstash/conf.d directory` and ignores all other files.
---
### Author:  [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 30, 2019, 6:32am UTC](https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466/4 "2019-05-30T06:32:14Z")
Awesome, thank you very much for sharing that 😃
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 4, 2022, 7:10am UTC](https://discuss.elastic.co/t/setup-questions-for-custom-logs-from-application-into-logstash/183466/5 "2022-11-04T07:10:07Z")