Multiple configuration files not working as expected


(Lookingcloudy) #1

I have two configuration files. When I try to run together using bin/logstash -f config/*.conf only one of the configuration files runs. Both files have the same .sql but different SQL connection strings (different databases). When I run them one at a time they work as expected.

Any clue as to why this isn't working?

customer1.conf

input {
jdbc {
type => "referrals_cust1"
jdbc_driver_library => "sqljdbc4.jar"
jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
jdbc_connection_string => "jdbc:sqlserver://...t;"
jdbc_user => "..."
jdbc_password => "....$"
jdbc_fetch_size => 5000
#schedule => "*/2 * * * *"
statement_filepath => "sql/referrals.sql"
}
}
output {
#stdout { codec => rubydebug }
if [type] == "referrals_cust1" {
elasticsearch {
protocol => http
index => "cust1"
document_type => "referrals"
document_id => "%{policyref}"
cluster => "staging"
host => "localhost"
doc_as_upsert => true
}
}
}

customer2.conf

input {
jdbc {
type => "referrals_cust2"
jdbc_driver_library => "sqljdbc4.jar"
jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
jdbc_connection_string => "jdbc:sqlserver://...;"
jdbc_user => "..."
jdbc_password => "...$"
jdbc_fetch_size => 5000
#schedule => "*/2 * * * *"
statement_filepath => "sql/referrals.sql"
}
}
output {
#stdout { codec => rubydebug }
if [type] == "referrals_cust2" {
elasticsearch {
protocol => http
index => "cust2"
document_type => "referrals"
document_id => "%{policyref}"
cluster => "staging"
host => "localhost"
doc_as_upsert => true
}
}
}


(Vincent Tran) #2

Can you run with the --debug flag? It will log conf loading.


(Architha) #3

@lookingcloudy

Hi lookingcloudy , did you find a solution for this ? I have a similar situation where i have to run multiple config files with scheduling involved. Please help :slight_smile:
Thanks in advance !


(system) #4