Combining Multiple Config Files

Elastic Stack Logstash
1

Hi,

How would I be able to combine multiple config files to push data to elasticsearch.

I currently have 2 csv files that have different column names and data results. I want to be able to run multiple config files and display results on Kibana.

Thanks,

kate

2

One approach is to put all the config files in a single directory and then you call logstash like this:

logstash -f path_to_directory

BUT, in order for this to work, in each config file you need to use types as shown below. Each config file must have a different type or else the config files will step on each other.

input {
 -your normal input settings-
 type => "my_type_1"
}

filter {
 if [type] == "my_type_1"{
  -your normal filter settings-
 }
}

output {
 if [type] == "my_type_1" {
  -your normal output settings-
 }
}

1 Like
3

Once that is set how do I run multiple config files on the same directory. They are all in the conf folder. When I run logstash -f "path to conf file" I get configuration file not found error.

4

That should do the trick. Hmm.

Are the config files all named with extension '.config' ?

Are there any files in that directory that aren't config files? I recall that causes a problem.

Are there any spaces in the directory path? If so, try enclosing the path in double-quotes or making an alias to that directory without spaces in it.

5

All have extension .Conf

6

Sorry, I'm not sure what the issue could be.

7

Nevermind issue is resolved.

8

What was the problem, it might help others in future if you can share it.