t-nakata
(NAKATA)
November 11, 2019, 5:59am
1
Filebeatを使用してElasticseachにデータを登録したいです。その際、FilebeatからLogstash経由で登録したいものと、直接Elasticseachに登録したいファイルが存在します。その場合、一つのFilebeatで実現することは可能でしょうか?
マニュアルを見ると、Filebeatにて指定できるOutputは1つのみとあります。
やはりFilebeatを2台用意し、Outputの設定をそれぞれLogstash、Elasticseachにするといった方法となりますでしょうか?
st1t
(Shota Ito)
November 11, 2019, 9:01am
3
昔Issueが上がってたみたいですが、現時点では難しいのかな?と思っています。
ちなみに、Outputを2箇所に分けておきたいのはどのような目的からでしょうか?
opened 07:07PM - 25 Feb 16 UTC
closed 02:45AM - 09 Mar 16 UTC
enhancement
libbeat
Beats already support outputting to any combination of one file, ES, LS, redis, … kafka, and console at the same time. Could Beats be enhanced to support multiple outputs of the same type? An example use case is shown below.
```
|-->Logstash input host (dev) -> redis queue (dev) -> logstash filter hosts (dev) -> elasticsearch (dev)
Filebeat --|
|-->Logstash input host (prod) -> redis queue (prod) -> logstash filter hosts (prod) -> elasticsearch (prod)
```
Assuming there are no issues around multi-instantiation of an output type, then I think the biggest challenge here is around how to handle this in configuration (without braking backwards-compatability).
Hi All,
Wanted to use elasticsearch and logstash for filebeat output. Though we can use the multiple instances of filebeat would like to check any other possible options.
Requirement
Use elasticsearch output for default filebeat embedded modules like system and apache module
Use logstash output for custom log file parsing and output.
Considering workarounds
create multiple logstash pipelines in which use the pipeline parameter for es output for every ingest pipeline. Many input filters to …
system
(system)
Closed
December 9, 2019, 9:01am
4
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.