Can't load modules

I have a website that is hosted with apache. I can't seem to get the apache module working.

I think this is happening because filebeat output is directed to logstash (not elasticsearch).

If I just a regular filebeat setup I get this:

Exiting: Index management requested but the Elasticsearch output is not configured/enabled

I ran these commands:

filebeat modules enable apache
nano /etc/filebeat/modules.d/apache.yml # Pointed to the logs (https://i.imgur.com/jTpKQuK.png)
filebeat setup --pipelines --modules apache,apache2
filebeat setup --dashboards
systemctl restart filebeat

As advised by this guide, I've configured logstash to use pipelines output (this is my logstash output config)

And it seems like it won't receive anything

Is it possible to send modules through logstash? Am I missing something? Thanks ahead.

this is what I'm getting from logstash:

[2020-09-03T10:29:25,247][WARN ][logstash.outputs.elasticsearch][main][96b7324cb7ac9fdd78624e65847b5937676961062569496354cd70bf75aeebf8] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-7.9.0-2020.09.03", :routing=>nil, :_type=>"_doc", :pipeline=>"filebeat-7.9.0-apache-access-pipeline"}, #<LogStash::Event:0x5b062f79>], :response=>{"index"=>{"_index"=>"filebeat-7.9.0-2020.09.03", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"illegal_argument_exception", "reason"=>"pipeline with id [filebeat-7.9.0-apache-access-pipeline] does not exist"}}}}

Is this your thread over on Reddit? https://www.reddit.com/r/elasticsearch/comments/ilsogs/cant_load_modules/

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.