i'm trying to use ELK "Elasticsearch , logstash and kibana" to monitor apache and nginx logs
and centralize logs into kibana.
now I have got logs of apache into logstash and kibana so,
what should i do to get ngnix logs too ??
Thanks.
i'm trying to use ELK "Elasticsearch , logstash and kibana" to monitor apache and nginx logs
and centralize logs into kibana.
now I have got logs of apache into logstash and kibana so,
what should i do to get ngnix logs too ??
Thanks.
An exact answer depends on
Ok thanks @magnusbaeck but what about if there are multiple servers i want to monitor and the ELK into another server?
what should i do to monitor all servers "different machines" into a single ELK ?
Install Filebeat on all machines with logs and get them shipped to the machine where you want to run Logstash.
@magnusbaeck only filebeat or filebeat with logstash too ??
That's up to you. I prefer using Filebeat and Logstash together since Logstash has more extensive filtering abilities.
Really thanks alot @magnusbaeck
Is kibana can monitor apache request number , active workers and idle workers ?? if yse could you tell me how to make it into kibana ?
Kibana can monitor any data you throw at it. I don't think there's anything built-in for what you're looking for. but check out Metricbeat and its modules.
@magnusbaeck my metricbeat.yml configuration attached and i followed this steps
https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-configuration.html
but never occurred and no merticbeat* index added to kibana
what should i do ?
###################### Metricbeat Configuration Example #######################
#========================== Modules configuration ============================
metricbeat.config.modules:
module: system
metricsets:
module: apache
metricsets: ["status"]
enabled: true
period: 1s
hosts: ["my_host"]
path: ${path.config}/modules.d/*.yml
reload.enabled: false
#reload.period: 10s
#==================== Elasticsearch template setting ==========================
setup.template.settings:
index.number_of_shards: 1
index.codec: best_compression
#_source.enabled: false
#================================ General =====================================
#name:
#tags: ["service-X", "web-tier"]
#fields:
#============================== Dashboards =====================================
-setup
CLI flag or the setup
command.#setup.dashboards.enabled: false
#setup.dashboards.url:
#============================== Kibana =====================================
setup.kibana:
host: "http://myhost:5601"
#host: "localhost:5601"
#============================= Elastic Cloud ==================================
output.elasticsearch.hosts
andsetup.kibana.host
options.cloud.id
in the Elastic Cloud web UI.#cloud.id:
output.elasticsearch.username
andoutput.elasticsearch.password
settings. The format is <user>:<pass>
.#cloud.auth:
#================================ Outputs =====================================
#-------------------------- Elasticsearch output ------------------------------
output.elasticsearch:
hosts: ["localhost:9200"]
#protocol: "https"
#username: "elastic"
#password: "changeme"
#----------------------------- Logstash output --------------------------------
#output.logstash:
#hosts: ["localhost:5044"]
#ssl.certificate_authorities: ["/etc/pki/root/ca.pem"]
#ssl.certificate: "/etc/pki/client/cert.pem"
#ssl.key: "/etc/pki/client/cert.key"
#================================ Logging =====================================
#logging.level: debug
#logging.selectors: ["*"]
#============================== Xpack Monitoring ===============================
#xpack.monitoring.enabled: false
#xpack.monitoring.elasticsearch:
The Metricbeat logs probably contain clues, especially if you crank up the loglevel. If that doesn't help, ask in the Beats category.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.