No logs on Kibana discover under filebeat-* index


(Shahid Chaudhary) #1

I installed new ELK server single node .

on the first login i am getting the error of indice idex .
here is my filebeat logs form y ELK server.

sudo service filebeat restart
root@ip-172-31-10-222:# sudo tail -f /var/log/filebeat/filebeat
2018-11-10T12:23:15.678Z ERROR pipeline/output.go:100 Failed to connect to backoff(elasticsearch(http://localhost:9200)): Connection marked as failed because the onConnect callback failed: Error loading pipeline for fileset nginx/access: This module requires the following Elasticsearch plugins: ingest-user-agent, ingest-geoip. You can install them by running the following commands on all the Elasticsearch nodes:
sudo bin/elasticsearch-plugin install ingest-user-agent
sudo bin/elasticsearch-plugin install ingest-geoip
2018-11-10T12:23:15.678Z INFO pipeline/output.go:93 Attempting to reconnect to backoff(elasticsearch(http://localhost:9200)) with 4 reconnect attempt(s)
2018-11-10T12:23:15.679Z INFO [publish] pipeline/retry.go:189 retryer: send unwait-signal to consumer
2018-11-10T12:23:15.679Z INFO [publish] pipeline/retry.go:191 done
2018-11-10T12:23:15.679Z INFO [publish] pipeline/retry.go:166 retryer: send wait signal to consumer
2018-11-10T12:23:15.679Z INFO [publish] pipeline/retry.go:168 done
2018-11-10T12:23:15.699Z INFO elasticsearch/client.go:712 Connected to Elasticsearch version 6.4.3
2018-11-10T12:23:15.719Z INFO template/load.go:129 Template already exists and will not be overwritten.
2018-11-10T12:23:29.379Z INFO [monitoring] log/log.go:141 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":120,"time":{"ms":121}},"total":{"ticks":770,"time":{"ms":775},"value":770},"user":{"ticks":650,"time":{"ms":654}}},"info":{"ephemeral_id":"1d169a7c-b030-42f1-8b17-704cdee49d4d","uptime":{"ms":30250}},"memstats":{"gc_next":11102784,"memory_alloc":5923976,"memory_total":20553408,"rss":29851648}},"filebeat":{"events":{"active":4126,"added":4145,"done":19},"harvester":{"open_files":10,"running":10,"started":10}},"libbeat":{"config":{"module":{"running":0},"reloads":1},"output":{"read":{"bytes":9916},"type":"elasticsearch","write":{"bytes":5783}},"pipeline":{"clients":13,"events":{"active":4120,"filtered":22,"published":4116,"retry":100,"total":4142}}},"registrar":{"states":{"current":7,"update":19},"writes":{"success":19,"total":19}},"system":{"cpu":{"cores":2},"load":{"1":3.93,"15":3.69,"5":4,"norm":{"1":1.965,"15":1.845,"5":2}}}}}}
2018-11-10T12:23:31.814Z ERROR pipeline/output.go:100 Failed to connect to backoff(elasticsearch(http://localhost:9200)): Connection marked as failed because the onConnect callback failed: Error loading pipeline for fileset nginx/access: This module requires the following Elasticsearch plugins: ingest-user-agent, ingest-geoip. You can install them by running the following commands on all the Elasticsearch nodes:
** sudo bin/elasticsearch-plugin install ingest-user-agent**
** sudo bin/elasticsearch-plugin install ingest-geoip**

I tried to install this

by using the below bits its not installed.

root@ip-172-31-10-222:/bin# sudo bin/elasticsearch-plugin install ingest-user-agent
sudo: bin/elasticsearch-plugin: command not found
root@ip-172-31-10-222:/bin# sudo elasticsearch-plugin install ingest-user-agent
sudo: elasticsearch-plugin: command not found
root@ip-172-31-10-222:/bin# apt-get install elasticsearch-plugin
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package elasticsearch-plugin
root@ip-172-31-10-222:/bin# apt-get install -y elasticsearch-plugin
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package elasticsearch-plugin

the issue is under the discover TAB i am getting logs against merticbeat-* and heartbeat-* indexs but there no logs against the filebeat- index*
please find the screen for the references


(Steffen Siering) #2

Please properly format CLI input/output, logs, and configuration files using the </> button.

How did you install/setup elasticsearch? Looks like your Elasticsearch setup is incomplete.

root@ip-172-31-10-222:/bin# sudo bin/elasticsearch-plugin install ingest-user-agent
sudo: bin/elasticsearch-plugin: command not found

You get this failure because you are either a) in the wrong directory, b) the source you installed from does not contain the elasticsearch-plugin tool, or c) elasticsearch-plugin is installed in some other directory.

You get this error:

root@ip-172-31-10-222:/bin# apt-get install -y elasticsearch-plugin
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package elasticsearch-plugin

Because the package does not exist.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.