WARN [unicast] [graylog-10c86db3-2159-4731-9c3f-14adf0634104] failed to send ping to [{#zen_unicast_1#}{127.0.0.1}{127.0.0.1:9300}] org.elasticsearch.transport.SendRequestTransportException: [][127.0.0.1:9300][internal:discovery/zen/unicast]

Hello guys,

I have a problem when running Graylog2
The problem seems to be Elasticsearch, but Elasticsearch seems to be running just fine.
I've followed the instructions from the graylog website (for CentOS), but the error I get is this one:

2016-08-17T06:03:50.022Z INFO [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check. 2016-08-17T06:04:18.274Z WARN [unicast] [graylog-10c86db3-2159-4731-9c3f-14adf0634104] failed to send ping to [{#zen_unicast_1#}{127.0.0.1}{127.0.0.1:9300}] org.elasticsearch.transport.SendRequestTransportException: [][127.0.0.1:9300][internal:discovery/zen/unicast] at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:340) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.sendPingRequestToNode(UnicastZenPing.java:440) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.sendPings(UnicastZenPing.java:426) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.ping(UnicastZenPing.java:240) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ping.ZenPingService.ping(ZenPingService.java:106) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ping.ZenPingService.pingAndWait(ZenPingService.java:84) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ZenDiscovery.findMaster(ZenDiscovery.java:886) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ZenDiscovery.innerJoinCluster(ZenDiscovery.java:350) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ZenDiscovery.access$4800(ZenDiscovery.java:91) ~[graylog.jar:?] at org.elasticsearch.discovery.zen.ZenDiscovery$JoinThreadControl$1.run(ZenDiscovery.java:1237) ~[graylog.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_45] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_45] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_45] Caused by: org.elasticsearch.transport.NodeNotConnectedException: [][127.0.0.1:9300] Node not connected at org.elasticsearch.transport.netty.NettyTransport.nodeChannel(NettyTransport.java:1132) ~[graylog.jar:?] at org.elasticsearch.transport.netty.NettyTransport.sendRequest(NettyTransport.java:819) ~[graylog.jar:?] at org.elasticsearch.transport.TransportService.sendRequest(TransportService.java:329) ~[graylog.jar:?] ... 12 more 2016-08-17T06:04:20.025Z INFO [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.

Checking the elasticsearch:

curl -XGET 'http://localhost:9200/_cluster/health?pretty=true' { "cluster_name" : "es-graylog", "status" : "green", "timed_out" : false, "number_of_nodes" : 1, "number_of_data_nodes" : 1, "active_primary_shards" : 0, "active_shards" : 0, "relocating_shards" : 0, "initializing_shards" : 0, "unassigned_shards" : 0, "delayed_unassigned_shards" : 0, "number_of_pending_tasks" : 0, "number_of_in_flight_fetch" : 0, "task_max_waiting_in_queue_millis" : 0, "active_shards_percent_as_number" : 100.0 }

The elasticsearch.yml file looks like this:

cluster.name: es-graylog node.name: "clj-lc-test01" network.host: 0.0.0.0 http.port: 9200 discovery.zen.ping.unicast.hosts: ["clj-lc-test01"]

And this is the Graylog config:

is_master = true node_id_file = /etc/graylog/server/node-id password_secret = some secret pass root_password_sha2 = some other secret pass plugin_dir = /usr/share/graylog-server/plugin rest_listen_uri = http://0.0.0.0:12900/ web_enable = true web_listen_uri = http://0.0.0.0:9000/ rotation_strategy = count elasticsearch_max_docs_per_index = 20000000 rotation_strategy = count elasticsearch_max_docs_per_index = 20000000 elasticsearch_max_number_of_indices = 20 retention_strategy = delete elasticsearch_max_number_of_indices = 20 retention_strategy = delete elasticsearch_shards = 4 elasticsearch_replicas = 0 elasticsearch_index_prefix = graylog allow_leading_wildcard_searches = false allow_highlighting = false elasticsearch_analyzer = standard output_batch_size = 500 output_flush_interval = 1 output_fault_count_threshold = 5 output_fault_penalty_seconds = 30 processbuffer_processors = 5 outputbuffer_processors = 3 processor_wait_strategy = blocking ring_size = 65536 inputbuffer_ring_size = 65536 inputbuffer_processors = 2 inputbuffer_wait_strategy = blocking message_journal_enabled = true message_journal_dir = /var/lib/graylog-server/journal lb_recognition_period_seconds = 3 mongodb_uri = mongodb://localhost/graylog mongodb_max_connections = 1000 mongodb_threads_allowed_to_block_multiplier = 5 content_packs_dir = /usr/share/graylog-server/contentpacks content_packs_auto_load = grok-patterns.json

Could anyone give me a hint of where am I getting it wrong?

Thank you,
Gabriel

Hello guys.

In the meantime I've found the problem.
In graylog config I was not saying the name of the elasticsearch cluster.
My bad.

What I needed to add are these lines:

elasticsearch_cluster_name = es-graylog elasticsearch_discovery_zen_ping_unicast_hosts = 127.0.0.1:9300

Gabriel