Link between Kibana filebeat and logstash not done


(leclerc cyril) #1

Hi,

I use Filebeat, logstash and Kibana on the same host but in KIbana i see nothing here is logstash logs

2016-08-10T10:22:53+02:00 DBG End of file reached: C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-one\log\server.log; Backoff now.
2016-08-10T10:22:53+02:00 DBG harvest: "C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-two\log\server.log" position:152733 (offset snapshot:0)
2016-08-10T10:22:53+02:00 INFO Harvester started for file: C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-two\log\server.log
2016-08-10T10:22:53+02:00 DBG End of file reached: C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-two\log\server.log; Backoff now.
2016-08-10T10:22:54+02:00 DBG End of file reached: C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-three\log\server.log; Backoff now.
2016-08-10T10:22:54+02:00 DBG End of file reached: C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-two\log\server.log; Backoff now.
2016-08-10T10:22:54+02:00 DBG End of file reached: C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-one\log\server.log; Backoff now.
2016-08-10T10:22:55+02:00 DBG Flushing spooler because of timeout. Events flushed: 357
2016-08-10T10:22:55+02:00 DBG Publish: {
"@timestamp": "2016-08-10T08:22:53.420Z",
"beat": {
"hostname": "rs-tst-int-02",
"name": "rs-tst-int-02"
},
"count": 1,
"fields": null,
"input_type": "log",
"message": "10:20:37,531 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 99) WFLYUT0021: Registered web context: /AofPortal",
"offset": 146050,
"source": "C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-one\log\server.log",
"type": "log"
}
2016-08-10T10:22:55+02:00 DBG Publish: {
"@timestamp": "2016-08-10T08:22:53.420Z",
"beat": {
"hostname": "rs-tst-int-02",
"name": "rs-tst-int-02"
},
"count": 1,
"fields": null,
"input_type": "log",
"message": "10:20:37,914 INFO [org.apache.cxf.endpoint.ServerImpl] (MSC service thread 1-1) Setting the server's publish address to be http://localhost:8080/AofWeb/AofWsService",
"offset": 146184,
"source": "C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-one\log\server.log",
"type": "log"
}
2016-08-10T10:22:55+02:00 DBG Publish: {
"@timestamp": "2016-08-10T08:22:53.420Z",
"beat": {
"hostname": "rs-tst-int-02",
"name": "rs-tst-int-02"
},
"count": 1,
"fields": null,
"input_type": "log",
"message": "10:20:38,441 INFO [org.jboss.ws.cxf.deployment] (MSC service thread 1-1) JBWS024074: WSDL published to: file:/C:/dev/servers/wildfly-9.0.2.Final/domain/servers/server-one/data/wsdl/AofWeb.war/AofWsService.wsdl",
"offset": 146351,
"source": "C:\dev\servers\wildfly-9.0.2.Final\domain\servers\server-one\log\server.log",
"type": "log"
}

it seems to send data to logstash ? logstash logs

<Cabin::Metrics:0x37a4cfd8 @channel=#<Cabin::Channel:0x679280dc ...>, @metrics={}, @metrics_lock=#Mutex:0x25498a72>, @subscribers={12386=>#<Cabin::Subscriber:0x23ccc2bf @options={}, @output=#<Cabin::Outputs::IO:0x58421ef8 @lock=#Mutex:0x5cff590c, @io=#<File:c:/Elk/logstash/logstash.log>>>}, @level=:debug>, @buffer=[], @operations_mutex=#Mutex:0x2f5287>", :interval=>1, :level=>:debug, :file=>"/Elk/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-2.6.2-java/lib/logstash/outputs/elasticsearch/buffer.rb", :line=>"90", :method=>"interval_flush"}
{:timestamp=>"2016-08-10T10:22

why i see nothing in KIBANA and i think in elastic search? process with logstash agent is working


(leclerc cyril) #2

OK i made some changes and finally it is working , maybe not add "agent" in logstash command


(ruflin) #3

Glad you found a solution. Closing this topic.


(ruflin) #4