Reporting not working on Kibana under docker

reporting

(Daniele Tesse) #1

Hi all, I'm experiencing issues with the reporting functionality on my ELK 6.6.0 cluster under docker.
Every time I try to create a Report I get the following error:

TimeoutError: waiting for selector "[data-test-subj="euiToastHeader"]" failed: timeout 30000ms exceeded

Inspecting the kibana's log I find this message:

{"type":"log","@timestamp":"2019-02-26T11:43:40Z","tags":["reporting","browser-driver","chromium-driver-factory","headless-chromium-driver","error"],"pid":1,"message":"waitForSelector [data-shared-item],[data-shared-items-count] failed on http://0.0.0.0:5601/login?next=%2Fapp%2Fkibana#/dashboard/0fd65b40-35e5-11e9-a24e-1dc39317a6ca.....

In addition, I have several defunct process into the kibana container:

kibana 426 1 0 11:07 ? 00:00:00 [headless_shell]
kibana 438 1 0 11:07 ? 00:00:00 [headless_shell]
kibana 450 1 1 11:07 ? 00:00:02 [headless_shell]

I tried disabling the chromium sandbox as suggested here https://www.elastic.co/guide/en/kibana/current/reporting-chromium-sandbox.html without luck.

Searching on internet, I found that could be an issue with the chromium driver under docker, but I'm not sure it is the case:

Is there a away to make it work?

Regards


#2

Hi @kibit86,

Can you please share a full log from the moment when Kibana is started to the moment when you try to create a report?

Also check out System requirements for Reporting and this bug report (there is a chance your docker image environment is missing some dependencies).

Best,
Oleg


(Daniele Tesse) #3

Hi azasypkin,
system requirements are surely sutisfied as the machine has 32GB of RAM and 8 CPUs.

The log section from the start to the request is very big, could you please tell me what informations you need, in order to let me able to filter the output?

Thanks


#4

The log section from the start to the request is very big, could you please tell me what informations you need, in order to let me able to filter the output?

Any error log records and anything that is mentioning Chrome maybe, especially at the initial stage of Kibana bootstrap.


(Daniele Tesse) #5

Here the log containing chromium strings

Blockquote
{"type":"log","@timestamp":"2019-02-26T11:06:19Z","tags":["reporting","browser-driver","warning"],"pid":1,"message":"Enabling the Chromium sandbox provides an additional layer of protection."}
{"type":"log","@timestamp":"2019-02-26T11:07:49Z","tags":["reporting","browser-driver","chromium-driver-factory","headless-chromium-driver","error"],"pid":1,"message":"waitForSelector [data-shared-item],[data-shared-items-count] failed on http://0.0.0.0:5601/login?next=%2Fapp%2Fkibana#/dashboard/55993a70-3636-11e9-a2aa-c35af3ddf5b5?_g=(refreshInterval:(pause:!f,value:60000),time:(from:now-4h,mode:quick,to:now))&_a=(description:'',filters:!(),fullScreenMode:!f,options:(darkTheme:!f,hidePanelTitles:!t,useMargins:!f),panels:!((gridData:(h:10,i:'1',w:8,x:16,y:4),id:'507d3b80-3632-11e9-a2aa-c35af3ddf5b5',panelIndex:'1',type:visualization,version:'6.6.0'),(gridData:(h:10,i:'2',w:8,x:24,y:4),id:'18c96fb0-3632-11e9-a2aa-c35af3ddf5b5',panelIndex:'2',type:visualization,version:'6.6.0'),(gridData:(h:10,i:'3',w:8,x:8,y:4),id:'5d6b5ce0-3633-11e9-a2aa-c35af3ddf5b5',panelIndex:'3',type:visualization,version:'6.6.0'),(gridData:(h:10,i:'4',w:8,x:32,y:4),id:ee00ad70-3631-11e9-a2aa-c35af3ddf5b5,panelIndex:'4',type:visualization,version:'6.6.0'),(gridData:(h:10,i:'5',w:8,x:40,y:4),id:ac410dc0-3632-11e9-a2aa-c35af3ddf5b5,panelIndex:'5',type:visualization,version:'6.6.0'),(gridData:(h:10,i:'6',w:8,x:0,y:4),id:'6c37e290-3631-11e9-a2aa-c35af3ddf5b5',panelIndex:'6',type:visualization,version:'6.6.0'),(gridData:(h:15,i:'7',w:24,x:0,y:14),id:d3ffe400-3635-11e9-a2aa-c35af3ddf5b5,panelIndex:'7',type:visualization,version:'6.6.0'),(gridData:(h:15,i:'8',w:24,x:24,y:14),id:'5c22da80-3637-11e9-a2aa-c35af3ddf5b5',panelIndex:'8',type:visualization,version:'6.6.0'),(gridData:(h:15,i:'9',w:24,x:24,y:29),id:'71eeb600-35f5-11e9-a24e-1dc39317a6ca',panelIndex:'9',type:visualization,version:'6.6.0'),(gridData:(h:7,i:'10',w:8,x:0,y:37),id:'01855d90-320a-11e9-a24e-1dc39317a6ca',panelIndex:'10',type:visualization,version:'6.6.0'),(gridData:(h:8,i:'11',w:12,x:0,y:29),id:'84c85820-35f6-11e9-a24e-1dc39317a6ca',panelIndex:'11',type:visualization,version:'6.6.0'),(gridData:(h:8,i:'12',w:12,x:12,y:29),id:f392c560-35f6-11e9-a24e-1dc39317a6ca,panelIndex:'12',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:7,i:'13',w:8,x:8,y:37),id:'25076ef0-36b7-11e9-a2aa-c35af3ddf5b5',panelIndex:'13',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:7,i:'14',w:8,x:16,y:37),id:b486d4f0-36b0-11e9-a2aa-c35af3ddf5b5,panelIndex:'14',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:4,i:'15',w:24,x:0,y:0),id:de030d10-38ec-11e9-a24e-1dc39317a6ca,panelIndex:'15',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:4,i:'16',w:24,x:24,y:0),id:a2fdec00-38ef-11e9-a24e-1dc39317a6ca,panelIndex:'16',type:visualization,version:'6.6.0')),query:(language:lucene,query:''),timeRestore:!t,title:'%5BDashboard%5D%5BGeneral%5D%20-%20Overall%20Status',viewMode:view)&forceNow=2019-02-26T11:07:14.215Z"}
{"type":"log","@timestamp":"2019-02-26T11:15:55Z","tags":["reporting","browser-driver","chromium-driver-factory","headless-chromium-driver","error"],"pid":1,"message":"waitForSelector [data-shared-item],[data-shared-items-count] failed on http://0.0.0.0:5601/login?next=%2Fapp%2Fkibana#/dashboard/0fd65b40-35e5-11e9-a24e-1dc39317a6ca?_g=(refreshInterval:(pause:!f,value:60000),time:(from:now-4h,mode:quick,to:now))&_a=(description:'Welcome%20Dashboard',filters:!(),fullScreenMode:!f,options:(darkTheme:!f,hidePanelTitles:!f,useMargins:!t),panels:!((embeddableConfig:(),gridData:(h:14,i:'1',w:12,x:12,y:0),id:'62ef1ef0-35e2-11e9-a24e-1dc39317a6ca',panelIndex:'1',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'3',w:12,x:24,y:0),id:a2b48a60-35e3-11e9-a24e-1dc39317a6ca,panelIndex:'3',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'4',w:12,x:36,y:0),id:fb0c0cb0-35e3-11e9-a24e-1dc39317a6ca,panelIndex:'4',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'5',w:12,x:0,y:14),id:'18c8cfe0-35e4-11e9-a24e-1dc39317a6ca',panelIndex:'5',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'6',w:12,x:24,y:14),id:'529f8640-35e5-11e9-a24e-1dc39317a6ca',panelIndex:'6',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'7',w:12,x:12,y:14),id:'8327b030-35e5-11e9-a24e-1dc39317a6ca',panelIndex:'7',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'8',w:12,x:36,y:14),id:fd1c23d0-35ea-11e9-a24e-1dc39317a6ca,panelIndex:'8',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'9',w:12,x:0,y:0),id:'3fff6870-3699-11e9-a24e-1dc39317a6ca',panelIndex:'9',type:visualization,version:'6.6.0')),query:(language:lucene,query:''),timeRestore:!t,title:'%5BDashboard%5D%20-%20Welcome',viewMode:view)&forceNow=2019-02-26T11:15:20.663Z"}
{"type":"log","@timestamp":"2019-02-26T11:43:40Z","tags":["reporting","browser-driver","chromium-driver-factory","headless-chromium-driver","error"],"pid":1,"message":"waitForSelector [data-shared-item],[data-shared-items-count] failed on http://0.0.0.0:5601/login?next=%2Fapp%2Fkibana#/dashboard/0fd65b40-35e5-11e9-a24e-1dc39317a6ca?_g=(refreshInterval:(pause:!f,value:60000),time:(from:now-4h,mode:quick,to:now))&_a=(description:'Welcome%20Dashboard',filters:!(),fullScreenMode:!f,options:(darkTheme:!f,hidePanelTitles:!f,useMargins:!t),panels:!((embeddableConfig:(),gridData:(h:14,i:'1',w:12,x:12,y:0),id:'62ef1ef0-35e2-11e9-a24e-1dc39317a6ca',panelIndex:'1',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'3',w:12,x:24,y:0),id:a2b48a60-35e3-11e9-a24e-1dc39317a6ca,panelIndex:'3',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'4',w:12,x:36,y:0),id:fb0c0cb0-35e3-11e9-a24e-1dc39317a6ca,panelIndex:'4',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'5',w:12,x:0,y:14),id:'18c8cfe0-35e4-11e9-a24e-1dc39317a6ca',panelIndex:'5',type:visualization,version:'6.6.0'),(embeddableConfig:(),gridData:(h:14,i:'6',w:12,x:24,y:14),id:'529f8640-35e5-11e9-....

In addition I find several entries about requests from headless chromium agent:
{"type":"response","@timestamp":"2019-02-26T11:07:17Z","tags":,"pid":1,"method":"get","statusCode":200,"req":{"url":"/plugins/metrics/index.css","method":"get","headers":{"host":"0.0.0.0:5601","connection":"keep-alive","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/71.0.3563.0 Safari/537.36","accept":"text/css,/;q=0.1","referer":"http://0.0.0.0:5601/login?next=%2Fapp%2Fkibana","accept-encoding":"gzip, deflate"},"remoteAddress":"127.0.0.1","userAgent":"127.0.0.1","referer":"http://0.0.0.0:5601/login?next=%2Fapp%2Fkibana"},"res":{"statusCode":200,"responseTime":10,"contentLength":9},"message":"GET /plugins/metrics/index.css 200 10ms - 9.0B"}


(Daniele Tesse) #6

Is someone able to reproduce this issue in its docker lab?


(Lewis Barclay) #7

I've got this issue currently but not using Docker, just a straight Kibana install. Did you manage to find a resolution?


(Daniele Tesse) #8

NO, unfortunately I still face this issue with the reporting feature. Which version of kibana are you using? could it be something related to the kibana version 6.6.X?


(Lewis Barclay) #9

Yes same version as you, 6.6.0! I've got a ticket logged, will keep you updated!


(Daniele Tesse) #10

Thank you


(Lewis Barclay) #11

Do you have support or are you using the trial?


(Daniele Tesse) #12

I'm actually using the trial license on my lab environment


(Hung Minh Nguyen) #13

Same issue here too. is this a confirmed bug from Elastic?


(Lewis Barclay) #14

I think its looking like a bug, support is saying the logs are confusing and that its leaning towards a bug. Will keep you guys updated when I hear back!


(Lewis Barclay) #15

Hey guys,

I have the answer, or at least finally sorted my issue. Can you please ensure that your server.host and server.name settings are both fully lowercase in your kibana.yml file?


(Martin Juul Petersen) #16

Running the full elasticstack using docker-compose here and I am running into the same issue with reporting, using a trial x-pack license. I've tried fiddling with everything and I can't really seem to find any error messages in neither ElasticSearch nor Kibana log files.

My server.host and server.name settings are all lowercase already.

I tried doing a report with an empty search in "discover" and that actually seemed to work, but no visualizations whatsoever will work.


(Martin Juul Petersen) #17

Well, with that said I also did figure it out for me. Apparently the reporting server was having issues resolving the correct URL to the Kibana interface, so I went into my kibana.yml and added the proxy parameters:

xpack.reporting.kibanaServer.hostname: kibana
xpack.reporting.kibanaServer.protocol: http
xpack.reporting.kibanaServer.port: 5601

and suddenly it started working. Docker will resolve the hostname of 'kibana' to the relevant machine running the Kibana instance, so this works out for me.


(Daniele Tesse) #18

It works!
thank you very much Capsup