[7.5.0] Problem with reporting feature (dependencies most likely)

Elastic Stack Kibana
1

Hi there!

I think the title is self-explanatory but I'll add here some further info.

I'm trying to make some reports on a Kibana instance installed on a RHEL 6.3 (Santiago) machine.

Now, it fails with main error
Error spawning Chromium browser: [Error: Protocol error (Target.setDiscoverTargets): Target closed.]

I try to dig deeper but without finding anything really interesting.
I followed the instruction on some other similar posts and when I do

ldd kibana/data/headless_shell-linux/headless_shell | grep not

it returns

data/headless_shell-linux/headless_shell: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by data/headless_shell-linux/headless_shell)
data/headless_shell-linux/headless_shell: /lib64/libc.so.6: version `GLIBC_2.15' not found (required by data/headless_shell-linux/headless_shell)
data/headless_shell-linux/headless_shell: /lib64/libc.so.6: version `GLIBC_2.16' not found (required by data/headless_shell-linux/headless_shell)

Supposing the machine I'm working with is not allowed to access the web, how do I install (if needed) such versions of GLIBC on it?

Is there any chance there's a different cause to this error?

For the sake of completeness I'll post down here the verbose log extracted from Kibana when trying to make a report of a Dashboard.

Thank you!

2 
{
  "type":"log",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "info"
  ],
  "pid":27610,
  "message":"k4xy26b20lay79b7b73ps8nd - Starting job"
}

{
  "type":"log",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "browser-driver",
    "debug"
  ],
  "pid":27610,
  "message":"Creating browser driver factory"
}

{
  "type":"error",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "printable_pdf",
    "execute",
    "k4xy3xkx0lay79b7b73rgviz",
    "error"
  ],
  "pid":27610,
  "level":"error",
  "error":{
    "message":"Error spawning Chromium browser: [Error: Protocol error (Target.setDiscoverTargets): Target closed.]",
    "name":"Error",
    "stack":"Error: Error spawning Chromium browser: [Error: Protocol error (Target.setDiscoverTargets): Target closed.]
                at Observable.Rx.Observable.create [as _subscribe] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:118:24)"
  },
  "message":"Error spawning Chromium browser: [Error: Protocol error (Target.setDiscoverTargets): Target closed.]"
}

{
  "type":"log",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "error"
  ],
  "pid":27610,
  "message":"k4xy26b20lay79b7b73ps8nd - Failure occurred on job k4xy3xkx0lay79b7b73rgviz: Error: Error spawning Chromium browser: [Error: Protocol error (Target.setDiscoverTargets): Target closed.]
              at Observable.Rx.Observable.create [as _subscribe] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:118:24)"
}

{
  "type":"log",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "queue-worker",
    "debug"
  ],
  "pid":27610,
  "message":"Worker error: (k4xy3xkx0lay79b7b73rgviz)"
}

{
  "type":"log",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "warning"
  ],
  "pid":27610,
  "message":"k4xy26b20lay79b7b73ps8nd - Failing job k4xy3xkx0lay79b7b73rgviz"
}

{
  "type":"error",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "warning",
    "process"
  ],
  "pid":27610,
  "level":"error",
  "error":{
    "message":"Error: Protocol error (Target.setDiscoverTargets): Target closed.
                at Promise (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:74:56)
                at new Promise (<anonymous>)
                at Connection.send (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:73:12)
                at Function.create (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Browser.js:34:22)
                at Launcher.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Launcher.js:184:37)
                at module.exports.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Puppeteer.js:37:27)
                at Observable.Rx.Observable.create [as _subscribe] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:100:25)
                at Observable._trySubscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:43:25)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:29:22)
                at MergeMapOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:35:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at TakeOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/take.js:35:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at DoOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/tap.js:29:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at /home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/util/subscribeTo.js:22:31",
    "name":"UnhandledPromiseRejectionWarning",
    "stack":"UnhandledPromiseRejectionWarning: Error: Protocol error (Target.setDiscoverTargets): Target closed.
                at Promise (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:74:56)
                at new Promise (<anonymous>)
                at Connection.send (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:73:12)
                at Function.create (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Browser.js:34:22)
                at Launcher.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Launcher.js:184:37)
                at module.exports.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Puppeteer.js:37:27)
                at Observable.Rx.Observable.create [as _subscribe] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:100:25)
                at Observable._trySubscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:43:25)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:29:22)
                at MergeMapOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:35:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at TakeOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/take.js:35:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at DoOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/tap.js:29:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at /home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/util/subscribeTo.js:22:31
                at emitWarning (internal/process/promises.js:81:15)
                at emitPromiseRejectionWarnings (internal/process/promises.js:120:9)
                at process._tickCallback (internal/process/next_tick.js:69:34)"
  },
  "message":"Error: Protocol error (Target.setDiscoverTargets): Target closed.
              at Promise (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:74:56)
              at new Promise (<anonymous>)
              at Connection.send (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:73:12)
              at Function.create (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Browser.js:34:22)
              at Launcher.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Launcher.js:184:37)
              at module.exports.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Puppeteer.js:37:27)
              at Observable.Rx.Observable.create [as _subscribe] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:100:25)
              at Observable._trySubscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:43:25)
              at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:29:22)
              at MergeMapOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:35:23)
              at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
              at TakeOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/take.js:35:23)
              at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
              at DoOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/tap.js:29:23)
              at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
              at /home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/util/subscribeTo.js:22:31"
}

{
  "type":"error",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "warning",
    "process"
  ],
  "pid":27610,
  "level":"error",
  "error":{
    "message":"Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)",
    "name":"UnhandledPromiseRejectionWarning",
    "stack":"Error: Protocol error (Target.setDiscoverTargets): Target closed.
                at Promise (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:74:56)
                at new Promise (<anonymous>)
                at Connection.send (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:73:12)
                at Function.create (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Browser.js:34:22)
                at Launcher.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Launcher.js:184:37)
                at module.exports.launch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Puppeteer.js:37:27)
                at Observable.Rx.Observable.create [as _subscribe] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:100:25)
                at Observable._trySubscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:43:25)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:29:22)
                at MergeMapOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:35:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at TakeOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/take.js:35:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at DoOperator.call (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/tap.js:29:23)
                at Observable.subscribe (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Observable.js:24:22)
                at /home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/util/subscribeTo.js:22:31"
  },
  "message":"Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)"
}

{
  "type":"log",
  "@timestamp":"2020-01-03T09:18:07Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "info"
  ],
  "pid":27610,
  "message":"k4xy26b20lay79b7b73ps8nd - Job marked as failed: /.reporting-2019.12.29/_doc/k4xy3xkx0lay79b7b73rgviz"
  }
3

Ok so, I've manually downloaded the following files:

http://mirror.centos.org/centos/7/os/x86_64/Packages/glibc-2.17-292.el7.x86_64.rpm
http://mirror.centos.org/centos/7/os/x86_64/Packages/glibc-common-2.17-292.el7.x86_64.rpm
http://mirror.centos.org/centos/7/os/x86_64/Packages/glibc-devel-2.17-292.el7.x86_64.rpm
http://mirror.centos.org/centos/7/os/x86_64/Packages/glibc-headers-2.17-292.el7.x86_64.rpm

I've transferred them to the RHEL machine and (with a sudoer) I've run:

sudo rpm -Uvh glibc-2.17-55.el6.x86_64.rpm \
glibc-common-2.17-55.el6.x86_64.rpm \
glibc-devel-2.17-55.el6.x86_64.rpm \
glibc-headers-2.17-55.el6.x86_64.rpm --force --nodeps

to force the installation.

Running ldd kibana/data/headless_shell-linux/headless_shell | grep not now returns nothing (good) and when trying to make a report it returns the following new error:

Error: Request to [https://feeds.elastic.co/kibana/v7.5.0.json] failed! [net::ERR_NAME_NOT_RESOLVED]

which is the same I have on a brand-new Kibana installation on my local machine if I try generating a report with no internet connection.

So the questions are: is it supposed to work like that? Can't I generate offline reports (sounds strange)? How do I fix it?

Thanks

4

@tsullivan one more reporting question for you please.

Thanks,
Bhavya

1 Like
5

Again to help you better understand the error I'll post here the Kibana log when trying to make a report:

{
  "type":"error",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "printable_pdf",
    "execute",
    "k53mzhc20hdx79b7b7dp6xeu",
    "error"
  ],
  "pid":22533,
  "level":"error",
  "error":{
    "message":"Request to [https://feeds.elastic.co/kibana/v7.5.0.json] failed! [net::ERR_NAME_NOT_RESOLVED]",
    "name":"Error",
    "stack":"Error: Request to [https://feeds.elastic.co/kibana/v7.5.0.json] failed! [net::ERR_NAME_NOT_RESOLVED]
              at MergeMapSubscriber.Rx.fromEvent.pipe.req [as project] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:197:30)
              at MergeMapSubscriber._tryNext (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:65:27)
              at MergeMapSubscriber._next (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:55:18)
              at MergeMapSubscriber.Subscriber.next (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Subscriber.js:64:18)
              at Page.handler (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/observable/fromEvent.js:22:28)
              at Page.emit (events.js:189:13)
              at NetworkManager.Page.networkManager.on.event (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Page.js:112:74)
              at NetworkManager.emit (events.js:189:13)
              at NetworkManager._onLoadingFailed (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/NetworkManager.js:315:10)
              at CDPSession.emit (events.js:189:13)
              at CDPSession._onMessage (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:200:12)
              at Connection._onMessage (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:112:17)
              at PipeTransport._dispatch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/PipeTransport.js:61:22)
              at Socket.PipeTransport._eventListeners.helper.addEventListener.buffer (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/PipeTransport.js:30:64)
              at Socket.emit (events.js:189:13)
              at addChunk (_stream_readable.js:284:12)"
    },
    "message":"Request to [https://feeds.elastic.co/kibana/v7.5.0.json] failed! [net::ERR_NAME_NOT_RESOLVED]"
}

{
  "type":"log",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "browser-driver",
    "headless-browser-console",
    "error"
  ],
  "pid":22533,
  "message":"Failed to load resource: net::ERR_NAME_NOT_RESOLVED"
}

{
  "type":"log",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "error"
  ],
  "pid":22533,
  "message":"k4y3wb010hdx79b7b7144swy - Failure occurred on job k53mzhc20hdx79b7b7dp6xeu: Error: Request to [https://feeds.elastic.co/kibana/v7.5.0.json] failed! [net::ERR_NAME_NOT_RESOLVED]
            at MergeMapSubscriber.Rx.fromEvent.pipe.req [as project] (/home/logstash/kibana-7.5.0-linux-x86_64/x-pack/legacy/plugins/reporting/server/browsers/chromium/driver_factory/index.js:197:30)
            at MergeMapSubscriber._tryNext (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:65:27)
            at MergeMapSubscriber._next (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/operators/mergeMap.js:55:18)
            at MergeMapSubscriber.Subscriber.next (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/Subscriber.js:64:18)
            at Page.handler (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/rxjs/internal/observable/fromEvent.js:22:28)
            at Page.emit (events.js:189:13)
            at NetworkManager.Page.networkManager.on.event (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Page.js:112:74)
            at NetworkManager.emit (events.js:189:13)
            at NetworkManager._onLoadingFailed (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/NetworkManager.js:315:10)
            at CDPSession.emit (events.js:189:13)
            at CDPSession._onMessage (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:200:12)
            at Connection._onMessage (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/Connection.js:112:17)
            at PipeTransport._dispatch (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/PipeTransport.js:61:22)
            at Socket.PipeTransport._eventListeners.helper.addEventListener.buffer (/home/logstash/kibana-7.5.0-linux-x86_64/node_modules/puppeteer-core/lib/PipeTransport.js:30:64)
            at Socket.emit (events.js:189:13)
            at addChunk (_stream_readable.js:284:12)"
}

{
  "type":"log",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "warning"
  ],
  "pid":22533,
  "message":"k4y3wb010hdx79b7b7144swy - Failing job k53mzhc20hdx79b7b7dp6xeu"
}

{
  "type":"log",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "browser-driver",
    "headless-browser-console",
    "error"
  ],
  "pid":22533,
  "message":"JSHandle@error"
}

{
  "type":"log",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "printable_pdf",
    "execute",
    "k53mzhc20hdx79b7b7dp6xeu",
    "error"
  ],
  "pid":22533,
  "message":"waitForSelector .application failed on my_dashboard_url"
}

{
  "type":"log",
  "@timestamp":"2020-01-07T08:53:30Z",
  "tags":[
    "reporting",
    "esqueue",
    "queue-worker",
    "info"
  ],
  "pid":22533,
  "message":"k4y3wb010hdx79b7b7144swy - Job marked as failed: /.reporting-2020.01.05/_doc/k53mzhc20hdx79b7b7dp6xeu"
}
6

Nobody here? I start to think it might be a bug.

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

8

If the Kibana server is air-gapped, then the reporting failed generating the report because it fails download the Newsfeed.

This is a bug and we fixed it on 7.5.2

If you do not want to upgrade, please disable the newsfeed in kibana.yml and restart Kibana:

newsfeed.enabled: false
9

Regarding the Glibc, please check Kibana & your Operating system version in Kibana here.

Kibana 7.5 doesn't support RHEL 6.x especially for reporting.

A workaround instead of copying libc would be to run Kibana in Docker.