I'm working on updating a project from using Elastic OSS components at version 7.6.2 to version 7.9.2. For the most part everything has gone smoothly. However, I've gotten stuck on a few plugins that, although they install correctly, and don't throw any obvious errors per se, they don't seem to show up at all in the Kibana GUI.
I know the purpose of this forum is not to debug 3rd party plugins, and I'm not asking for that specifically. But I'm hoping for some direction on how I can debug what it is about the plugins that don't show up in the GUI vs. those that do so I can get it resolved.
Here are a list of the plugins I'm using:
- kibana-comments-app-plugin - works
- elastalert-kibana-plugin - works
- kibana-swimlane - missing
- kibana-sankey - missing
- kibana-drilldown - missing
As you can see in my Dockerfile, I'm swapping out the version strings from the released versions to 7.9.2 and making a few other tweaks that I've found are required to get the installation to work. During my docker image build, the plugins appear to succeed:
Installing ElastAlert plugin...
Archive: elastalert-kibana-plugin.zip
inflating: kibana/elastalert-kibana-plugin/package.json
inflating: kibana/elastalert-kibana-plugin/public/components/main/main.js
updating: kibana/elastalert-kibana-plugin/package.json (deflated 42%)
updating: kibana/elastalert-kibana-plugin/public/components/main/main.js (deflated 63%)
Attempting to transfer from file:///tmp/elastalert-kibana-plugin.zip
Transferring 24641559 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
Installing Sankey visualization...
Archive: /tmp/kibana-sankey.zip
...
Attempting to transfer from file:///tmp/sankey_vis.zip
Transferring 12062304 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
Installing Drilldown menu plugin...
Archive: /tmp/kibana-drilldown.zip
...
Attempting to transfer from file:///tmp/drilldown.zip
Transferring 195325 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
Installing Comments visualization...
Archive: kibana-comments.zip
inflating: kibana/kibana-comments-app-plugin/package.json
inflating: kibana/kibana-comments-app-plugin/public/app.js
updating: kibana/kibana-comments-app-plugin/package.json (deflated 48%)
updating: kibana/kibana-comments-app-plugin/public/app.js (deflated 75%)
Attempting to transfer from file:///tmp/kibana-comments.zip
Transferring 23644018 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
Installing Swimlanes visualization...
Archive: kibana-swimlane.zip
inflating: kibana/prelert_swimlane_vis/package.json
updating: kibana/prelert_swimlane_vis/package.json (deflated 40%)
Attempting to transfer from file:///tmp/kibana-swimlane.zip
Transferring 251923 bytes....................
Transfer complete
Retrieving metadata from plugin archive
Extracting plugin archive
Extraction complete
Plugin installation complete
Here are the relevant lines from the logs at Kibana startup:
2020-10-16T13:12:44Z info plugins-service Plugin "visTypeXy" is disabled.
2020-10-16T13:12:46Z warning legacy-service Some installed third party plugin(s) [elastalert-kibana-plugin, kbn_sankey_vis, kibana-comments-app-plugin, kibana-plugin-drilldownmenu, prelert_swimlane_vis] are using the legacy plugin format and will no longer work in a future Kibana release. Please refer to https://ela.st/kibana-breaking-changes-8-0 for a list of breaking changes and https://ela.st/kibana-platform-migration for documentation on how to migrate legacy plugins.
2020-10-16T13:12:46Z warning config","deprecation kibana.defaultAppId is deprecated and will be removed in 8.0. Please use the `defaultRoute` advanced setting instead
2020-10-16T13:12:46Z info plugins-system Setting up [38] plugins: [usageCollection,telemetryCollectionManager,telemetry,kibanaUsageCollection,newsfeed,mapsLegacy,kibanaLegacy,timelion,share,legacyExport,esUiShared,charts,bfetch,expressions,data,home,console,apmOss,management,indexPatternManagement,advancedSettings,savedObjects,visualizations,visualize,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,tileMap,regionMap,inputControlVis,discover,dashboard,savedObjectsManagement]
2020-10-16T13:12:46Z info savedobjects-service Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...
2020-10-16T13:12:46Z info savedobjects-service Starting saved objects migrations
2020-10-16T13:12:46Z info savedobjects-service Creating index .kibana_1.
2020-10-16T13:12:47Z info savedobjects-service Pointing alias .kibana to .kibana_1.
2020-10-16T13:12:47Z info savedobjects-service Finished in 694ms.
2020-10-16T13:12:47Z info plugins-system Starting [38] plugins: [usageCollection,telemetryCollectionManager,telemetry,kibanaUsageCollection,newsfeed,mapsLegacy,kibanaLegacy,timelion,share,legacyExport,esUiShared,charts,bfetch,expressions,data,home,console,apmOss,management,indexPatternManagement,advancedSettings,savedObjects,visualizations,visualize,visTypeVislib,visTypeVega,visTypeTimeseries,visTypeTimelion,visTypeTagcloud,visTypeTable,visTypeMetric,visTypeMarkdown,tileMap,regionMap,inputControlVis,discover,dashboard,savedObjectsManagement]
2020-10-16T13:12:49Z info optimize Optimizing and caching bundles for elastalert-kibana-plugin, kibana-comments-app-plugin, status_page and timelion. This may take a few minutes
Error in worker TypeError [ERR_INVALID_ARG_TYPE]: The "id" argument must be of type string. Received type object
Error in worker TypeError [ERR_INVALID_ARG_TYPE]: The "id" argument must be of type string. Received type object
Error in worker TypeError [ERR_INVALID_ARG_TYPE]: The "id" argument must be of type string. Received type object
2020-10-16T13:13:41Z info optimize Optimization of bundles for elastalert-kibana-plugin, kibana-comments-app-plugin, status_page and timelion complete in 51.78 seconds
2020-10-16T13:13:41Z status plugin:kibana@7.9.2 Status changed from uninitialized to green - Ready
...
2020-10-16T13:13:41Z status plugin:elasticsearch@7.9.2 Status changed from yellow to green - Ready
2020-10-16T13:13:41Z status plugin:elastalert-kibana-plugin@1.3.0 Status changed from uninitialized to green - Ready
2020-10-16T13:13:41Z status plugin:kibana-comments-app-plugin@7.9.2-1 Status changed from uninitialized to green - Ready
2020-10-16T13:13:41Z info Server running at http://0:5601/kibana
2020-10-16T13:13:41Z info Kibana http server running at http://0:5601/kibana
I notice a few things that may(?) be related:
- The "Some installed third party plugins are using the legacy plugin format" message: I understand that they'll be deprecated in a future release, and I'll have to deal with that at that point. But 7.9.2 does still support the legacy plugin format, right? You'll notice that the list of plugins here includes both the working and "broken" plugins I'm installing.
- The "Optimization of bundles for elastalert-kibana-plugin, kibana-comments-app-plugin..." message: this is the most revealing one, probably, as it shows of the five plugins, the only two that are optimizing happen to be the ones that work
The other three plugins all add a visualization type to be used in visualizations/dashboards. However, in the "new visualization" UI their icons don't show up at all.
I'm not really a Kibana plugin developer, I know just enough to poke and prod at it to get it up and running. But I'm at a bit of a loss here and am looking for some directions or help to know how I can debug why these plugins aren't showing up.
Thanks!