Canvas build for Kibana 6.4.3?


#1

Hi, I'm updating Kibana due to the security advisory posted yesterday.

After updating Canvas disappeared (maybe there can somehow be better feedback for when this will happen), and after removing / attempting to install the plugin I get the following:

NODE_OPTIONS="--max-old-space-size=4096" ./bin/kibana-plugin install https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2200.zip
Plugin installation was unsuccessful due to error "Incorrect Kibana version in plugin [canvas]. Expected [6.4.3]; found [6.4.2]"

(CJ Cenizal) #2

Thanks for the ping! Looks like we need to release Canvas for 6.4.3. We'll get this done ASAP and I'll give you the new link once it's up.


(CJ Cenizal) #3

OK here you go!

https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2201.zip

(John) #4

https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2201.zip not this one?

as your link gives:

sudo -u kibana NODE_OPTIONS="--max-old-space-size=4096" ./bin/kibana-plugin install https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2225.zip
Attempting to transfer from https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2225.zip
Attempting to transfer from https://artifacts.elastic.co/downloads/kibana-plugins/https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2225.zip/https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2225.zip-6.4.3.zip
Plugin installation was unsuccessful due to error "No valid url specified."


(Joe Fleming) #5

Yeah, sorry about that. 2225 ended up being a broken build, so we removed it and cut 2201.

https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2201.zip is what you want, that was built for 6.4.3.


(John) #6

BUT hangs around here Optimizing and caching browser bundles...

{"type":"log","@timestamp":"2018-11-08T22:12:39Z","tags":["info","optimize"],"pid":3085,"message":"Optimizing and caching bundles for ml, stateSessionStorageRedirect, status_page, timelion, graph, monitoring, login, logout, dashboardViewer, apm, canvas and kibana. This may take a few minutes"}
{"type":"log","@timestamp":"2018-11-08T22:16:04Z","tags":["info","optimize"],"pid":3085,"message":"Optimization of bundles for ml, stateSessionStorageRedirect, status_page, timelion, graph, monitoring, login, logout, dashboardViewer, apm, canvas and kibana complete in 205.80 seconds"}
{"type":"log","@timestamp":"2018-11-08T22:16:04Z","tags":["info"],"pid":3085,"message":"Plugin initialization disabled."}


(CJ Cenizal) #7

I've edited my original comment to reflect the correct URL. Sorry about the confusion!


(John) #8

Thanks all.

maybe this Optimizing and caching browser bundles... could take a long time?

Just seems a bit quiet on the container now. :slight_smile:

root 3072 2974 0 23:12 pts/4 00:00:00 sudo -u kibana NODE_OPTIONS=--max-old-space-size=4096 ./bin/kibana-plugin install https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2201.zip
kibana 3073 3072 0 23:12 pts/4 00:00:12 ./bin/../node/bin/node --max-old-space-size=4096 --no-warnings ./bin/../src/cli_plugin install https://download.elastic.co/kibana/canvas/kibana-canvas-0.1.2201.zip
kibana 3085 3073 0 23:12 pts/4 00:03:03 /usr/share/kibana/node/bin/node /usr/share/kibana/src/cli --env.name=production --optimize.useBundleCache=false --server.autoListen=false --plugins.initialize=false --uiSettings.enabled=fals

I'll leave it for now.... Check tomorrow!


(Joe Fleming) #9

maybe this Optimizing and caching browser bundles... could take a long time?

Yes, yes it does. It also takes a lot of resources. You probably won't have luck running it on a system with less than 4GB of ram.

That said, since you're building containers, once you install the plugin and run it once, you don't need to run it again. Though, do be careful if you change the kibana.yml file (via a volume for example), since enabling/disabling plugins and some of the other setting cause a re-optimize. That will fail on resource constrained machines/environments, and will happen every time you start that container.

If you want to customize things in the kibana.yml, your best bet is doing that first, then installing plugins and letting the optimize step finish. Once it does, you've got a Kibana container that works how you want and doesn't have that 4GB ram requirement.


Here's an example multi-stage Dockerfile I recently put together that you may find helpful.

FROM ubuntu:18.04 as builder
  
# update apt, install dependencies
RUN apt-get -y update \
  && apt-get -y install wget

# fetch and unpack kibana, move path to "kibana"
WORKDIR /build
ARG KIBANA_VERSION=6.4.3
RUN wget -q "https://artifacts.elastic.co/downloads/kibana/kibana-${KIBANA_VERSION}-linux-x86_64.tar.gz" \
  && tar zxf "kibana-${KIBANA_VERSION}-linux-x86_64.tar.gz" && mv kibana-${KIBANA_VERSION}-linux-x86_64 kibana

# copy kibana.yml file
WORKDIR /build/kibana
COPY ./kibana.yml ./config/kibana.yml

# install canvas plugin
ARG CANVAS_VERSION=0.1.2201
RUN NODE_OPTIONS="--max-old-space-size=4096" ./bin/kibana-plugin install "https://download.elastic.co/kibana/canvas/kibana-canvas-${CANVAS_VERSION}.zip"

# create new container for smaller image
FROM ubuntu:18.04
WORKDIR /app
COPY --from=builder /build/kibana .

# run kibana
EXPOSE 5601
VOLUME /app/config
ENTRYPOINT ["bin/kibana"]

Just create a kibana.yml file next to the Dockerfile and build. You can docker cp that from docker.elastic.co/kibana/kibana:6.4.3, or just grab it from the repo.

You might be able to get away with an Alpine build or some other smaller image for the second stage, I haven't tried, Ubuntu was small enough for me.


(John) #10

Thanks Joe,

Great seeing how you would build this with docker.

For me, I'm using a LXC, I up'd the memory and let it optimize last night and left it. Looks like it took hours!

Did a restart this morning, and we're cooking.
:smile:


(Joe Fleming) #11

Looks like it took hours!

Ouch! I takes 5-10 minutes for me on an older macbook pro, sounds like you've got yourself a pretty resource constrained system. Glad it worked out though, and that the Dockerfile was helpful.


(system) #12

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.