Unable to perform offline upgrade of logstash plugins

Elastic Stack Logstash
1

I need to upgrade the logstash-input-s3 and logstash-output-s3 plugins on an environment disconnected from the internet. The offline server is running logstash v5.2.2.

Per the instructions here I installed logstash v5.2.2 on a machine with an internet connection, upgraded the two plugins, and ran the suggested command:

/usr/share/logstash/bin/logstash-plugin prepare-offline-pack logstash-input-s3 logstash-output-s3 --overwrite

This successfully produced a ZIP file which I uploaded to the offline machine. I then ran the next command suggested in the documentation:

/usr/share/logstash/bin/logstash-plugin install file:///tmp/logstash-offline-plugins-5.2.2.zip

This produces an error:

ERROR: An error occured when installing the: file:///tmp/logstash-offline-plugins-5.2.2.zip, to have more information about the error add a DEBUG=1 before running the command., message: You have requested:
  stud = 0.0.23

The bundle currently has stud locked at 0.0.22.
Try running `bundle update stud`

The server does not have Ruby installed and is not connected to the internet. If I look in the ZIP file I can see the correct stud gem is included. I tried the same procedure with v5.6.8 in a dev environment and got similar results, albeit with different gems having trouble. What do I need to resolve this?

2

version is not ok?

3

In this case the dependency called stud is a common dependency to many plugins.

The problem is that you are only updating 2 plugins (S3 input and S3 output) out of the list of plugins that have stud as a dependency, locked at 0.0.22 or 0.0.18.

In LS 5.2.2...
Plugins holding stud at 0.0.22

logstash-input-couchdb_changes
logstash-input-exec
logstash-input-ganglia
logstash-input-gelf
logstash-input-heartbeat
logstash-input-http_poller
logstash-input-imap
logstash-input-irc
logstash-input-pipe
logstash-input-udp
logstash-input-rabbitmq
logstash-output-s3
logstash-output-rabbitmq

Plugins holding stud at 0.0.18

logstash-input-s3

The steps you need is:

  1. Create an offline pack with all the above mentioned plugins in it.
  2. On the offline machine, take a backup of the Logstash folder (where the Gemfile.jruby-1.9.lock file is)
  3. Run the file based install as before.

If it fails report back the error message here.

4

Ran:

bin/logstash-plugin prepare-offline-pack logstash-input-s3 logstash-output-s3 logstash-codec-plain logstash-input-couchdb_changes logstash-input-exec logstash-input-ganglia logstash-input-gelf logstash-input-heartbeat logstash-input-http_poller logstash-input-imap logstash-input-irc logstash-input-pipe logstash-input-udp logstash-input-rabbitmq logstash-output-rabbitmq --overwrite

Note that I did not upgrade the other plugins. Installing on offline machine produced same error as before.

5

OK. One last thing to try.

On the offline LS install, remove all the plugins in the offline pack then try the install as before (this is why the backup) if there is still an error, restore from backup.

The absolute last thing to do is:

  1. Zip up the offline installation
  2. Copy the zip file to an online machine.
  3. Update the s3 input and outputs
  4. Zip it up again, copy the zip file back and unzip over the old one.

The rsync utility might be useful to keep an online and offline installation in sync as well.

6

Thanks for all the help. I'll try this out in a couple hours.

7

Same error after uninstall. Trying the zip method.

8

Archive method seems to work. Thanks.

1 Like
9

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.