Logstash with Google Pub/Sub

Elastic Stack Logstash
1

Hi All

I'm want to use logstash-input-google-cloud-pubsub as input for logstash 2.2.2.
All my tries to run it have failed so far.

Installing out of the box gives me an dependency error

gcloud 0.6.1 requires Ruby 2.0

Installing in jruby compatability mode "JRUBY_OPTS=--2.0" was success but failed at startup:

./bin/logstash -f /home/me/dev/proj/deployment/logstash/pipeline.conf
SyntaxError: /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.6.1/lib/gcloud.rb:113: syntax error, unexpected tLABEL
  def datastore scope: nil
                      ^
     require at org/jruby/RubyKernel.java:1040
     require at /opt/logstash/vendor/bundle/jruby/1.9/gems/polyglot-0.3.5/lib/polyglot.rb:65
      (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-google-cloud-pubsub-2.0.2/lib/logstash/inputs/google_cloud_pubsub.rb:1
     require at org/jruby/RubyKernel.java:1040
     require at /opt/logstash/vendor/bundle/jruby/1.9/gems/polyglot-0.3.5/lib/polyglot.rb:65
      (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-google-cloud-pubsub-2.0.2/lib/logstash/inputs/google_cloud_pubsub.rb:2
      (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.2.2-java/lib/logstash/plugin.rb:1
      lookup at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.2.2-java/lib/logstash/plugin.rb:80
        eval at org/jruby/RubyKernel.java:1079
      plugin at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.2.2-java/lib/logstash/pipeline.rb:400
  initialize at (eval):7
  initialize at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.2.2-java/lib/logstash/pipeline.rb:57
        call at org/jruby/RubyProc.java:281
     execute at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.2.2-java/lib/logstash/agent.rb:172
        call at org/jruby/RubyProc.java:281
         run at /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.2.2-java/lib/logstash/runner.rb:90

Installing version pinned to gcloud 0.5 succeeded. However trying to run it failed with the following:

./bin/logstash -f /home/me/dev/proj/deployment/logstash/pipeline.conf
google_cloud_pubsub plugin doesn't have a version. This plugin isn't well
 supported by the community and likely has no maintainer. {:level=>:warn}
elasticsearch: unknown error {:class=>"Manticore::ResolutionFailure", :level=>:error}
elasticsearch {:class=>"Manticore::ResolutionFailure", :level=>:error}
elasticsearch {:class=>"Manticore::ResolutionFailure", :level=>:error}
elasticsearch {:class=>"Manticore::ResolutionFailure", :level=>:error}
Settings: Default pipeline workers: 4
SyntaxError: /opt/logstash/vendor/bundle/jruby/1.9/gems/jwt-1.5.3/lib/jwt/verify.rb:7: unknown type of %string
      %i[verify_aud verify_expiration verify_iat verify_iss verify_jti verify_not_before verify_sub].each do |method_name|
        ^
  require at org/jruby/RubyKernel.java:1040
  require at /opt/logstash/vendor/bundle/jruby/1.9/gems/polyglot-0.3.5/lib/polyglot.rb:65
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/jwt-1.5.3/lib/jwt/decode.rb:1
  require at org/jruby/RubyKernel.java:1040
  ...
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud/pubsub/connection.rb:17
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud/pubsub/project.rb:1
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud/pubsub/project.rb:17
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud/pubsub.rb:1
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud/pubsub.rb:17
     call at org/jruby/RubyProc.java:281
   (root) at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud.rb:1
     call at org/jruby/RubyProc.java:281
   pubsub at /opt/logstash/vendor/bundle/jruby/1.9/gems/gcloud-0.5.0/lib/gcloud.rb:206

Does Somebody already use it?
Can you please share your experience of how do you run it exactly?

Thanks a lot,
Ilya

2

The issue was resolved.

thanks.