I am trying to send data to BigQuery using LogStash.
The BigQuery output plugin is installed, as shown by using bin/logstash-plugin list, but when running a .conf file consisting of:
output {
google_bigquery {
project_id =>
dataset =>
csv_schema =>
json_key_file =>
error_directory =>
service_account =>
}
}
The log file reads:
[2019-08-29T12:57:11,028][ERROR][logstash.plugins.registry] Problems loading a plugin with {:type=>"output", :name=>"google_bigquery", :path=>"logstash/outputs/google_bigquery", :error_message=>"\n\n\tyou might need to reinstall the gem which depends on the missing jar or in case there is Jars.lock then resolve the jars with lock_jars command\n\nno such file to load -- com/google/cloud/google-cloud-bigquery/1.24.1/google-cloud-bigquery-1.24.1 (LoadError)", :error_class=>RuntimeError, :error_backtrace=>["uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/jar_dependencies.rb:356:in do_require'", "uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/jar_dependencies.rb:265:inblock in require_jar'", "uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/jar_dependencies.rb:307:in require_jar_with_block'", "uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/jar_dependencies.rb:264:inrequire_jar'".