# Mongodb/logstash connect error **URL:** \ **Category:** Logstash\ **Created:** [March 29, 2023, 9:35am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799 "2023-03-29T09:35:42Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [March 29, 2023, 9:35am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/1 "2023-03-29T09:35:42Z")
This is an error message when running logstash. error message: Using bundled JDK: /home/admin/lg-862/jdk Sending Logstash logs to /home/admin/lg-862/logs which is now configured via log4j2.properties [2023-03-29T18:22:25,781][INFO][logstash.runner] Log4j configuration path used is: /home/admin/lg-862/config/log4j2.properties [2023-03-29T18:22:25,789][WARN][logstash.runner] The use of JAVA\_HOME has been deprecated. Logstash 8.0 and later ignores JAVA\_HOME and uses the bundled JDK. Running Logstash with the bundled JDK is recommended. The bundled JDK has been verified to work with each specific version of Logstash, and generally provides best performance and reliability. If you have compelling reasons for using your own JDK (organizational-specific compliance requirements, for example), you can configure LS\_JAVA\_HOME to use that version instead. [2023-03-29T18:22:25,790][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"8.6.2", "jruby.version"=\>"jruby 9.3.10.0 (2.6.8) 2023-02-01 107b2e6697 OpenJDK 64-Bit Server VM 17.0.6+10 on 17.0.6+10 +indy +jit [x86\_64-linux]"} [2023-03-29T18:22:25,792][INFO][logstash.runner] JVM bootstrap flags: [-Xms1g, -Xmx1g, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djruby.compile.invokedynamic=true, -XX:+HeapDumpOnOutOfMemoryError, -Djava.security.egd=file:/dev/urandom, -Dlog4j2.isThreadContextMapInheritable=true, -Djruby.regexp.interruptible=true, -Djdk.io.File.enableADS=true, --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED, --add-opens=java.base/java.security=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.nio.channels=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.management/sun.management=ALL-UNNAMED] [2023-03-29T18:22:25,921][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified [2023-03-29T18:22:26,367][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600, :ssl\_enabled=\>false} [2023-03-29T18:22:26,522][INFO][org.reflections.Reflections] Reflections took 90 ms to scan 1 urls, producing 127 keys and 444 values [2023-03-29T18:22:26,976][INFO][logstash.javapipeline] Pipeline `main` is configured with `pipeline.ecs_compatibility: v8` setting. All plugins in this pipeline will default to `ecs_compatibility => v8` unless explicitly configured otherwise. [2023-03-29T18:22:26,996][INFO][logstash.javapipeline][main] Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>4, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50, "pipeline.max\_inflight"=\>500, "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} [2023-03-29T18:22:27,479][INFO][logstash.javapipeline][main] Pipeline Java execution initialization time {"seconds"=\>0.48} [2023-03-29T18:22:27,587][ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\, :backtrace=\>["/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/inputs/jdbc.rb:272:in `register'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-mixin-ecs_compatibility_support-1.3.0-java/lib/logstash/plugin_mixins/ecs_compatibility_support/target_check.rb:48:in `register'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:234:in `block in register_plugins'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:233:in `register_plugins'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:392:in `start\_inputs'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:317:in `start_workers'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:191:in `run'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:143:in `block in start'"], "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} [2023-03-29T18:22:27,588][INFO][logstash.javapipeline][main] Pipeline terminated {"pipeline.id"=\>"main"} [2023-03-29T18:22:27,590][ERROR][logstash.agent] Failed to execute action {:id=\>:main, :action\_type=\>LogStash::ConvergeResult::FailedAction, :message=\>"Could not execute action: PipelineAction::Create, action\_result: false", :backtrace=\>nil} [2023-03-29T18:22:27,599][INFO][logstash.runner] Logstash shut down. [2023-03-29T18:22:27,603][FATAL][org.logstash.Logstash] Logstash stopped processing because of an error: (SystemExit) exit org.jruby.exceptions.SystemExit: (SystemExit) exit at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:790) ~[jruby.jar:?] at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:753) ~[jruby.jar:?] at home.admin.lg\_minus\_862.lib.bootstrap.environment.(/home/admin/lg-862/lib/bootstrap/environment.rb:91) ~[?:?] This is the conf file I ran. input{ jdbc { jdbc\_connection\_string =\> "jdbc:mongodb://XX.XX.XX.XX:27017/mytestdb" jdbc\_user =\> "admin" jdbc\_driver\_library =\> "/home/admin/lg-862/logstash-core/lib/jars/mongo-java-driver-3.9.1-javadoc.jar" jdbc\_driver\_class =\> "com.mongodb.MongoClient" } } output{ stdout{ } } Is it possible to do logstash connection with mongoDB? ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [March 29, 2023, 10:04am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/2 "2023-03-29T10:04:49Z")
> [@jskang](#): > > Pipeline error {:pipeline\_id=\>"main", :exception=\>#\ **Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [March 29, 2023, 10:29am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/3 "2023-03-29T10:29:00Z") Thank you for answer. I wrote a sample sql and the error message changed. [ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\. Are you sure you've included the correct jdbc driver in :jdbc\_driver\_library?\>, :backtrace=\>["/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin\_mixins/jdbc/common.rb:45:in `load_driver'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/inputs/jdbc.rb:307:in `register'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-mixin-ecs\_compatibility\_support-1.3.0-java/lib/logstash/plugin\_mixins/ecs\_compatibility\_support/target\_check.rb:48:in `register'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:234:in `block in register\_plugins'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:233:in `register\_plugins'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:392:in `start_inputs'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:317:in `start\_workers'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:191:in `run'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:143:in `block in start'"], "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} It seems to be a library issue this time... Do you have logstash-input-mongodb before that? I saw the article you talked about on Slack before and I left a comment there, but it is not easy to connect logstash and mongodb. ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [March 29, 2023, 11:49am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/4 "2023-03-29T11:49:08Z")
So that error is talking about the JDBC driver, so I would recommend double checking you have the correct driver, version and path in the config. If it's [this thread](https://elasticstack.slack.com/archives/CND4DUJ10/p1675677874284319) you're referring to, there are several options listed for interacting with Elasticsearch aside from Logstash. Can you explain what you're trying to do and perhaps we can propose an alternative? ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [March 31, 2023, 2:09am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/5 "2023-03-31T02:09:23Z")
I want to connect MongoDB and Logstash to send data to Elasticsearch. I want to use the ELK method, so I want Logstash and MongoDB to be connected. It looks like you are not getting the right drivers. Is it possible to get the mongodb jdbc driver? conf file, but it doesn't seem to work. I also tried using monstache among other methods, but the installation did not go smoothly. ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [March 31, 2023, 12:51pm UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/6 "2023-03-31T12:51:33Z")
Ok, have you double checked the driver to make sure you are using a version compatible with the version of MongoDB that you are trying to extract from? I do have another option if you are on a later version of Elastic. If you're 8.5.0 or later there is a new [MongoDB connector](https://www.elastic.co/guide/en/enterprise-search/8.5/connectors-mongodb.html), albeit in technical preview, that can also be used to extract form MongoDB into Elasticsearch. ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 3, 2023, 5:57am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/7 "2023-04-03T05:57:21Z")
Thank you for answer. All are using 8.6.2. I'm going to store log data in mongodb, can kibana handle its capacity? I downloaded the driver again to try it with logstash. I am getting this error. can you solve it? conf file: input{ jdbc{ jdbc\_driver\_library =\> "/home/admin/lg-862/lgstash-core/lib/jars/mongojdbc4.8.jar" jdbc\_driver\_class =\> "Java::com.wisecoders.dbschema.mongodb.JdbcDriver" jdbc\_connection\_string =\> "mongodb://XXXXXX:XXXXXX@XXX.XXX.XX.XX:27017/mytestdb" jdbc\_user =\> "XXXXXXX" jdbc\_password =\> "XXXXX" statement =\> "db.getCollection('testcoll').find({})" } } output{ stdout{ } } error: ./bin/logstash -f workshop.conf Using bundled JDK: /home/admin/lg-862/jdk jruby: warning: unknown property jruby.version Sending Logstash logs to /home/admin/lg-862/logs which is now configured via log4j2.properties [2023-04-03T14:41:22,746][INFO][logstash.runner] Log4j configuration path used is: /home/admin/lg-862/config/log4j2.properties [2023-04-03T14:41:22,752][WARN][logstash.runner] The use of JAVA\_HOME has been deprecated. Logstash 8.0 and later ignores JAVA\_HOME and uses the bundled JDK. Running Logstash with the bundled JDK is recommended. The bundled JDK has been verified to work with each specific version of Logstash, and generally provides best performance and reliability. If you have compelling reasons for using your own JDK (organizational-specific compliance requirements, for example), you can configure LS\_JAVA\_HOME to use that version instead. [2023-04-03T14:41:22,752][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"8.6.2", "jruby.version"=\>"jruby 9.3.10.0 (2.6.8) 2023-02-01 107b2e6697 OpenJDK 64-Bit Server VM 17.0.6+10 on 17.0.6+10 +jit [x86\_64-linux]"} [2023-04-03T14:41:22,754][INFO][logstash.runner] JVM bootstrap flags: [-Djruby.version=9.2.13.0, -Djruby.regexp.interruptible=true, -Djdk.io.File.enableADS=true, --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED, --add-opens=java.base/java.security=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.nio.channels=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.management/sun.management=ALL-UNNAMED] [2023-04-03T14:41:22,887][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified [2023-04-03T14:41:23,254][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600, :ssl\_enabled=\>false} [2023-04-03T14:41:23,485][INFO][org.reflections.Reflections] Reflections took 102 ms to scan 1 urls, producing 127 keys and 444 values [2023-04-03T14:41:23,888][INFO][logstash.javapipeline] Pipeline `main` is configured with `pipeline.ecs_compatibility: v8` setting. All plugins in this pipeline will default to `ecs_compatibility => v8` unless explicitly configured otherwise. [2023-04-03T14:41:23,907][INFO][logstash.javapipeline][main] Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>4, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50, "pipeline.max\_inflight"=\>500, "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} [2023-04-03T14:41:24,409][INFO][logstash.javapipeline][main] Pipeline Java execution initialization time {"seconds"=\>0.5} [2023-04-03T14:41:24,633][ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\, :backtrace=\>["/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin\_mixins/jdbc/common.rb:59:in `block in load_driver_jars'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin\_mixins/jdbc/common.rb:54:in `load_driver_jars'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin_mixins/jdbc/common.rb:34:in `load\_driver'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/inputs/jdbc.rb:307:in `register'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-mixin-ecs_compatibility_support-1.3.0-java/lib/logstash/plugin_mixins/ecs_compatibility_support/target_check.rb:48:in `register'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:234:in `block in register_plugins'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:233:in `register_plugins'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:392:in `start\_inputs'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:317:in `start_workers'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:191:in `run'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:143:in `block in start'"], "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} [2023-04-03T14:41:24,634][INFO][logstash.javapipeline][main] Pipeline terminated {"pipeline.id"=\>"main"} [2023-04-03T14:41:24,641][ERROR][logstash.agent] Failed to execute action {:id=\>:main, :action\_type=\>LogStash::ConvergeResult::FailedAction, :message=\>"Could not execute action: PipelineAction::Create, action\_result: false", :backtrace=\>nil} [2023-04-03T14:41:24,650][INFO][logstash.runner] Logstash shut down. [2023-04-03T14:41:24,654][FATAL][org.logstash.Logstash] Logstash stopped processing because of an error: (SystemExit) exit org.jruby.exceptions.SystemExit: (SystemExit) exit at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:790) ~[jruby.jar:?] at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:753) ~[jruby.jar:?] at home.admin.lg\_minus\_862.lib.bootstrap.environment.(/home/admin/lg-862/lib/bootstrap/environment.rb:91) ~[?:?] ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 3, 2023, 7:14am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/8 "2023-04-03T07:14:18Z")
I am not using elastic cloud. ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [April 3, 2023, 8:25am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/9 "2023-04-03T08:25:34Z")
> [@jskang](#): > > [2023-04-03T14:41:24,633][ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\, Looks like the process doesn't have sufficient entitlements to access the driver. Can you check the permissions? ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 3, 2023, 8:52am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/10 "2023-04-03T08:52:57Z")
conf file: input{ jdbc{ jdbc\_driver\_class =\> "Java::com.wisecoders.dbschema.mongodb.JdbcDriver" jdbc\_driver\_library =\> "/usr/share/logstash/logstash-core/lib/jars/mongojdbc4.8.jar" jdbc\_connection\_string =\> "mongodb://XXX:XXX@XX.XX.XX.XX:27017/mytestdb" jdbc\_user =\> "XX" jdbc\_password =\> "XX" statement =\> "db.getCollection('testcoll').find({})" } } output{ stdout{ } } error : [2023-04-03T17:52:15,435][INFO][logstash.javapipeline][main] Pipeline Java execution initialization time {"seconds"=\>0.48} [2023-04-03T17:52:15,574][ERROR][logstash.inputs.jdbc][main] Unable to connect to database. Tried 1 times {:message=\>"LoadError: no such file to load -- sequel/adapters/mongodb", :exception=\>Sequel::AdapterNotFound, :cause=\>#\, :backtrace=\>["org/jruby/RubyKernel.java:1017:in `require'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/database/connecting.rb:87:in `load\_adapter'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/database/connecting.rb:17:in `adapter_class'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/database/connecting.rb:36:in `connect'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/core.rb:124:in `connect'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin_mixins/jdbc/jdbc.rb:118:in `block in jdbc\_connect'", "org/jruby/RubyKernel.java:1507:in `loop'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin_mixins/jdbc/jdbc.rb:115:in `jdbc\_connect'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin\_mixins/jdbc/jdbc.rb:158:in `open_jdbc_connection'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/inputs/jdbc.rb:309:in `register'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-mixin-ecs\_compatibility\_support-1.3.0-java/lib/logstash/plugin\_mixins/ecs\_compatibility\_support/target\_check.rb:48:in `register'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:234:in `block in register\_plugins'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:233:in `register\_plugins'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:392:in `start_inputs'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:317:in `start\_workers'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:191:in `run'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:143:in `block in start'"]} [2023-04-03T17:52:15,649][ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\, :backtrace=\>["org/jruby/RubyKernel.java:1017:in `require'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/database/connecting.rb:87:in `load\_adapter'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/database/connecting.rb:17:in `adapter_class'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/database/connecting.rb:36:in `connect'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/sequel-5.62.0/lib/sequel/core.rb:124:in `connect'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin_mixins/jdbc/jdbc.rb:118:in `block in jdbc\_connect'", "org/jruby/RubyKernel.java:1507:in `loop'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin_mixins/jdbc/jdbc.rb:115:in `jdbc\_connect'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin\_mixins/jdbc/jdbc.rb:158:in `open_jdbc_connection'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/inputs/jdbc.rb:309:in `register'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-mixin-ecs\_compatibility\_support-1.3.0-java/lib/logstash/plugin\_mixins/ecs\_compatibility\_support/target\_check.rb:48:in `register'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:234:in `block in register\_plugins'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:233:in `register\_plugins'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:392:in `start_inputs'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:317:in `start\_workers'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:191:in `run'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:143:in `block in start'"], "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} [2023-04-03T17:52:15,649][INFO][logstash.javapipeline][main] Pipeline terminated {"pipeline.id"=\>"main"} [2023-04-03T17:52:15,652][ERROR][logstash.agent] Failed to execute action {:id=\>:main, :action\_type=\>LogStash::ConvergeResult::FailedAction, :message=\>"Could not execute action: PipelineAction::Create, action\_result: false", :backtrace=\>nil} [2023-04-03T17:52:15,661][INFO][logstash.runner] Logstash shut down. [2023-04-03T17:52:15,664][FATAL][org.logstash.Logstash] Logstash stopped processing because of an error: (SystemExit) exit org.jruby.exceptions.SystemExit: (SystemExit) exit at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:790) ~[jruby.jar:?] at org.jruby.RubyKernel.exit(org/jruby/RubyKernel.java:753) ~[jruby.jar:?] at home.admin.lg\_minus\_862.lib.bootstrap.environment.(/home/admin/lg-862/lib/bootstrap/environment.rb:91) ~[?:?] admin@qa-optool01-svr:~/lg-862$ When I changed it after reading the article to remove jdbc\_driver\_library or specify it as the path written above, another error message appeared... help.. ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 3, 2023, 8:55am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/11 "2023-04-03T08:55:15Z")
LoadError: no such file to load -- sequel/adapters/mongodb This problem is too hard for me.. ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 3, 2023, 9:13am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/12 "2023-04-03T09:13:49Z")
It seems to be a version issue. ELK is all using version 8.6.2, but mongoDB Driver is version 4.8. ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [April 3, 2023, 12:41pm UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/13 "2023-04-03T12:41:19Z")
Can you share where you got the driver from? I've found this [older thread](https://discuss.elastic.co/t/mongodb-jdbc-using-in-logstash/291311) talking about driver compatibility, so I wonder if you are using the correct driver. ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 3, 2023, 12:58pm UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/14 "2023-04-03T12:58:43Z")
1.curl -O [https://dbschema.com/jdbc-drivers/MongoDbJdbcDriver.zip](https://dbschema.com/jdbc-drivers/MongoDbJdbcDriver.zip) 2.unzip MongoDbJdbcDriver.zip I have downloaded and used this. confile: input{ jdbc{ jdbc\_driver\_class =\> "com.mongodb.jdbc.MongoDriver" jdbc\_driver\_library =\> "/usr/share/logstash/logstash-core/lib/jars/mongodb-driver-core-4.8.1.jar" jdbc\_connection\_string =\> "jdbc:mongodb://XXX:XXX@XXX.XXX.xXX.XXX:27017/mytestdb" jdbc\_user =\> "XXXXXXX" jdbc\_password =\> "XXXXXX" statement =\> "db.getCollection('testcoll').find({})" } } output{ stdout{ } } Currently I am writing like this [ERROR][logstash.javapipeline][main] Pipeline error {:pipeline\_id=\>"main", :exception=\>#\. Are you sure you've included the correct jdbc driver in :jdbc\_driver\_library?\>, :backtrace=\>["/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/plugin\_mixins/jdbc/common.rb:45:in `load_driver'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-integration-jdbc-5.4.1/lib/logstash/inputs/jdbc.rb:307:in `register'", "/home/admin/lg-862/vendor/bundle/jruby/2.6.0/gems/logstash-mixin-ecs\_compatibility\_support-1.3.0-java/lib/logstash/plugin\_mixins/ecs\_compatibility\_support/target\_check.rb:48:in `register'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:234:in `block in register\_plugins'", "org/jruby/RubyArray.java:1865:in `each'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:233:in `register\_plugins'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:392:in `start_inputs'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:317:in `start\_workers'", "/home/admin/lg-862/logstash-core/lib/logstash/java\_pipeline.rb:191:in `run'", "/home/admin/lg-862/logstash-core/lib/logstash/java_pipeline.rb:143:in `block in start'"], "pipeline.sources"=\>["/home/admin/lg-862/workshop.conf"], :thread=\>"#\"} [2023-04-03T21:25:28,124][INFO][logstash.javapipeline][main] Pipeline terminated {"pipeline.id"=\>"main"} [2023-04-03T21:25:28,132][ERROR][logstash.agent] Failed to execute action {:id=\>:main, :action\_type=\>LogStash::ConvergeResult::FailedAction, :message=\>"Could not execute action: PipelineAction::Create, action\_result: false", :backtrace=\>nil} I am in this error state. ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [April 3, 2023, 1:35pm UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/15 "2023-04-03T13:35:55Z")
> [@jskang](#): > > jdbc\_driver\_library =\> "/usr/share/logstash/logstash-core/lib/jars/mongodb-driver-core-4.8.1.jar" I've downloaded a copy of the driver zip you are currently using. Should the `jdbc_driver_library` property not point to jar `mongojdbc4.8.jar` rather than `mongodb-driver-core-4.8.1.jar`? Looking at this [related thread](https://discuss.elastic.co/t/how-to-read-mongodb-logs-from-logstash-jdbc-plugin/312301) I suspect that might be the problem. ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 4, 2023, 2:44am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/16 "2023-04-04T02:44:47Z")
Thank you for answer. I paid attention to that part and corrected it, and then I encountered another error. I wonder if I'm still writing the conf file incorrectly... I'm having a hard time figuring out what the problem is. ```auto com.mongodb.MongoSocketOpenException: Exception opening socket at com.mongodb.internal.connection.SocketStream.open(SocketStream.java:73) ~[mongodb-driver-core-4.8.1.jar:?] at com.mongodb.internal.connection.InternalStreamConnection.open(InternalStreamConnection.java:183) ~[mongodb-driver-core-4.8.1.jar:?] at com.mongodb.internal.connection.DefaultServerMonitor$ServerMonitorRunnable.lookupServerDescription(DefaultServerMonitor.java:198) [mongodb-driver-core-4.8.1.jar:?] at com.mongodb.internal.connection.DefaultServerMonitor$ServerMonitorRunnable.run(DefaultServerMonitor.java:158) [mongodb-driver-core-4.8.1.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.pollConnect(Native Method) ~[?:?] at sun.nio.ch.Net.pollConnectNow(Net.java:672) ~[?:?] at sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:542) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at com.mongodb.internal.connection.SocketStreamHelper.initialize(SocketStreamHelper.java:107) ~[mongodb-driver-core-4.8.1.jar:?] at com.mongodb.internal.connection.SocketStream.initializeSocket(SocketStream.java:82) ~[mongodb-driver-core-4.8.1.jar:?] at com.mongodb.internal.connection.SocketStream.open(SocketStream.java:68) ~[mongodb-driver-core-4.8.1.jar:?] ... 4 more ``` ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [April 4, 2023, 9:16am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/17 "2023-04-04T09:16:33Z")
> [@jskang](#): > > ```auto > com.mongodb.MongoSocketOpenException: Exception opening socket > at com.mongodb.internal.connection.SocketStream.open(SocketStream.java:73) ~[mongodb-driver-core-4.8.1.jar:?] > at com.mongodb.internal.connection.InternalStreamConnection.open(InternalStreamConnection.java:183) ~[mongodb-driver-core-4.8.1.jar:?] > at com.mongodb.internal.connection.DefaultServerMonitor$ServerMonitorRunnable.lookupServerDescription(DefaultServerMonitor.java:198) [mongodb-driver-core-4.8.1.jar:?] > at com.mongodb.internal.connection.DefaultServerMonitor$ServerMonitorRunnable.run(DefaultServerMonitor.java:158) [mongodb-driver-core-4.8.1.jar:?] > at java.lang.Thread.run(Thread.java:833) [?:?] > Caused by: java.net.ConnectException: Connection refused > > ``` This looks like Logstash is struggling to connect to your MongoDB instance. Can you check your connection URL, username and password? ---
**Author:** ![jskang](https://avatars.discourse-cdn.com/v4/letter/j/c2a13f/32.png) [@jskang](https://discuss.elastic.co/u/jskang)\ **Post date:** [April 4, 2023, 9:25am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/18 "2023-04-04T09:25:24Z")
you're right. I did have a connection. Do you know what to do if you want to move only new data to Elasticsearch when data piles up in mongodb? Now, the existing data is sent and it is terminated. Or Pipeline terminated {"pipeline.id"=\>"main"} I leave this message and stay still, but there is no reaction when new data is added. ---
**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\ **Post date:** [April 4, 2023, 9:57am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/19 "2023-04-04T09:57:48Z")
If you don't specify a value for `schedule` the pipeline will be executed once. Take a look at the below resources in the documentation: 1. [JDBC Input Plugin- Scheduling](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#_scheduling_2) 2. [`schedule`](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-jdbc.html#plugins-inputs-jdbc-schedule) parameter ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [May 2, 2023, 9:58am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799/20 "2023-05-02T09:58:17Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.