My conf file:
input {
jdbc {
type => "ECSC-1-1"
jdbc_connection_string => "jdbc:postgresql://db-postgresql-lon1-68952-do-user-1949559-0.db.ondigitalocean.com/emis"
jdbc_user => "doadmin"
jdbc_password => "z04t1h3hr5ggy1xh"
jdbc_page_size => '50000'
jdbc_driver_library => "/Users/jonathanbowker/servers/ELK7/logstash-7.1.0/conf.d/postgresql.jar"
jdbc_driver_class => "org.postgresql.Driver"
statement_filepath => "/Users/jonathanbowker/servers/ELK7/logstash-7.1.0/conf.d/email.sql"
last_run_metadata_path => "/etc/logstash/last_run/ecsc-1-1"
schedule => "*/10 * * * *"
tracking_column => "di.document_index_key"
tracking_column_type => "numeric"
use_column_value => true
}
}
filter {
}
output {
elasticsearch {
hosts => ["http://localhost:9200/"]
index => "ecsc-main-controls-%{+YYYY.MM.dd}"
template_overwrite => "true"
manage_template => "false"
}
stdout { codec => json }
}
I am running JDBC Driver postgresql-9.4-1203-jdbc42.jar with Logstash 7.10.0 and Java 1.8.0_131 and Ruby 2.3.7p456 (2018-03-28 revision 63024)
This is the response I receive:
Sending Logstash logs to /Users/test/servers/ELK7/logstash-7.1.0/logs which is now configured via log4j2.properties
[2019-07-20T08:50:54,282][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2019-07-20T08:50:54,303][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.1.0"}
[2019-07-20T08:51:02,385][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>, :added=>[http://localhost:9200/]}}
[2019-07-20T08:51:02,669][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://localhost:9200/"}
[2019-07-20T08:51:02,762][INFO ][logstash.outputs.elasticsearch] ES Output version determined {:es_version=>7}
[2019-07-20T08:51:02,771][WARN ][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the type event field won't be used to determine the document _type {:es_version=>7}
[2019-07-20T08:51:02,843][INFO ][logstash.outputs.elasticsearch] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["http://localhost:9200/"]}
[2019-07-20T08:51:02,881][INFO ][logstash.javapipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>4, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>500, :thread=>"#<Thread:0x50cc4629 run>"}
[2019-07-20T08:51:03,201][INFO ][logstash.javapipeline ] Pipeline started {"pipeline.id"=>"main"}
[2019-07-20T08:51:03,298][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>}
[2019-07-20T08:51:03,978][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
/Users/test/servers/ELK7/logstash-7.1.0/vendor/bundle/jruby/2.5.0/gems/rufus-scheduler-3.0.9/lib/rufus/scheduler/cronline.rb:77: warning: constant ::Fixnum is deprecated
The process stops here ... can anybody help please?