Hi ,
I've installed Logstash V7.16.3 on Windows 10, and I am struggling to load log files using the following configuration even after deleting the sinceDB
input {
file {
path => "C:\software\ELK\sample-data\*.txt"
start_position => "beginning"
sincedb_path => "C:\software\ELK\config\sinceDB"
}
}
#input { stdin { } }
output {
stdout {
codec => rubydebug
}
}
no sure if I missed out anything? the debug log was attached here
thanks,
Landong Zuo
[2022-01-25T10:37:23,480][INFO ][logstash.runner ] Log4j configuration path used is: C:\software\ELK\logstash-7.16.3\config\log4j2.properties
[2022-01-25T10:37:23,495][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.16.3", "jruby.version"=>"jruby 9.2.20.1 (2.5.8) 2021-11-30 2a2962fbd1 Java HotSpot(TM) 64-Bit Server VM 25.202-b08 on 1.8.0_202-b08 +indy +jit [mswin32-x86_64]"}
[2022-01-25T10:37:23,503][DEBUG][logstash.modules.scaffold] Found module {:module_name=>"fb_apache", :directory=>"C:/software/ELK/logstash-7.16.3/modules/fb_apache/configuration"}
[2022-01-25T10:37:23,505][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"fb_apache", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x6e73b2b9 @directory="C:/software/ELK/logstash-7.16.3/modules/fb_apache/configuration", @module_name="fb_apache", @kibana_version_parts=["6", "0", "0"]>}
[2022-01-25T10:37:23,507][DEBUG][logstash.modules.scaffold] Found module {:module_name=>"netflow", :directory=>"C:/software/ELK/logstash-7.16.3/modules/netflow/configuration"}
[2022-01-25T10:37:23,512][DEBUG][logstash.plugins.registry] Adding plugin to the registry {:name=>"netflow", :type=>:modules, :class=>#<LogStash::Modules::Scaffold:0x2415be1a @directory="C:/software/ELK/logstash-7.16.3/modules/netflow/configuration", @module_name="netflow", @kibana_version_parts=["6", "0", "0"]>}
[2022-01-25T10:37:23,586][DEBUG][logstash.runner ] -------- Logstash Settings (* means modified) ---------
[2022-01-25T10:37:23,587][DEBUG][logstash.runner ] node.name: "WL-66088659"
[2022-01-25T10:37:23,594][DEBUG][logstash.runner ] *path.config: "C:\\software\\ELK\\logstash-7.16.3\\config\\conf.d\\test.conf"
[2022-01-25T10:37:23,595][DEBUG][logstash.runner ] path.data: "C:/software/ELK/logstash-7.16.3/data"
[2022-01-25T10:37:23,595][DEBUG][logstash.runner ] modules.cli: <Java::OrgLogstashUtil::ModulesSettingArray:1 []>
[2022-01-25T10:37:23,596][DEBUG][logstash.runner ] modules: []
[2022-01-25T10:37:23,597][DEBUG][logstash.runner ] modules_list: []
[2022-01-25T10:37:23,597][DEBUG][logstash.runner ] modules_variable_list: []
[2022-01-25T10:37:23,598][DEBUG][logstash.runner ] modules_setup: false
[2022-01-25T10:37:23,598][DEBUG][logstash.runner ] config.test_and_exit: false
[2022-01-25T10:37:23,599][DEBUG][logstash.runner ] config.reload.automatic: false
[2022-01-25T10:37:23,600][DEBUG][logstash.runner ] config.reload.interval: #<Java::OrgLogstashUtil::TimeValue:0x4455846f>
[2022-01-25T10:37:23,600][DEBUG][logstash.runner ] config.support_escapes: false
[2022-01-25T10:37:23,601][DEBUG][logstash.runner ] config.field_reference.parser: "STRICT"
[2022-01-25T10:37:23,601][DEBUG][logstash.runner ] metric.collect: true
[2022-01-25T10:37:23,602][DEBUG][logstash.runner ] pipeline.id: "main"
[2022-01-25T10:37:23,602][DEBUG][logstash.runner ] pipeline.system: false
[2022-01-25T10:37:23,603][DEBUG][logstash.runner ] pipeline.workers: 8
[2022-01-25T10:37:23,603][DEBUG][logstash.runner ] pipeline.batch.size: 125
[2022-01-25T10:37:23,604][DEBUG][logstash.runner ] pipeline.batch.delay: 50
[2022-01-25T10:37:23,604][DEBUG][logstash.runner ] pipeline.unsafe_shutdown: false
[2022-01-25T10:37:23,605][DEBUG][logstash.runner ] pipeline.java_execution: true
[2022-01-25T10:37:23,606][DEBUG][logstash.runner ] pipeline.reloadable: true
[2022-01-25T10:37:23,607][DEBUG][logstash.runner ] pipeline.plugin_classloaders: false
[2022-01-25T10:37:23,608][DEBUG][logstash.runner ] pipeline.separate_logs: false
[2022-01-25T10:37:23,608][DEBUG][logstash.runner ] pipeline.ordered: "auto"
[2022-01-25T10:37:23,609][DEBUG][logstash.runner ] pipeline.ecs_compatibility: "disabled"
[2022-01-25T10:37:23,610][DEBUG][logstash.runner ] path.plugins: []
[2022-01-25T10:37:23,619][DEBUG][logstash.runner ] config.debug: false
[2022-01-25T10:37:23,619][DEBUG][logstash.runner ] *log.level: "debug" (default: "info")
[2022-01-25T10:37:23,620][DEBUG][logstash.runner ] version: false
[2022-01-25T10:37:23,621][DEBUG][logstash.runner ] help: false
[2022-01-25T10:37:23,621][DEBUG][logstash.runner ] enable-local-plugin-development: false
[2022-01-25T10:37:23,623][DEBUG][logstash.runner ] log.format: "plain"
[2022-01-25T10:37:23,623][DEBUG][logstash.runner ] api.enabled: true
[2022-01-25T10:37:23,624][DEBUG][logstash.runner ] api.http.host: "127.0.0.1"
[2022-01-25T10:37:23,624][DEBUG][logstash.runner ] api.http.port: 9600..9700
[2022-01-25T10:37:23,625][DEBUG][logstash.runner ] api.environment: "production"
[2022-01-25T10:37:23,628][DEBUG][logstash.runner ] api.auth.type: "none"
[2022-01-25T10:37:23,634][DEBUG][logstash.runner ] api.ssl.enabled: false
[2022-01-25T10:37:23,634][DEBUG][logstash.runner ] queue.type: "memory"
[2022-01-25T10:37:23,635][DEBUG][logstash.runner ] queue.drain: false
[2022-01-25T10:37:23,636][DEBUG][logstash.runner ] queue.page_capacity: 67108864
[2022-01-25T10:37:23,636][DEBUG][logstash.runner ] queue.max_bytes: 1073741824
[2022-01-25T10:37:23,637][DEBUG][logstash.runner ] queue.max_events: 0
[2022-01-25T10:37:23,638][DEBUG][logstash.runner ] queue.checkpoint.acks: 1024
[2022-01-25T10:37:23,639][DEBUG][logstash.runner ] queue.checkpoint.writes: 1024
[2022-01-25T10:37:23,640][DEBUG][logstash.runner ] queue.checkpoint.interval: 1000
[2022-01-25T10:37:23,640][DEBUG][logstash.runner ] queue.checkpoint.retry: false
[2022-01-25T10:37:23,643][DEBUG][logstash.runner ] dead_letter_queue.enable: false
[2022-01-25T10:37:23,649][DEBUG][logstash.runner ] dead_letter_queue.max_bytes: 1073741824
[2022-01-25T10:37:23,650][DEBUG][logstash.runner ] dead_letter_queue.flush_interval: 5000
[2022-01-25T10:37:23,650][DEBUG][logstash.runner ] slowlog.threshold.warn: #<Java::OrgLogstashUtil::TimeValue:0x4eb6d757>
[2022-01-25T10:37:23,651][DEBUG][logstash.runner ] slowlog.threshold.info: #<Java::OrgLogstashUtil::TimeValue:0x526b664a>
[2022-01-25T10:37:23,652][DEBUG][logstash.runner ] slowlog.threshold.debug: #<Java::OrgLogstashUtil::TimeValue:0xd72c30d>
[2022-01-25T10:37:23,652][DEBUG][logstash.runner ] slowlog.threshold.trace: #<Java::OrgLogstashUtil::TimeValue:0x1822f415>
[2022-01-25T10:37:23,653][DEBUG][logstash.runner ] keystore.classname: "org.logstash.secret.store.backend.JavaKeyStore"
[2022-01-25T10:37:23,654][DEBUG][logstash.runner ] keystore.file: "C:/software/ELK/logstash-7.16.3/config/logstash.keystore"
[2022-01-25T10:37:23,654][DEBUG][logstash.runner ] path.queue: "C:/software/ELK/logstash-7.16.3/data/queue"
[2022-01-25T10:37:23,656][DEBUG][logstash.runner ] path.dead_letter_queue: "C:/software/ELK/logstash-7.16.3/data/dead_letter_queue"
[2022-01-25T10:37:23,660][DEBUG][logstash.runner ] path.settings: "C:/software/ELK/logstash-7.16.3/config"
[2022-01-25T10:37:23,665][DEBUG][logstash.runner ] path.logs: "C:/software/ELK/logstash-7.16.3/logs"
[2022-01-25T10:37:23,666][DEBUG][logstash.runner ] xpack.monitoring.enabled: false
[2022-01-25T10:37:23,666][DEBUG][logstash.runner ] xpack.monitoring.elasticsearch.hosts: ["http://localhost:9200"]
[2022-01-25T10:37:23,667][DEBUG][logstash.runner ] xpack.monitoring.collection.interval: #<Java::OrgLogstashUtil::TimeValue:0x46dc48bc>
[2022-01-25T10:37:23,668][DEBUG][logstash.runner ] xpack.monitoring.collection.timeout_interval: #<Java::OrgLogstashUtil::TimeValue:0x11019c05>
[2022-01-25T10:37:23,668][DEBUG][logstash.runner ] xpack.monitoring.elasticsearch.username: "logstash_system"
[2022-01-25T10:37:23,669][DEBUG][logstash.runner ] xpack.monitoring.elasticsearch.ssl.verification_mode: "certificate"
[2022-01-25T10:37:23,669][DEBUG][logstash.runner ] xpack.monitoring.elasticsearch.sniffing: false
[2022-01-25T10:37:23,670][DEBUG][logstash.runner ] xpack.monitoring.collection.pipeline.details.enabled: true
[2022-01-25T10:37:23,670][DEBUG][logstash.runner ] xpack.monitoring.collection.config.enabled: true
[2022-01-25T10:37:23,671][DEBUG][logstash.runner ] monitoring.enabled: false
[2022-01-25T10:37:23,672][DEBUG][logstash.runner ] monitoring.elasticsearch.hosts: ["http://localhost:9200"]
[2022-01-25T10:37:23,681][DEBUG][logstash.runner ] monitoring.collection.interval: #<Java::OrgLogstashUtil::TimeValue:0x3d38a0b9>
[2022-01-25T10:37:23,682][DEBUG][logstash.runner ] monitoring.collection.timeout_interval: #<Java::OrgLogstashUtil::TimeValue:0x7aa152c6>
[2022-01-25T10:37:23,682][DEBUG][logstash.runner ] monitoring.elasticsearch.username: "logstash_system"
[2022-01-25T10:37:23,683][DEBUG][logstash.runner ] monitoring.elasticsearch.ssl.verification_mode: "certificate"
[2022-01-25T10:37:23,684][DEBUG][logstash.runner ] monitoring.elasticsearch.sniffing: false
[2022-01-25T10:37:23,684][DEBUG][logstash.runner ] monitoring.collection.pipeline.details.enabled: true
[2022-01-25T10:37:23,685][DEBUG][logstash.runner ] monitoring.collection.config.enabled: true
[2022-01-25T10:37:23,686][DEBUG][logstash.runner ] node.uuid: ""
[2022-01-25T10:37:23,686][DEBUG][logstash.runner ] xpack.management.enabled: false
[2022-01-25T10:37:23,687][DEBUG][logstash.runner ] xpack.management.logstash.poll_interval: #<Java::OrgLogstashUtil::TimeValue:0x15a5b2fc>
[2022-01-25T10:37:23,688][DEBUG][logstash.runner ] xpack.management.pipeline.id: ["main"]
[2022-01-25T10:37:23,691][DEBUG][logstash.runner ] xpack.management.elasticsearch.username: "logstash_system"
[2022-01-25T10:37:23,697][DEBUG][logstash.runner ] xpack.management.elasticsearch.hosts: ["https://localhost:9200"]
[2022-01-25T10:37:23,698][DEBUG][logstash.runner ] xpack.management.elasticsearch.ssl.verification_mode: "certificate"
[2022-01-25T10:37:23,699][DEBUG][logstash.runner ] xpack.management.elasticsearch.sniffing: false
[2022-01-25T10:37:23,699][DEBUG][logstash.runner ] --------------- Logstash Settings -------------------
[2022-01-25T10:37:23,742][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2022-01-25T10:37:23,798][DEBUG][logstash.agent ] Initializing API WebServer {"api.http.host"=>"127.0.0.1", "api.http.port"=>9600..9700, "api.ssl.enabled"=>false, "api.auth.type"=>"none", "api.environment"=>"production"}
[2022-01-25T10:37:23,847][DEBUG][logstash.api.service ] [api-service] start
[2022-01-25T10:37:24,156][DEBUG][logstash.agent ] Setting up metric collection
[2022-01-25T10:37:24,236][DEBUG][logstash.instrument.periodicpoller.os] Starting {:polling_interval=>5, :polling_timeout=>120}
[2022-01-25T10:37:24,251][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:24,437][DEBUG][logstash.instrument.periodicpoller.jvm] Starting {:polling_interval=>5, :polling_timeout=>120}
[2022-01-25T10:37:24,569][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:24,575][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:24,596][DEBUG][logstash.instrument.periodicpoller.persistentqueue] Starting {:polling_interval=>5, :polling_timeout=>120}
[2022-01-25T10:37:24,611][DEBUG][logstash.instrument.periodicpoller.deadletterqueue] Starting {:polling_interval=>5, :polling_timeout=>120}
[2022-01-25T10:37:26,309][DEBUG][logstash.agent ] Starting agent
[2022-01-25T10:37:26,323][DEBUG][logstash.agent ] Starting API WebServer (puma)
[2022-01-25T10:37:26,388][DEBUG][logstash.config.source.local.configpathloader] Skipping the following files while reading config since they don't match the specified glob pattern {:files=>["C:/software/ELK/logstash-7.16.3/config/conf.d/cf.conf"]}
[2022-01-25T10:37:26,392][DEBUG][logstash.config.source.local.configpathloader] Reading config file {:config_file=>"C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf"}
[2022-01-25T10:37:26,453][DEBUG][logstash.agent ] Trying to start API WebServer {:port=>9600, :ssl_enabled=>false}
[2022-01-25T10:37:26,462][DEBUG][logstash.agent ] Converging pipelines state {:actions_count=>1}
[2022-01-25T10:37:26,474][DEBUG][logstash.agent ] Executing action {:action=>LogStash::PipelineAction::Create/pipeline_id:main}
[2022-01-25T10:37:26,484][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600, :ssl_enabled=>false}
[2022-01-25T10:37:27,139][DEBUG][org.reflections.Reflections] going to scan these urls:
jar:file:/C:/software/ELK/logstash-7.16.3/logstash-core/lib/jars/logstash-core.jar!/
[2022-01-25T10:37:27,207][INFO ][org.reflections.Reflections] Reflections took 67 ms to scan 1 urls, producing 119 keys and 417 values
[2022-01-25T10:37:27,215][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.JsonDeserializer -> com.fasterxml.jackson.databind.deser.std.StdDeserializer
[2022-01-25T10:37:27,216][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.deser.NullValueProvider -> com.fasterxml.jackson.databind.JsonDeserializer
[2022-01-25T10:37:27,216][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> com.fasterxml.jackson.databind.deser.std.StdDeserializer
[2022-01-25T10:37:27,217][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.filter.AbstractFilterable$Builder -> org.apache.logging.log4j.core.appender.AbstractAppender$Builder
[2022-01-25T10:37:27,218][DEBUG][org.reflections.Reflections] expanded subtype java.security.SecureClassLoader -> java.net.URLClassLoader
[2022-01-25T10:37:27,218][DEBUG][org.reflections.Reflections] expanded subtype java.lang.ClassLoader -> java.security.SecureClassLoader
[2022-01-25T10:37:27,219][DEBUG][org.reflections.Reflections] expanded subtype java.io.Closeable -> java.net.URLClassLoader
[2022-01-25T10:37:27,220][DEBUG][org.reflections.Reflections] expanded subtype java.lang.AutoCloseable -> java.io.Closeable
[2022-01-25T10:37:27,221][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.jsonFormatVisitors.JsonFormatVisitable -> com.fasterxml.jackson.databind.JsonSerializer
[2022-01-25T10:37:27,221][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.config.builder.api.ConfigurationBuilderFactory -> org.apache.logging.log4j.core.config.ConfigurationFactory
[2022-01-25T10:37:27,222][DEBUG][org.reflections.Reflections] expanded subtype org.jruby.RubyObject -> org.jruby.RubyException
[2022-01-25T10:37:27,223][DEBUG][org.reflections.Reflections] expanded subtype org.jruby.RubyBasicObject -> org.jruby.RubyObject
[2022-01-25T10:37:27,224][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Cloneable -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,224][DEBUG][org.reflections.Reflections] expanded subtype org.jruby.runtime.builtin.IRubyObject -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,225][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,226][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Comparable -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,226][DEBUG][org.reflections.Reflections] expanded subtype org.jruby.runtime.marshal.CoreObjectType -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,227][DEBUG][org.reflections.Reflections] expanded subtype org.jruby.runtime.builtin.InstanceVariables -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,228][DEBUG][org.reflections.Reflections] expanded subtype org.jruby.runtime.builtin.InternalVariables -> org.jruby.RubyBasicObject
[2022-01-25T10:37:27,231][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.ser.std.StdSerializer -> com.fasterxml.jackson.databind.ser.std.StdScalarSerializer
[2022-01-25T10:37:27,236][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.JsonSerializer -> com.fasterxml.jackson.databind.ser.std.StdSerializer
[2022-01-25T10:37:27,237][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.jsonFormatVisitors.JsonFormatVisitable -> com.fasterxml.jackson.databind.ser.std.StdSerializer
[2022-01-25T10:37:27,237][DEBUG][org.reflections.Reflections] expanded subtype com.fasterxml.jackson.databind.jsonschema.SchemaAware -> com.fasterxml.jackson.databind.ser.std.StdSerializer
[2022-01-25T10:37:27,238][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> com.fasterxml.jackson.databind.ser.std.StdSerializer
[2022-01-25T10:37:27,239][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Throwable -> java.lang.Exception
[2022-01-25T10:37:27,240][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> java.lang.Throwable
[2022-01-25T10:37:27,240][DEBUG][org.reflections.Reflections] expanded subtype java.util.AbstractList -> java.util.ArrayList
[2022-01-25T10:37:27,241][DEBUG][org.reflections.Reflections] expanded subtype java.util.AbstractCollection -> java.util.AbstractList
[2022-01-25T10:37:27,242][DEBUG][org.reflections.Reflections] expanded subtype java.util.Collection -> java.util.AbstractCollection
[2022-01-25T10:37:27,242][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Iterable -> java.util.Collection
[2022-01-25T10:37:27,243][DEBUG][org.reflections.Reflections] expanded subtype java.util.List -> java.util.AbstractList
[2022-01-25T10:37:27,243][DEBUG][org.reflections.Reflections] expanded subtype java.util.Collection -> java.util.List
[2022-01-25T10:37:27,244][DEBUG][org.reflections.Reflections] expanded subtype java.util.List -> java.util.ArrayList
[2022-01-25T10:37:27,252][DEBUG][org.reflections.Reflections] expanded subtype java.util.RandomAccess -> java.util.ArrayList
[2022-01-25T10:37:27,253][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Cloneable -> java.util.ArrayList
[2022-01-25T10:37:27,253][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> java.util.ArrayList
[2022-01-25T10:37:27,253][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.filter.AbstractFilterable -> org.apache.logging.log4j.core.appender.AbstractAppender
[2022-01-25T10:37:27,254][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.AbstractLifeCycle -> org.apache.logging.log4j.core.filter.AbstractFilterable
[2022-01-25T10:37:27,255][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.LifeCycle2 -> org.apache.logging.log4j.core.AbstractLifeCycle
[2022-01-25T10:37:27,256][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.LifeCycle -> org.apache.logging.log4j.core.LifeCycle2
[2022-01-25T10:37:27,256][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.filter.Filterable -> org.apache.logging.log4j.core.filter.AbstractFilterable
[2022-01-25T10:37:27,257][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.LifeCycle -> org.apache.logging.log4j.core.filter.Filterable
[2022-01-25T10:37:27,258][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.Appender -> org.apache.logging.log4j.core.appender.AbstractAppender
[2022-01-25T10:37:27,258][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.LifeCycle -> org.apache.logging.log4j.core.Appender
[2022-01-25T10:37:27,259][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.impl.LocationAware -> org.apache.logging.log4j.core.appender.AbstractAppender
[2022-01-25T10:37:27,259][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Exception -> java.io.IOException
[2022-01-25T10:37:27,263][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Exception -> java.lang.RuntimeException
[2022-01-25T10:37:27,268][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.AbstractLifeCycle -> org.apache.logging.log4j.core.filter.AbstractFilter
[2022-01-25T10:37:27,269][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.Filter -> org.apache.logging.log4j.core.filter.AbstractFilter
[2022-01-25T10:37:27,269][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.LifeCycle -> org.apache.logging.log4j.core.Filter
[2022-01-25T10:37:27,270][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Comparable -> java.lang.Enum
[2022-01-25T10:37:27,271][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> java.lang.Enum
[2022-01-25T10:37:27,273][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.LogEvent -> org.apache.logging.log4j.core.impl.Log4jLogEvent
[2022-01-25T10:37:27,273][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> org.apache.logging.log4j.core.LogEvent
[2022-01-25T10:37:27,274][DEBUG][org.reflections.Reflections] expanded subtype java.util.AbstractMap -> java.util.IdentityHashMap
[2022-01-25T10:37:27,274][DEBUG][org.reflections.Reflections] expanded subtype java.util.Map -> java.util.AbstractMap
[2022-01-25T10:37:27,275][DEBUG][org.reflections.Reflections] expanded subtype java.util.Map -> java.util.IdentityHashMap
[2022-01-25T10:37:27,283][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> java.util.IdentityHashMap
[2022-01-25T10:37:27,284][DEBUG][org.reflections.Reflections] expanded subtype java.lang.Cloneable -> java.util.IdentityHashMap
[2022-01-25T10:37:27,285][DEBUG][org.reflections.Reflections] expanded subtype org.apache.logging.log4j.core.impl.LocationAwareLogEventFactory -> org.apache.logging.log4j.core.impl.LogEventFactory
[2022-01-25T10:37:27,285][DEBUG][org.reflections.Reflections] expanded subtype java.io.Serializable -> org.apache.logging.log4j.message.Message
[2022-01-25T10:37:27,286][DEBUG][org.reflections.Reflections] expanded subtype java.lang.RuntimeException -> java.lang.IllegalArgumentException
[2022-01-25T10:37:27,300][DEBUG][org.logstash.secret.store.SecretStoreFactory] Attempting to exists or secret store with implementation: org.logstash.secret.store.backend.JavaKeyStore
[2022-01-25T10:37:28,244][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"file", :type=>"input", :class=>LogStash::Inputs::File}
[2022-01-25T10:37:28,322][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"plain", :type=>"codec", :class=>LogStash::Codecs::Plain}
[2022-01-25T10:37:28,407][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@id = "plain_f2ec41e6-af4a-4f0d-86f6-b6aed5a2549d"
[2022-01-25T10:37:28,407][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@enable_metric = true
[2022-01-25T10:37:28,409][DEBUG][logstash.codecs.plain ] config LogStash::Codecs::Plain/@charset = "UTF-8"
[2022-01-25T10:37:28,484][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@start_position = "beginning"
[2022-01-25T10:37:28,485][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@path = ["C:\\software\\ELK\\sample-data\\*.txt"]
[2022-01-25T10:37:28,486][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@id = "1571e7efb3a3f9dbea76233cfa22ac7bc13417a0f775d50a311e152285cb7269"
[2022-01-25T10:37:28,493][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@sincedb_path = "C:\\software\\ELK\\config\\sinceDB"
[2022-01-25T10:37:28,494][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@enable_metric = true
[2022-01-25T10:37:28,502][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@codec = <LogStash::Codecs::Plain id=>"plain_f2ec41e6-af4a-4f0d-86f6-b6aed5a2549d", enable_metric=>true, charset=>"UTF-8">
[2022-01-25T10:37:28,503][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@add_field = {}
[2022-01-25T10:37:28,505][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@stat_interval = 1.0
[2022-01-25T10:37:28,506][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@discover_interval = 15
[2022-01-25T10:37:28,506][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@sincedb_write_interval = 15.0
[2022-01-25T10:37:28,507][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@delimiter = "\n"
[2022-01-25T10:37:28,507][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@close_older = 3600.0
[2022-01-25T10:37:28,508][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@mode = "tail"
[2022-01-25T10:37:28,508][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@file_completed_action = "delete"
[2022-01-25T10:37:28,509][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@sincedb_clean_after = 1209600.0
[2022-01-25T10:37:28,509][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@file_chunk_size = 32768
[2022-01-25T10:37:28,510][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@file_chunk_count = 140737488355327
[2022-01-25T10:37:28,512][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@file_sort_by = "last_modified"
[2022-01-25T10:37:28,519][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@file_sort_direction = "asc"
[2022-01-25T10:37:28,520][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@exit_after_read = false
[2022-01-25T10:37:28,522][DEBUG][logstash.inputs.file ] config LogStash::Inputs::File/@check_archive_validity = false
[2022-01-25T10:37:28,553][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"stdout", :type=>"output", :class=>LogStash::Outputs::Stdout}
[2022-01-25T10:37:28,573][DEBUG][logstash.plugins.registry] On demand adding plugin to the registry {:name=>"rubydebug", :type=>"codec", :class=>LogStash::Codecs::RubyDebug}
[2022-01-25T10:37:28,581][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@id = "rubydebug_dd771a39-7e07-4506-b343-34fff802d497"
[2022-01-25T10:37:28,582][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@enable_metric = true
[2022-01-25T10:37:28,582][DEBUG][logstash.codecs.rubydebug] config LogStash::Codecs::RubyDebug/@metadata = false
[2022-01-25T10:37:29,842][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:29,871][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:29,875][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:29,935][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@codec = <LogStash::Codecs::RubyDebug id=>"rubydebug_dd771a39-7e07-4506-b343-34fff802d497", enable_metric=>true, metadata=>false>
[2022-01-25T10:37:29,936][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@id = "d9ff5f1d7406805212a301dc90dd4ab640805cf3b8c331e341d7d10dcdb07c94"
[2022-01-25T10:37:29,944][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@enable_metric = true
[2022-01-25T10:37:29,945][DEBUG][logstash.outputs.stdout ] config LogStash::Outputs::Stdout/@workers = 1
[2022-01-25T10:37:29,994][DEBUG][logstash.javapipeline ] Starting pipeline {:pipeline_id=>"main"}
[2022-01-25T10:37:30,129][INFO ][logstash.javapipeline ][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>8, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>1000, "pipeline.sources"=>["C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf"], :thread=>"#<Thread:0x4f9d1273 run>"}
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,751][DEBUG][org.logstash.config.ir.CompiledPipeline][main] Compiled output
P[output-stdout{"codec"=>"rubydebug"}|[file]C:/software/ELK/logstash-7.16.3/config/conf.d/test.conf:14:3:```
stdout {
codec => rubydebug
}
```]
into
org.logstash.config.ir.compiler.ComputeStepSyntaxElement@3fdc2b9c
[2022-01-25T10:37:30,941][INFO ][logstash.javapipeline ][main] Pipeline Java execution initialization time {"seconds"=>0.81}
[2022-01-25T10:37:31,073][INFO ][logstash.javapipeline ][main] Pipeline started {"pipeline.id"=>"main"}
[2022-01-25T10:37:31,087][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:37:31,092][DEBUG][logstash.javapipeline ] Pipeline started successfully {:pipeline_id=>"main", :thread=>"#<Thread:0x4f9d1273 run>"}
[2022-01-25T10:37:31,149][INFO ][filewatch.observingtail ][main][1571e7efb3a3f9dbea76233cfa22ac7bc13417a0f775d50a311e152285cb7269] START, creating Discoverer, Watch with file and sincedb collections
[2022-01-25T10:37:31,167][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2022-01-25T10:37:31,190][DEBUG][filewatch.sincedbcollection][main][1571e7efb3a3f9dbea76233cfa22ac7bc13417a0f775d50a311e152285cb7269] open: reading from C:\software\ELK\config\sinceDB
[2022-01-25T10:37:32,277][DEBUG][filewatch.sincedbcollection][main][1571e7efb3a3f9dbea76233cfa22ac7bc13417a0f775d50a311e152285cb7269] writing sincedb (delta since last write = 1643107052)
[2022-01-25T10:37:34,882][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:34,893][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:34,894][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:36,102][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:37:39,913][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:39,923][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:39,924][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:41,100][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:37:44,923][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:44,937][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:44,938][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:46,101][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:37:47,473][DEBUG][filewatch.sincedbcollection][main][1571e7efb3a3f9dbea76233cfa22ac7bc13417a0f775d50a311e152285cb7269] writing sincedb (delta since last write = 15)
[2022-01-25T10:37:49,940][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:49,944][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:49,945][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:51,101][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:37:54,951][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:54,953][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:54,954][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:37:56,099][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:37:59,965][DEBUG][logstash.instrument.periodicpoller.cgroup] One or more required cgroup files or directories not found: /proc/self/cgroup, /sys/fs/cgroup/cpuacct, /sys/fs/cgroup/cpu
[2022-01-25T10:37:59,970][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ParNew"}
[2022-01-25T10:37:59,972][DEBUG][logstash.instrument.periodicpoller.jvm] collector name {:name=>"ConcurrentMarkSweep"}
[2022-01-25T10:38:01,097][DEBUG][org.logstash.execution.PeriodicFlush][main] Pushing flush onto pipeline.
[2022-01-25T10:38:02,651][DEBUG][filewatch.sincedbcollection][main][1571e7efb3a3f9dbea76233cfa22ac7bc13417a0f775d50a311e152285cb7269] writing sincedb (delta since last write = 15)