I have ES 5.6.3 and logstash 5.4 installed on my local system whereas I have filebeat 5.4 installed in another system. Whenever I am trying to run logstash, I get the following error
[[main]<beats] ERROR logstash.pipeline - A plugin had an unrecoverable error. Will restart this plugin.
** Plugin: <LogStash::Inputs::Beats host=>"171.16.203.122", port=>5044, id=>"0071afb40104d17543db821bb2ad85d9dd89778e-1", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_503f23f3-5557-4dfc-967b-2fe14cf3bc93", enable_metric=>true, charset=>"UTF-8">, ssl=>false, ssl_verify_mode=>"none", include_codec_tag=>true, ssl_handshake_timeout=>10000, congestion_threshold=>5, target_field_for_codec=>"message", tls_min_version=>1, tls_max_version=>1.2, cipher_suites=>["TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256"], client_inactivity_timeout=>60>**
** Error: Cannot assign requested address: bind**
10:48:44.028 [[main]<beats] ERROR logstash.pipeline - A plugin had an unrecoverable error. Will restart this plugin.
** Plugin: <LogStash::Inputs::Beats host=>client ip, port=>5044, id=>"0071afb40104d17543db821bb2ad85d9dd89778e-1", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_503f23f3-5557-4dfc-967b-2fe14cf3bc93", enable_metric=>true, charset=>"UTF-8">, ssl=>false, ssl_verify_mode=>"none", include_codec_tag=>true, ssl_handshake_timeout=>10000, congestion_threshold=>5, target_field_for_codec=>"message", tls_min_version=>1, tls_max_version=>1.2, cipher_suites=>["TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384", "TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256"], client_inactivity_timeout=>60>**
Error: event executor terminated
The following is my configuration file
input { **
** beats {
** host => "client ip"**
** port => "5044"**
** #ssl => true**
** #ssl_certificate => "D:\ELK\OpenSSL\bin\server.csr"**
** #ssl_key => "D:\ELK\OpenSSL\bin\server.key"**
** }**
}
filter {
** csv {**
** separator => ","**
** columns => ["Timestamp",**
"Memory-% Committed Bytes In Use",
"Memory-Available Bytes",
"Memory-Available KBytes",
"Memory-Available MBytes",
"Memory-Page Faults/sec",
"Memory-Free System Page Table Entries",
"PhysicalDisk(_Total)-Avg. Disk Bytes/Read",
"PhysicalDisk(_Total)-Avg. Disk Bytes/Write",
"PhysicalDisk(_Total)-Current Disk Queue Length",
"PhysicalDisk(_Total)-Disk Read Bytes/sec",
"PhysicalDisk(_Total)-Disk Write Bytes/sec",
"Process(_Total)-% Processor Time",
"Process(_Total)-% User Time",
"Process(_Total)-ID Process",
"Process(_Total)-Thread Count",
"Process(_Total)-Working Set",
"Process(_Total)-IO Read Bytes/sec",
"Process(_Total)-IO Write Bytes/sec",
"Processor(_Total)-% Idle Time",
"Processor(_Total)-% Processor Time",
"Processor(_Total)-% User Time"]
** }**
}
output { **
** elasticsearch {
** hosts => ["server ip:9200"]**
** index => systemosmetricsindex**
** }**
** stdout{codec => rubydebug }**
elasticsearch.yml file
# ---------------------------------- Network -----------------------------------
network.host: server ip
http.port: 9200
logstash.yml file
# ------------ Node identity ------------
node.name: server ip
# ------------ Metrics Settings --------------
http.host: server ip
http.port: 9600
filebeat.yml
filebeat.prospectors:
- input_type: log
** paths:**
** - D:\Development\Shaswata\Perfmon\INHYICBIVM004_20171112-000001*.csv**
#----------------------------- Logstash output --------------------------------
output.logstash:
** # The Logstash hosts**
** hosts: ["server ip:5044"]**
** # Optional SSL. By default is off.**
** # List of root certificates for HTTPS server verifications**
** #ssl.certificate_authorities: ["/etc/pki/root/ca.pem"]**
** # Certificate for SSL client authentication**
** #ssl.certificate: "/etc/pki/client/cert.pem"**
** # Client Certificate Key**
** #ssl.key: ["D:\Development\Shaswata\server.key"]**