There is an error that is saying that the data is not indexing in elasticsearch.
I'll show you the command i'm using to start logstash and the error that happens when i start the filebeat.
# bin/logstash --path.settings /etc/logstash/ -f /etc/logstash/conf.d/logstash-sample.conf
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.headius.backport9.modules.Modules (file:/usr/share/logstash/logstash-core/lib/jars/jruby-complete-9.2.9.0.jar) to method sun.nio.ch.NativeThread.signal(long)
WARNING: Please consider reporting this to the maintainers of com.headius.backport9.modules.Modules
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Sending Logstash logs to /var/log/logstash which is now configured via log4j2.properties
[2020-03-19T17:05:10,652][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2020-03-19T17:05:10,878][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.6.0"}
[2020-03-19T17:05:14,763][INFO ][org.reflections.Reflections] Reflections took 95 ms to scan 1 urls, producing 20 keys and 40 values
[2020-03-19T17:05:17,544][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://localhost:9200/]}}
[2020-03-19T17:05:18,007][WARN ][logstash.outputs.elasticsearch][main] Restored connection to ES instance {:url=>"http://localhost:9200/"}
[2020-03-19T17:05:18,142][INFO ][logstash.outputs.elasticsearch][main] ES Output version determined {:es_version=>7}
[2020-03-19T17:05:18,167][WARN ][logstash.outputs.elasticsearch][main] Detected a 6.x and above cluster: the `type` event field won't be used to determine the document _type {:es_version=>7}
[2020-03-19T17:05:18,282][INFO ][logstash.outputs.elasticsearch][main] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//localhost:9200"]}
[2020-03-19T17:05:18,449][INFO ][logstash.outputs.elasticsearch][main] Using default mapping template
[2020-03-19T17:05:18,526][WARN ][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge][main] A gauge metric of an unknown type (org.jruby.specialized.RubyArrayOneObject) has been create for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team.
[2020-03-19T17:05:18,537][INFO ][logstash.javapipeline ][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>4, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>500, "pipeline.sources"=>["/etc/logstash/conf.d/logstash-sample.conf"], :thread=>"#<Thread:0x5e74a8da run>"}
[2020-03-19T17:05:18,640][INFO ][logstash.outputs.elasticsearch][main] Attempting to install template {:manage_template=>{"index_patterns"=>"logstash-*", "version"=>60001, "settings"=>{"index.refresh_interval"=>"5s", "number_of_shards"=>1}, "mappings"=>{"dynamic_templates"=>[{"message_field"=>{"path_match"=>"message", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false}}}, {"string_fields"=>{"match"=>"*", "match_mapping_type"=>"string", "mapping"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>true, "properties"=>{"ip"=>{"type"=>"ip"}, "location"=>{"type"=>"geo_point"}, "latitude"=>{"type"=>"half_float"}, "longitude"=>{"type"=>"half_float"}}}}}}}
[2020-03-19T17:05:21,209][INFO ][logstash.inputs.beats ][main] Beats inputs: Starting input listener {:address=>"0.0.0.0:5044"}
[2020-03-19T17:05:21,233][INFO ][logstash.javapipeline ][main] Pipeline started {"pipeline.id"=>"main"}
[2020-03-19T17:05:21,431][INFO ][org.logstash.beats.Server][main] Starting server on port: 5044
[2020-03-19T17:05:21,456][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]}
[2020-03-19T17:05:21,915][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2020-03-19T17:06:40,647][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x35f571de>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,662][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x3b102d58>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,669][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x24c1badf>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,669][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x47d392c1>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,691][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x6c51e763>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,698][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x11e1f026>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,704][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x2755b110>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,710][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x8ac0ecc>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,715][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x57ef567>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,720][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x5ddc888f>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
[2020-03-19T17:06:40,719][ERROR][logstash.outputs.elasticsearch][main] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-%{[@metadata][ version]}", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x1efd5ed2>], :response=>{"index"=>{"_index"=>"filebeat-%{[@metadata][ version]}", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"invalid_index_name_exception", "reason"=>"Invalid index name [filebeat-%{[@metadata][ version]}], must not contain the following characters [ , \", *, \\, <, |, ,, >, /, ?]", "index_uuid"=>"_na_", "index"=>"filebeat-%{[@metadata][ version]}"}}}}
/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/awesome_print-1.7.0/lib/awesome_print/formatters/base_formatter.rb:31: warning: constant ::Fixnum is deprecated
PD: I have delete some ERROR code lines, because it sais the same all the time. After all of this code, in the terminal, as i said previously, i can see all the data i'm sending with the index structure i have in my logstash config file. But not in kibana.
Thanks a lot for "wasting your time" on trying to help me!
