Have you followed the instructions for enabling security in Elasticsearch and Kibana? You do need to also update the Kibana config. If it is still not working, please show your config.
apiVersion: v1
kind: ConfigMap
metadata:
name: logstash
data:
logstash.yml: |
http.host: "0.0.0.0" #path.config: /usr/share/logstash/pipeline
path.logs: /usr/share/logstash/logstash-kafka
## Disable X-Pack
## see https://www.elastic.co/guide/en/x-pack/current/xpack-settings.html
xpack.monitoring.enabled: true
xpack.monitoring.elasticsearch.url: es-coordinating:80
pipeline.workers: 6 ### (default value is Number of the host’s CPU cores )The number of workers that will, in parallel, execute the filter and output stages of the pipeline. If you find that events are backing up, or that the CPU is not saturated, consider increasing this number to better utilize machine processing power.
pipeline.batch.size: 100 ### The maximum number of events an individual worker thread will collect from inputs before attempting to execute its filters and outputs. Larger batch sizes are generally more efficient, but come at the cost of increased memory overhead. You may need to increase JVM heap space in the jvm.options config file.
config.reload.automatic: true ### When set to true, periodically checks if the configuration has changed and reloads the configuration whenever it is changed. This can also be triggered manually through the SIGHUP signal.
config.reload.interval: 30s ### How often in seconds Logstash checks the config files for changes.
xpack.security.enabled: true
xpack.management.enabled: true
xpack.management.elasticsearch.hosts: "http://17.99.223.232:80"
xpack.management.elasticsearch.username:
xpack.management.elasticsearch.password:
xpack.management.logstash.poll_interval: 5s
xpack.management.pipeline.id: ["main"]
logstash-kafka.conf: |
input {
kafka {
bootstrap_servers => "rn2-gbikafkad-lapp01.corp.apple.com:9093,rn2-gbikafkad-lapp02.corp.apple.com:9093,rn2-gbikafkad-lapp03.corp.apple.com:9093"
codec => "json"
topics => "gbi_etl_monitoring"
security_protocol => "SSL"
ssl_key_password => "MfgcH25uKH"
ssl_keystore_location => "/usr/share/logstash/certs/keystore.jks"
ssl_keystore_password => "MfgcH25uKH"
ssl_truststore_location => "/usr/share/logstash/certs/truststore.jks"
ssl_truststore_password => "MfgcH25uKH"
consumer_threads => 4 ### consumer threads subscribe to kafka topic
group_id => "logstash-etl-fwk-monitoring-dev-USRNO3"
tags => ["logs"]
}
}
output {
if "logs" in [tags]{
elasticsearch {
hosts => ["http://es-coordinating:80"]
index => "etl-fw-monitoring-logs-%{+YYYY.MM.dd}"
}
}
}
There is more to enabling security than enabling that parameter, e.g. setting up users, roles and TLS. It does not seem like you have done any of that.
Warning FailedMount 3m3s (x6 over 3m19s) kubelet, acs-node65.usrno1.applecloud.ioMountVolume.SetUp failed for volume "config-pattern" : configmap "logstash" not found
Warning FailedMount 3m3s (x6 over 3m19s) kubelet, acs-node65.usrno1.applecloud.ioMountVolume.SetUp failed for volume "config-volume" : configmap "logstash" not found
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.