Error: a container name must be specified for pod elk-monitoring-es-hot-0

Elastic Orchestration Elastic Cloud on Kubernetes (ECK)
1

Hi,

On GCP Autopilot Cluster(v1.21.5) I have deployed via ECK(1.8) Elasticserach server using this config .yaml

metadata:
  name: elk-monitoring
  namespace: xx
spec:
  monitoring:
    metrics:
      elasticsearchRefs:
      - name: elk-monitoring
        namespace: xx
    logs:
      elasticsearchRefs:
      - name: elk-monitoring
        namespace: xx
  version: 7.15.0
  nodeSets:
  - name: hot
    count: 1
    config:
      node.store.allow_mmap: false
      node.roles: ["master", "data", "ingest"]
      index.store.type: niofs
    volumeClaimTemplates:
    - metadata:
        name: elasticsearch-data
        namespace: xx
      spec:
        accessModes:
        - ReadWriteOnce
        resources:
          requests:
            storage: 100Gi
        storageClassName: premium-rwo
    podTemplate:
      spec:
        initContainers:
        - name: sysctl
          securityContext:
            privileged: false
          command: ['sh', '-c', 'sysctl -w vm.max_map_count=262144']
        containers:
        - name: elasticsearch
          resources:
              requests:
                memory: 2Gi
                cpu: 2
              limits:
                memory: 16Gi
                cpu: 8

  http:
    service:
      spec:
        type: ClusterIP
        ports:
          - name: https
            port: 9200
            protocol: TCP
            targetPort: 9200

Using kubectl get pods I can see that containers are starting

NAME                            READY   STATUS    RESTARTS   AGE
elk-monitoring-es-hot-0         3/3     Running   0          3d8h

But when I chcek the logs of pod "elk-monitoring-es-hot-0" I can see bellow log
error: a container name must be specified for pod elk-monitoring-es-hot-0, choose one of: [elasticsearch metricbeat filebeat] or one of the init containers: [elastic-internal-init-filesystem]

I am getting this error no matter if I specify init container with names as in the error or I just specify elasticserach container or all 3 elasticserach, metricbeat, filebeat container in the template with no init container.

2

Hi,

Could you share the command you are using to get the logs ? I think that something like kubectl logs pod/elk-monitoring-es-hot-0 elasticsearch should work.

Thanks

3

Thanks for the replay, sending the logs.

[2021-12-06T12:24:49,317][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] version[7.15.0], pid[7], build[default/docker/79d65f6e357953a5b3cbcc5e2c7c21073d89aa29/2021-09-16T03:05:29.143308416Z], OS[Linux/5.4.144+/amd64], JVM[Eclipse Foundation/OpenJDK 64-Bit Server VM/16.0.2/16.0.2+7]
[2021-12-06T12:24:49,322][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]
[2021-12-06T12:24:49,322][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-13090359393462897359, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms1024m, -Xmx1024m, -XX:MaxDirectMemorySize=536870912, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]
[2021-12-06T12:24:52,200][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [aggs-matrix-stats]
[2021-12-06T12:24:52,201][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [analysis-common]
[2021-12-06T12:24:52,201][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [constant-keyword]
[2021-12-06T12:24:52,201][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [frozen-indices]
[2021-12-06T12:24:52,201][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [ingest-common]
[2021-12-06T12:24:52,202][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [ingest-geoip]
[2021-12-06T12:24:52,202][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [ingest-user-agent]
[2021-12-06T12:24:52,202][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [kibana]
[2021-12-06T12:24:52,202][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [lang-expression]
[2021-12-06T12:24:52,203][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [lang-mustache]
[2021-12-06T12:24:52,203][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [lang-painless]
[2021-12-06T12:24:52,203][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [mapper-extras]
[2021-12-06T12:24:52,203][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [mapper-version]
[2021-12-06T12:24:52,204][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [parent-join]
[2021-12-06T12:24:52,204][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [percolator]
[2021-12-06T12:24:52,204][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [rank-eval]
[2021-12-06T12:24:52,205][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [reindex]
[2021-12-06T12:24:52,205][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [repositories-metering-api]
[2021-12-06T12:24:52,205][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [repository-encrypted]
[2021-12-06T12:24:52,205][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [repository-url]
[2021-12-06T12:24:52,206][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [runtime-fields-common]
[2021-12-06T12:24:52,206][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [search-business-rules]
[2021-12-06T12:24:52,206][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [searchable-snapshots]
[2021-12-06T12:24:52,206][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [snapshot-repo-test-kit]
[2021-12-06T12:24:52,207][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [spatial]
[2021-12-06T12:24:52,207][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [transform]
[2021-12-06T12:24:52,207][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [transport-netty4]
[2021-12-06T12:24:52,207][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [unsigned-long]
[2021-12-06T12:24:52,208][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [vector-tile]
[2021-12-06T12:24:52,208][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [vectors]
[2021-12-06T12:24:52,208][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [wildcard]
[2021-12-06T12:24:52,208][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-aggregate-metric]
[2021-12-06T12:24:52,209][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-analytics]
[2021-12-06T12:24:52,209][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-async]
[2021-12-06T12:24:52,210][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-async-search]
[2021-12-06T12:24:52,210][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-autoscaling]
[2021-12-06T12:24:52,210][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-ccr]
[2021-12-06T12:24:52,211][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-core]
[2021-12-06T12:24:52,211][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-data-streams]
[2021-12-06T12:24:52,211][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-deprecation]
[2021-12-06T12:24:52,212][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-enrich]
[2021-12-06T12:24:52,212][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-eql]
[2021-12-06T12:24:52,212][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-fleet]
[2021-12-06T12:24:52,212][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-graph]
[2021-12-06T12:24:52,213][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-identity-provider]
[2021-12-06T12:24:52,213][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-ilm]
[2021-12-06T12:24:52,213][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-logstash]
[2021-12-06T12:24:52,214][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-ml]
[2021-12-06T12:24:52,214][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-monitoring]
[2021-12-06T12:24:52,214][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-ql]
[2021-12-06T12:24:52,214][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-rollup]
[2021-12-06T12:24:52,215][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-security]
[2021-12-06T12:24:52,215][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-shutdown]
[2021-12-06T12:24:52,215][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-sql]
[2021-12-06T12:24:52,216][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-stack]
[2021-12-06T12:24:52,216][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-text-structure]
[2021-12-06T12:24:52,216][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-voting-only-node]
[2021-12-06T12:24:52,217][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] loaded module [x-pack-watcher]
[2021-12-06T12:24:52,217][INFO ][o.e.p.PluginsService     ] [elk-monitoring-es-hot-0] no plugins loaded
[2021-12-06T12:24:52,252][INFO ][o.e.e.NodeEnvironment    ] [elk-monitoring-es-hot-0] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sdb)]], net usable_space [97.8gb], net total_space [97.9gb], types [ext4]
[2021-12-06T12:24:52,253][INFO ][o.e.e.NodeEnvironment    ] [elk-monitoring-es-hot-0] heap size [1gb], compressed ordinary object pointers [true]
[2021-12-06T12:24:52,274][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] node name [elk-monitoring-es-hot-0], node ID [jeGSzzywSl-XNaAVUKvfhQ], cluster name [elk-monitoring], roles [master, data, ingest]
[2021-12-06T12:24:57,341][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [elk-monitoring-es-hot-0] [controller/179] [Main.cc@122] controller (64 bit): Version 7.15.0 (Build d0ab43b6c551f8) Copyright (c) 2021 Elasticsearch BV
[2021-12-06T12:24:58,051][INFO ][o.e.x.s.a.Realms         ] [elk-monitoring-es-hot-0] license mode is [trial], currently licensed security realms are [reserved/reserved,file/file1,native/native1]
4 
[2021-12-06T12:24:58,437][INFO ][o.e.x.s.a.s.FileRolesStore] [elk-monitoring-es-hot-0] parsed [48] roles from file [/usr/share/elasticsearch/config/roles.yml]
[2021-12-06T12:24:58,784][INFO ][o.e.i.g.LocalDatabases   ] [elk-monitoring-es-hot-0] initialized default databases [[GeoLite2-Country.mmdb, GeoLite2-City.mmdb, GeoLite2-ASN.mmdb]], config databases [[]] and watching [/usr/share/elasticsearch/config/ingest-geoip] for changes
[2021-12-06T12:24:58,786][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] initialized database registry, using geoip-databases directory [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ]
[2021-12-06T12:24:59,436][INFO ][o.e.t.NettyAllocator     ] [elk-monitoring-es-hot-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=1gb}]
[2021-12-06T12:24:59,506][INFO ][o.e.d.DiscoveryModule    ] [elk-monitoring-es-hot-0] using discovery type [zen] and seed hosts providers [settings, file]
[2021-12-06T12:24:59,989][INFO ][o.e.g.DanglingIndicesState] [elk-monitoring-es-hot-0] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2021-12-06T12:25:00,462][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] initialized
[2021-12-06T12:25:00,462][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] starting ...
[2021-12-06T12:25:00,475][INFO ][o.e.x.s.c.f.PersistentCache] [elk-monitoring-es-hot-0] persistent cache index loaded
[2021-12-06T12:25:00,585][INFO ][o.e.t.TransportService   ] [elk-monitoring-es-hot-0] publish_address {192.168.8.15:9300}, bound_addresses {0.0.0.0:9300}
[2021-12-06T12:25:00,694][INFO ][o.e.b.BootstrapChecks    ] [elk-monitoring-es-hot-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2021-12-06T12:25:00,705][INFO ][o.e.c.c.Coordinator      ] [elk-monitoring-es-hot-0] setting initial configuration to VotingConfiguration{jeGSzzywSl-XNaAVUKvfhQ}
[2021-12-06T12:25:00,822][INFO ][o.e.c.s.MasterService    ] [elk-monitoring-es-hot-0] elected-as-master ([1] nodes joined)[{elk-monitoring-es-hot-0}{jeGSzzywSl-XNaAVUKvfhQ}{jJgVZbYdQW-Rij1C-ge2rg}{192.168.8.15}{192.168.8.15:9300}{dim} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{elk-monitoring-es-hot-0}{jeGSzzywSl-XNaAVUKvfhQ}{jJgVZbYdQW-Rij1C-ge2rg}{192.168.8.15}{192.168.8.15:9300}{dim}]}
[2021-12-06T12:25:00,863][INFO ][o.e.c.c.CoordinationState] [elk-monitoring-es-hot-0] cluster UUID set to [dcDfpkGDQuu9H9bZdNGp3g]
[2021-12-06T12:25:00,890][INFO ][o.e.c.s.ClusterApplierService] [elk-monitoring-es-hot-0] master node changed {previous [], current [{elk-monitoring-es-hot-0}{jeGSzzywSl-XNaAVUKvfhQ}{jJgVZbYdQW-Rij1C-ge2rg}{192.168.8.15}{192.168.8.15:9300}{dim}]}, term: 1, version: 1, reason: Publication{term=1, version=1}
[2021-12-06T12:25:00,944][INFO ][o.e.h.AbstractHttpServerTransport] [elk-monitoring-es-hot-0] publish_address {elk-monitoring-es-hot-0.elk-monitoring-es-hot.prod-elk.svc/192.168.8.15:9200}, bound_addresses {0.0.0.0:9200}
[2021-12-06T12:25:00,945][INFO ][o.e.n.Node               ] [elk-monitoring-es-hot-0] started
[2021-12-06T12:25:01,028][INFO ][o.e.g.GatewayService     ] [elk-monitoring-es-hot-0] recovered [0] indices into cluster_state
[2021-12-06T12:25:01,207][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.ml-notifications-000002] for index patterns [.ml-notifications-000002]
[2021-12-06T12:25:01,282][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.ml-anomalies-] for index patterns [.ml-anomalies-*]
[2021-12-06T12:25:01,325][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.ml-stats] for index patterns [.ml-stats-*]
[2021-12-06T12:25:01,367][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.ml-state] for index patterns [.ml-state*]
[2021-12-06T12:25:01,410][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [logs-mappings]
[2021-12-06T12:25:01,453][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [synthetics-mappings]
[2021-12-06T12:25:01,493][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [metrics-settings]
[2021-12-06T12:25:01,531][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [synthetics-settings]
[2021-12-06T12:25:01,575][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [data-streams-mappings]
[2021-12-06T12:25:01,612][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [metrics-mappings]
[2021-12-06T12:25:01,647][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [logs-settings]
[2021-12-06T12:25:01,710][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.watch-history-13] for index patterns [.watcher-history-13*]
[2021-12-06T12:25:01,749][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [ilm-history] for index patterns [ilm-history-5*]
[2021-12-06T12:25:01,792][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.slm-history] for index patterns [.slm-history-5*]
[2021-12-06T12:25:01,830][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [.deprecation-indexing-settings]
[2021-12-06T12:25:01,871][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding component template [.deprecation-indexing-mappings]
[2021-12-06T12:25:01,914][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.monitoring-alerts-7] for index patterns [.monitoring-alerts-7]
[2021-12-06T12:25:01,973][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.monitoring-es] for index patterns [.monitoring-es-7-*]
[2021-12-06T12:25:02,015][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-7-*]
[2021-12-06T12:25:02,055][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-7-*]
[2021-12-06T12:25:02,099][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.monitoring-beats] for index patterns [.monitoring-beats-7-*]
[2021-12-06T12:25:02,140][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [synthetics] for index patterns [synthetics-*-*]
[2021-12-06T12:25:02,181][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [metrics] for index patterns [metrics-*-*]
[2021-12-06T12:25:02,220][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [logs] for index patterns [logs-*-*]
[2021-12-06T12:25:02,259][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding index template [.deprecation-indexing-template] for index patterns [.logs-deprecation.*]
[2021-12-06T12:25:02,299][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [ml-size-based-ilm-policy]
[2021-12-06T12:25:02,350][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [logs]
[2021-12-06T12:25:02,391][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [metrics]
[2021-12-06T12:25:02,425][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [synthetics]
[2021-12-06T12:25:02,460][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [watch-history-ilm-policy]
[2021-12-06T12:25:02,497][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [ilm-history-ilm-policy]
[2021-12-06T12:25:02,529][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [slm-history-ilm-policy]
[2021-12-06T12:25:02,565][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [.deprecation-indexing-ilm-policy]
[2021-12-06T12:25:02,601][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [.fleet-actions-results-ilm-policy]
[2021-12-06T12:25:02,687][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updating geoip databases
[2021-12-06T12:25:02,688][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] fetching geoip databases overview from [https://geoip.elastic.co/v1/database?elastic_geoip_service_tos=agree]
[2021-12-06T12:25:02,787][INFO ][o.e.l.LicenseService     ] [elk-monitoring-es-hot-0] license [6085deb3-74b2-4b29-8f0c-1d6135ab23a2] mode [basic] - valid
[2021-12-06T12:25:02,788][INFO ][o.e.x.s.a.Realms         ] [elk-monitoring-es-hot-0] license mode is [basic], currently licensed security realms are [reserved/reserved,file/file1,native/native1]
[2021-12-06T12:25:02,789][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [elk-monitoring-es-hot-0] Active license is now [BASIC]; Security is enabled
[2021-12-06T12:25:03,355][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updating geoip database [GeoLite2-ASN.mmdb]
[2021-12-06T12:25:03,682][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.geoip_databases] creating index, cause [auto(bulk api)], templates [], shards [1]/[0]
[2021-12-06T12:25:03,853][INFO ][o.e.c.r.a.AllocationService] [elk-monitoring-es-hot-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.geoip_databases][0]]]).
[2021-12-06T12:25:04,544][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] downloading geoip database [GeoLite2-ASN.mmdb] to [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ/GeoLite2-ASN.mmdb.tmp.gz]
[2021-12-06T12:25:04,561][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updated geoip database [GeoLite2-ASN.mmdb]
[2021-12-06T12:25:04,575][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updating geoip database [GeoLite2-City.mmdb]
[2021-12-06T12:25:04,753][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] successfully reloaded changed geoip database file [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ/GeoLite2-ASN.mmdb]
[2021-12-06T12:25:06,752][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] downloading geoip database [GeoLite2-City.mmdb] to [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ/GeoLite2-City.mmdb.tmp.gz]
[2021-12-06T12:25:06,765][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updated geoip database [GeoLite2-City.mmdb]
[2021-12-06T12:25:06,767][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updating geoip database [GeoLite2-Country.mmdb]
[2021-12-06T12:25:06,781][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [filebeat]
[2021-12-06T12:25:07,080][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [metricbeat]
[2021-12-06T12:25:07,237][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] downloading geoip database [GeoLite2-Country.mmdb] to [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ/GeoLite2-Country.mmdb.tmp.gz]
[2021-12-06T12:25:07,251][INFO ][o.e.i.g.GeoIpDownloader  ] [elk-monitoring-es-hot-0] updated geoip database [GeoLite2-Country.mmdb]
5 
[2021-12-06T12:25:07,347][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] successfully reloaded changed geoip database file [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ/GeoLite2-Country.mmdb]

[2021-12-06T12:25:07,713][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [metricbeat-7.15.0] for index patterns [metricbeat-7.15.0-*]

[2021-12-06T12:25:07,905][INFO ][o.e.i.g.DatabaseRegistry ] [elk-monitoring-es-hot-0] successfully reloaded changed geoip database file [/tmp/elasticsearch-13090359393462897359/geoip-databases/jeGSzzywSl-XNaAVUKvfhQ/GeoLite2-City.mmdb]

[2021-12-06T12:25:07,910][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [metricbeat-7.15.0-2021.12.06-000001] creating index, cause [api], templates [metricbeat-7.15.0], shards [1]/[1]

[2021-12-06T12:25:08,072][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [metricbeat-7.15.0-2021.12.06-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [metricbeat]

[2021-12-06T12:25:08,150][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [metricbeat-7.15.0-2021.12.06-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [metricbeat]

[2021-12-06T12:25:08,191][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [metricbeat-7.15.0-2021.12.06-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [metricbeat]

[2021-12-06T12:25:08,392][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [metricbeat-7.15.0-2021.12.06-000001/w2fTdJ4KRjuOF3CD0h61qg] update_mapping [_doc]

[2021-12-06T12:25:08,839][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [filebeat-7.15.0] for index patterns [filebeat-7.15.0-*]

[2021-12-06T12:25:08,929][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.ds-ilm-history-5-2021.12.06-000001] creating index, cause [initialize_data_stream], templates [ilm-history], shards [1]/[0]

[2021-12-06T12:25:08,932][INFO ][o.e.c.m.MetadataCreateDataStreamService] [elk-monitoring-es-hot-0] adding data stream [ilm-history-5] with write index [.ds-ilm-history-5-2021.12.06-000001], backing indices [], and aliases []

[2021-12-06T12:25:09,175][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [filebeat-7.15.0-2021.12.06-000001] creating index, cause [api], templates [filebeat-7.15.0], shards [1]/[1]

[2021-12-06T12:25:09,537][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [.ds-ilm-history-5-2021.12.06-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ilm-history-ilm-policy]

[2021-12-06T12:25:09,581][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.monitoring-es-7-mb-2021.12.06] creating index, cause [auto(bulk api)], templates [.monitoring-es], shards [1]/[0]

[2021-12-06T12:25:09,626][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [filebeat-7.15.0-2021.12.06-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [filebeat]

[2021-12-06T12:25:09,794][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [.ds-ilm-history-5-2021.12.06-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ilm-history-ilm-policy]

[2021-12-06T12:25:09,827][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [filebeat-7.15.0-2021.12.06-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [filebeat]

[2021-12-06T12:25:09,868][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [.ds-ilm-history-5-2021.12.06-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ilm-history-ilm-policy]

[2021-12-06T12:25:09,996][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [filebeat-7.15.0-2021.12.06-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [filebeat]

[2021-12-06T12:25:11,436][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [filebeat-7.15.0-2021.12.06-000001/BBQNEwRfQly6jGZuNmcHBw] update_mapping [_doc]

[2021-12-06T12:25:12,795][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [filebeat-7.15.0-2021.12.06-000001/BBQNEwRfQly6jGZuNmcHBw] update_mapping [_doc]

[2021-12-06T12:47:46,215][INFO ][o.e.x.s.a.f.FileUserPasswdStore] [elk-monitoring-es-hot-0] users file [/usr/share/elasticsearch/config/users] changed. updating users...

[2021-12-06T12:47:46,220][INFO ][o.e.x.s.a.f.FileUserRolesStore] [elk-monitoring-es-hot-0] users roles file [/usr/share/elasticsearch/config/users_roles] changed. updating users roles...

[2021-12-06T12:47:46,232][INFO ][o.e.x.s.a.s.FileRolesStore] [elk-monitoring-es-hot-0] parsed [48] roles from file [/usr/share/elasticsearch/config/roles.yml]

[2021-12-06T12:48:22,303][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001] creating index, cause [api], templates [], shards [1]/[1]

[2021-12-06T12:48:22,305][INFO ][o.e.c.r.a.AllocationService] [elk-monitoring-es-hot-0] updating number_of_replicas to [0] for indices [.kibana_7.15.0_001]

[2021-12-06T12:48:22,571][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [filebeat-7.15.0-2021.12.06-000001/BBQNEwRfQly6jGZuNmcHBw] update_mapping [_doc]

[2021-12-06T12:48:22,805][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.kibana_task_manager_7.15.0_001] creating index, cause [api], templates [], shards [1]/[1]

[2021-12-06T12:48:22,806][INFO ][o.e.c.r.a.AllocationService] [elk-monitoring-es-hot-0] updating number_of_replicas to [0] for indices [.kibana_task_manager_7.15.0_001]

[2021-12-06T12:48:26,182][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001/aeXzwFSRQNq2UJvWyoCS3A] update_mapping [_doc]

[2021-12-06T12:48:26,230][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_task_manager_7.15.0_001/Qmk9fblXRw28vEt5mf5PYw] update_mapping [_doc]

[2021-12-06T12:48:26,296][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.apm-custom-link] creating index, cause [api], templates [], shards [1]/[1]

[2021-12-06T12:48:26,297][INFO ][o.e.c.r.a.AllocationService] [elk-monitoring-es-hot-0] updating number_of_replicas to [0] for indices [.apm-custom-link]

[2021-12-06T12:48:26,348][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.apm-agent-configuration] creating index, cause [api], templates [], shards [1]/[1]

[2021-12-06T12:48:26,349][INFO ][o.e.c.r.a.AllocationService] [elk-monitoring-es-hot-0] updating number_of_replicas to [0] for indices [.apm-agent-configuration]

[2021-12-06T12:48:26,460][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [kibana-event-log-policy]

[2021-12-06T12:48:26,549][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.kibana_security_session_index_template_1] for index patterns [.kibana_security_session_1]

[2021-12-06T12:48:26,625][INFO ][o.e.c.m.MetadataIndexTemplateService] [elk-monitoring-es-hot-0] adding template [.kibana-event-log-7.15.0-template] for index patterns [.kibana-event-log-7.15.0-*]

[2021-12-06T12:48:26,709][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.kibana_security_session_1] creating index, cause [api], templates [.kibana_security_session_index_template_1], shards [1]/[0]

[2021-12-06T12:48:26,739][INFO ][o.e.x.s.s.SecurityIndexManager] [elk-monitoring-es-hot-0] security index does not exist, creating [.security-7] with alias [.security]

[2021-12-06T12:48:26,821][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.security-7] creating index, cause [api], templates [], shards [1]/[0]

[2021-12-06T12:48:26,873][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.kibana-event-log-7.15.0-000001] creating index, cause [api], templates [.kibana-event-log-7.15.0-template], shards [1]/[1]

[2021-12-06T12:48:26,874][INFO ][o.e.c.r.a.AllocationService] [elk-monitoring-es-hot-0] updating number_of_replicas to [0] for indices [.kibana-event-log-7.15.0-000001]

[2021-12-06T12:48:27,018][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001/aeXzwFSRQNq2UJvWyoCS3A] update_mapping [_doc]

[2021-12-06T12:48:27,026][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001/aeXzwFSRQNq2UJvWyoCS3A] update_mapping [_doc]

[2021-12-06T12:48:27,106][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [.kibana-event-log-7.15.0-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [kibana-event-log-policy]

[2021-12-06T12:48:27,143][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [.kibana-event-log-7.15.0-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [kibana-event-log-policy]

[2021-12-06T12:48:27,175][INFO ][o.e.x.i.IndexLifecycleTransition] [elk-monitoring-es-hot-0] moving index [.kibana-event-log-7.15.0-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [kibana-event-log-policy]

[2021-12-06T12:48:27,390][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk-monitoring-es-hot-0] adding index lifecycle policy [kibana-reporting]

[2021-12-06T12:48:29,109][INFO ][o.e.c.m.MetadataCreateIndexService] [elk-monitoring-es-hot-0] [.monitoring-kibana-7-mb-2021.12.06] creating index, cause [auto(bulk api)], templates [.monitoring-kibana], shards [1]/[0]

[2021-12-06T12:48:29,378][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001/aeXzwFSRQNq2UJvWyoCS3A] update_mapping [_doc]

[2021-12-06T12:53:26,784][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001/aeXzwFSRQNq2UJvWyoCS3A] update_mapping [_doc]

[2021-12-06T12:53:26,856][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [.kibana_7.15.0_001/aeXzwFSRQNq2UJvWyoCS3A] update_mapping [_doc]

[2021-12-06T12:53:34,061][INFO ][o.e.c.m.MetadataMappingService] [elk-monitoring-es-hot-0] [filebeat-7.15.0-2021.12.06-000001/BBQNEwRfQly6jGZuNmcHBw] update_mapping [_doc]
6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.