Default index (.kibana) not created


(ajit) #41
Hi,
I have kibana logs also . Below is my kibana logs.

{"type":"log","@timestamp":"2018-06-14T10:44:02Z","tags":["status","plugin:kibana@6.2.4","info"],"pid":9724,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T10:44:02Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":9724,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T10:44:02Z","tags":["status","plugin:timelion@6.2.4","info"],"pid":9724,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T10:44:02Z","tags":["status","plugin:console@6.2.4","info"],"pid":9724,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T10:44:02Z","tags":["status","plugin:metrics@6.2.4","info"],"pid":9724,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T10:44:03Z","tags":["listening","info"],"pid":9724,"message":"Server running at http://MUMCHELK01:5601"}
{"type":"log","@timestamp":"2018-06-14T10:44:03Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":9724,"state":"green","message":"Status changed from yellow to green - Ready","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
{"type":"response","@timestamp":"2018-06-14T10:44:16Z","tags":[],"pid":9724,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"mumchelk01:5601","connection":"keep-alive","cache-control":"max-age=0","user-agent":"Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36","upgrade-insecure-requests":"1","accept":"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8","accept-encoding":"gzip, deflate","accept-language":"en-GB,en;q=0.9,en-US;q=0.8,fr;q=0.7"},"remoteAddress":"172.21.215.213","userAgent":"172.21.215.213"},"res":{"statusCode":200,"responseTime":243,"contentLength":9},"message":"GET /app/kibana 200 243ms - 9.0B"}
{"type":"response","@timestamp":"2018-06-14T10:44:17Z","tags":[],"pid":9724,"method":"get","statusCode":304,"req":{"url":"/bundles/commons.style.css?v=16627","method":"get","headers":{"host":"mumchelk01:5601","connection":"keep-alive","user-agent":"Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36","accept":"text/css,*/*;q=0.1","referer":"http://mumchelk01:5601/app/kibana","accept-encoding":"gzip, deflate","accept-language":"en-GB,en;q=0.9,en-US;q=0.8,fr;q=0.7","if-none-match":"\"ea62ddd75d8207d706d6a63e068d7165a5c58796-/bundles/-gzip\""},"remoteAddress":"172.21.215.213","userAgent":"172.21.215.213","referer":"http://mumchelk01:5601/app/kibana"},"res":{"statusCode":304,"responseTime":16,"contentLength":9},"message":"GET /bundles/commons.style.css?v=16627 304 16ms - 9.0B"}

(ajit) #42
My elasticsearch and kibana configuration is given below:

    elasticsearch.yml

    bootstrap.system_call_filter: false
    cluster.name: my-application
    network.host: MUMCHELK01

    kibana.yml

    elasticsearch.url: "http://MUMCHELK01:9200"
    elasticsearch.ssl.verificationMode: "none"
    logging.dest: /var/log/kibana/kibana.log
    server.port: 5601
    server.host: "MUMCHELK01"

(David Pilato) #43

Can you stop elasticsearch and Kibana?
Can you remove the existing logs?
Can you remove the data dir of elasticsearch? I guess you don't have any data yet anyway as per the elements you pasted.
And start again elasticsearch first. Wait a bit. Then start Kibana again.

And share all logs from both systems please.


(ajit) #44
Hi @Christian_Dahlqvist ,
This is only kibana logs. I have restarted both ES and kibana. And not done any transaction on browser. Just after restart logs.

{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:kibana@6.2.4","info"],"pid":10310,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":10310,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:timelion@6.2.4","info"],"pid":10310,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:console@6.2.4","info"],"pid":10310,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:metrics@6.2.4","info"],"pid":10310,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["listening","info"],"pid":10310,"message":"Server running at http://MUMCHELK01:5601"}
{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":10310,"state":"green","message":"Status changed from yellow to green - Ready","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}

(ajit) #45

Hi @Christian_Dahlqvist
Below is elasticsearch logs.

[2018-06-14T16:36:07,596][DEBUG][r.suppressed             ] path: /.kibana/_mappings, params: {index=.kibana}
org.elasticsearch.index.IndexNotFoundException: no such index
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.indexNotFoundException(IndexNameExpressionResolver.java:678) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:630) ~[elasticsearch-6.2.4.jar:6.2.4]

(ajit) #47
Yes Thanks for reply,
But after going to browser I am able to access kibana. Also it produces logs after going to home page of kibana.
See the logs after login to home page of kibana. After waiting for elasticsearch.

{"type":"log","@timestamp":"2018-06-14T11:02:35Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":10310,"state":"green","message":"Status changed from yellow to green - Ready","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}
{"type":"response","@timestamp":"2018-06-14T11:14:44Z","tags":[],"pid":10310,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"mumchelk01:5601","connection":"keep-alive","cache-control":"max-age=0","user-agent":"Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36","upgrade-insecure-requests":"1","accept":"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8","accept-encoding":"gzip, deflate","accept-language":"en-GB,en;q=0.9,en-US;q=0.8,fr;q=0.7"},"remoteAddress":"172.21.215.213","userAgent":"172.21.215.213"},"res":{"statusCode":200,"responseTime":331,"contentLength":9},"message":"GET /app/kibana 200 331ms - 9.0B"}
{"type":"response","@timestamp":"2018-06-14T11:14:44Z","tags":[],"pid":10310,"method":"get","statusCode":304,"req":{"url":"/bundles/vendors.style.css?v=16627","method":"get","headers":{"host":"mumchelk01:5601","connection":"keep-alive","user-agent

(David Pilato) #48

Please read:


(ajit) #49

Hi @dadoonet,
i have done all things According to your instructions and logs are given below-
ElasticSearch logs-

[2018-06-14T17:13:09,568][DEBUG][o.e.b.JarHell            ] java.class.path: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-memory-7.2.1.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-core-7.2.1.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-dataformat-cbor-2.8.10.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/securesm-1.2.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/hppc-0.7.1.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-cli-6.2.4.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/spatial4j-0.6.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-spatial-7.2.1.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/HdrHistogram-2.1.9.jar:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-sandbox-
[2018-06-14T17:13:09,596][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-spatial-extras-7.2.1.jar
[2018-06-14T17:13:09,597][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/log4j-core-2.9.1.jar
[2018-06-14T17:13:09,600][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jopt-simple-5.0.2.jar
[2018-06-14T17:13:09,600][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-join-7.2.1.jar
[2018-06-14T17:13:09,601][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-dataformat-smile-2.8.10.jar
[2018-06-14T17:13:09,601][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jna-4.5.1.jar
[2018-06-14T17:13:09,602][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/log4j-api-2.9.1.jar
[2018-06-14T17:13:09,603][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-misc-7.2.1.jar
[2018-06-14T17:13:09,603][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-6.2.4.jar
[2018-06-14T17:13:09,611][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/plugin-classloader-6.2.4.jar
[2018-06-14T17:13:09,612][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-core-6.2.4.jar
[2018-06-14T17:13:09,612][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-spatial3d-7.2.1.jar
[2018-06-14T17:13:09,613][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/joda-time-2.9.9.jar
[2018-06-14T17:13:09,614][DEBUG][o.e.b.JarHell            ] examining jar: 
[2018-06-14T17:13:09,624][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-core-2.8.10.jar
[2018-06-14T17:13:09,631][DEBUG][o.e.c.n.IfConfig         ] configuration:

lo
        inet 127.0.0.1 netmask:255.0.0.0 scope:host
        inet6 ::1 prefixlen:128 scope:host
        UP LOOPBACK mtu:65536 index:1

eth1
        inet 172.21.153.176 netmask:255.255.255.0 broadcast:172.21.153.255 scope:site
        inet6 fe80::250:56ff:fe9f:2105 prefixlen:64 scope:link
        hardware 00:50:56:9F:21:05
        UP MULTICAST mtu:1500 index:2

[2018-06-14T17:13:09,730][INFO ][o.e.n.Node               ] [] initializing ...
[2018-06-14T17:13:09,856][DEBUG][o.e.e.NodeEnvironment    ] [BgWFCG6] using node location [[NodePath{path=/opt/ElasticSearchKibana/elasticsearch-6.2.4/data/nodes/0,

(ajit) #50

Remainig lines of ElasticSearch logs.

  09,857][DEBUG][o.e.e.NodeEnvironment    ] [BgWFCG6] node data locations details:
     -> /opt/ElasticSearchKibana/elasticsearch-6.2.4/data/nodes/0, free_space [66.1gb], usable_space [56.3gb], total_space [191.8gb], mount [/opt (/dev/mapper/VG00-LV_OPT)], type [ext4]
    [2018-06-14T17:13:09,858][INFO ][o.e.e.NodeEnvironment    ] [BgWFCG6] heap size [989.8mb], compressed ordinary object pointers [true]
    [2018-06-14T17:13:09,861][INFO ][o.e.n.Node               ] node name [BgWFCG6] derived from node ID [BgWFCG6vSr6wymIKOJuotQ]; set [node.name] to override
    [2018-06-14T17:13:09,861][INFO ][o.e.n.Node               ] version[6.2.4], pid[11485], build[ccec39f/2018-04-12T20:37:28.497551Z], OS[Linux/2.6.32-696.23.1.el6.x86_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_111/25.111-b14]
    [2018-06-14T17:13:09,862][INFO ][o.e.n.Node               ] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.G4UCR6zi, -XX:+HeapDumpOnOutOfMemoryError, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/opt/ElasticSearchKibana/elasticsearch-6.2.4, -Des.path.conf=/opt/ElasticSearchKibana/elasticsearch-6.2.4/config]
    [2018-06-14T17:13:09,862][DEBUG][o.e.n.Node               ] using config [/opt/ElasticSearchKibana/elasticsearch-6.2.4/config], data [[/opt/ElasticSearchKibana/elasticsearch-6.2.4/data]], logs [/opt/ElasticSearchKibana/elasticsearch-6.2.4/logs], plugins [/opt/ElasticSearchKibana/elasticsearch-6.2.4/plugins]
    [2018-06-14T17:13:09,882][DEBUG][o.e.b.JarHell            ] java.home: /usr/java/jdk1.8.0_111/jre
    [2018-06-14T17:13:09,882][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/modules/repository-url/repository-url-6.2.4.jar
    [2018-06-14T17:13:09,884][DEBUG][o.e.b.JarHell            ] java.home: /usr/java/jdk1.8.0_111/jre
    [2018-06-14T17:13:09,884][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/log4j-core-2.9.1.jar
    [2018-06-14T17:13:09,886][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-grouping-7.2.1.jar
    [2018-06-14T17:13:09,887][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/t-digest-3.0.jar
    [2018-06-14T17:13:09,887][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/log4j-1.2-api-2.9.1.jar
    [2018-06-14T17:13:09,888][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-dataformat-smile-2.8.10.jar
    [2018-06-14T17:13:09,888][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-suggest-7.2.1.jar
    [2018-06-14T17:13:09,889][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-analyzers-common-7.2.1.jar
    [2018-06-14T17:13:09,890][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/HdrHistogram-2.1.9.jar
    [2018-06-14T17:13:09,891][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-memory-7.2.1.jar
    [2018-06-14T17:13:09,891][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-dataformat-cbor-2.8.10.jar
    [2018-06-14T17:13:09,891][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-core-7.2.1.jar
    [2018-06-14T17:13:09,894][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jts-1.13.jar
    [2018-06-14T17:13:09,894][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/joda-time-2.9.9.jar
    [2018-06-14T17:13:09,895][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-core-6.2.4.jar
    [2018-06-14T17:13:09,896][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-dataformat-yaml-2.8.10.jar
    [2018-06-14T17:13:09,896][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-core-2.8.10.jar
    [2018-06-14T17:13:09,897][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-queries-7.2.1.jar
    [2018-06-14T17:13:09,898][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/hppc-0.7.1.jar
    [2018-06-14T17:13:09,899][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/plugin-classloader-6.2.4.jar
    [2018-06-14T17:13:09,899][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-backward-codecs-7.2.1.jar
    [2018-06-14T17:13:09,900][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-6.2.4.jar
    [2018-06-14T17:13:09,906][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-sandbox-7.2.1.jar
    [2018-06-14T17:13:09,907][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-spatial3d-7.2.1.jar
    [2018-06-14T17:13:09,907][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/plugin-cli-6.2.4.jar
    [2018-06-14T17:13:09,908][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-misc-7.2.1.jar
    [2018-06-14T17:13:09,908][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/securesm-1.2.jar
    [2018-06-14T17:13:09,908][DEBUG][o.e.b.JarHell            ] examining jar:

(ajit) #51

Kibana logs.

{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["status","plugin:kibana@6.2.4","info"],"pid":11778,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":11778,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["status","plugin:timelion@6.2.4","info"],"pid":11778,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["status","plugin:console@6.2.4","info"],"pid":11778,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["status","plugin:metrics@6.2.4","info"],"pid":11778,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["listening","info"],"pid":11778,"message":"Server running at http://MUMCHELK01:5601"}
{"type":"log","@timestamp":"2018-06-14T11:54:11Z","tags":["status","plugin:elasticsearch@6.2.4","info"],"pid":11778,"state":"green","message":"Status changed from yellow to green - Ready","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"}

(ajit) #52
Hi @dadoonet,
After starting kibana,elasticsearch logs is:-


[2018-06-14T17:13:09,572][DEBUG][o.e.b.JarHell            ] classloader urls: [file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-memory-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-core-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-dataformat-cbor-2.8.10.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/securesm-1.2.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/hppc-0.7.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-cli-6.2.4.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/spatial4j-0.6.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-spatial-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/HdrHistogram-2.1.9.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-sandbox-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jts-1.13.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-6.2.4.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/plugin-classloader-6.2.4.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/elasticsearch-core-6.2.4.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-spatial3d-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/joda-time-2.9.9.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-backward-codecs-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/t-digest-3.0.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-analyzers-common-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-highlighter-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/lucene-suggest-7.2.1.jar, file:/opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-core-2.8.10.jar]
[2018-06-14T17:13:09,575][DEBUG][o.e.b.JarHell            ] java.home: /usr/java/jdk1.8.0_111/jre
[2018-06-14T17:13:09,589][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/securesm-1.2.jar
[2018-06-14T17:13:09,624][DEBUG][o.e.b.JarHell            ] examining jar: /opt/ElasticSearchKibana/elasticsearch-6.2.4/lib/jackson-core-2.8.10.jar
[2018-06-14T17:13:09,631][DEBUG][o.e.c.n.IfConfig         ] configuration:

lo
        inet 127.0.0.1 netmask:255.0.0.0 scope:host
        inet6 ::1 prefixlen:128 scope:host
        UP LOOPBACK mtu:65536 index:1

eth1
        inet 172.21.153.176 netmask:255.255.255.0 broadcast:172.21.153.255 scope:site
        inet6 fe80::250:56ff:fe9f:2105 prefixlen:64 scope:link
        hardware 00:50:56:9F:21:05
        UP MULTICAST mtu:1500 index:2

[2018-06-14T17:13:09,730][INFO ][o.e.n.Node               ] [] initializing ...
[2018-06-14T17:13:09,856][DEBUG][o.e.e.NodeEnvironment    ] [BgWFCG6] using node location [[NodePath{path=/opt/ElasticSearchKibana/elasticsearch-6.2.4/data/nodes/0, indicesPath=/opt/ElasticSearchKibana/elasticsearch-6.2.4/data/nodes/0/indices, fileStore=/opt (/dev/mapper/VG00-LV_OPT), majorDeviceNumber=253, minorDeviceNumber=2}]], local_lock_id [0]
[2018-06-14T17:13:09,857][DEBUG][o.e.e.NodeEnvironment    ] [BgWFCG6] node data locations details:
 -> /opt/ElasticSearchKibana/elasticsearch-6.2.4/data/nodes/0, free_space [66.1gb], usable_space [

org.elasticsearch.index.IndexNotFoundException: no such index
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.indexNotFoundException(IndexNameExpressionResolver.java:678) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:630) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.resolve(IndexNameExpressionResolver.java:586) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:164) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:143) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:76) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.action.admin.indices.mapping.get.TransportGetMappingsAction.checkBlock(TransportGetMappingsAction.java:62) ~[elasticsearch-6.2.4.jar:6.2.4]
	at org.elasticsearch.action.admin.indices.mapping.get.TransportGetMappingsAction.checkBlock(TransportGetMappingsAction.java:40) ~[elasticsearch-6.2.4.jar:6.2.4]

(ajit) #53

Hi @dadoonet,

i have share all logs(kibana logs and Elasticsearch logs both).
please see and help me out.


(David Pilato) #54

Sounds like you change the LOG Level. Could you revert that and start again from scratch?

If you still can't make it work, here is what I'm suggesting:

Download elasticsearch from the website
Download kibana from the website
Unzip both.
Do not modify anything and launch:

bin/elasticsearch
bin/kibana

And report how this goes.


(ajit) #55

Hi @dadoonet,

Actually here,there are some limitations of 7000 characters that's why i was remove some lines from the logs.

ok,i am going to do each and everything according to you then after i will update you


(David Pilato) #56

Share the full logs on gist.github.com and paste links here.


(ajit) #57

We will download new setups and reinstall it. Just want one confirmation, Is this issue not creation of index (.kibana) due to higher version.?


(ajit) #58

We are using 6.2.4 version.


(David Pilato) #59

I have been using 6.2.4 over the last months without any issue.
I just switched to 6.3.0 with no issue as well.


(ajit) #60

Yes, But .kibana index not getting created in my setup. Please help us to create .kibana default index.
I have given you all logs and configurations. Please provide solution on this issue.


(David Pilato) #61

Describe exactly all the steps you did. I mean every single command you typed on your local machine. And messages you got back.