Nope, it's a self redirect and is working perfectly as intended on this part
We have 7,4k shards for 1.3Tb of indexed data by elasticsearch.
We need to define our Index Pattern filebeat-* in order to set it as default and use it for our visualisations and dashboard.
for what I'll do for now on, I will work around the nginx proxy and use kibana UI directly. I am using latest Firefox stable release.
NOTE: in the begining, when we had less data, filebeat-* Index Pattern was created successfully within seconds.
I have set discover.sampleSize to 50.
The first alarming issue comes in the first step of creating Index Pattern:
We should get @timestamp as a common time fields across all our data, yet Kibana isn't proposing it.
I hit Create Index Pattern anyway
Issue is less about the 401 response (which I got hitting Kibana directly without going through nginx) than the fact that the inex pattern creation stalls:
Here are the Kibana logs:
kibana | {"type":"response","@timestamp":"2020-09-24T14:29:35Z","tags":[],"pid":6,"method":"get","statusCode":200,"req":{"url":"/api/index_patterns/_fields_for_wildcard?pattern=filebeat-*&meta_fields=_source&meta_fields=_id&meta_fields=_type&meta_fields=_index&meta_fields=_score","method":"get","headers":{"host":"192.168.100.32:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:81.0) Gecko/20100101 Firefox/81.0","accept":"*/*","accept-language":"fr,fr-FR;q=0.8,en-US;q=0.5,en;q=0.3","accept-encoding":"gzip, deflate","referer":"http://192.168.100.32:5601/kibana/app/kibana","kbn-version":"7.4.0","content-type":"application/json","connection":"keep-alive","pragma":"no-cache","cache-control":"no-cache"},"remoteAddress":"172.16.14.171","userAgent":"172.16.14.171","referer":"http://192.168.100.32:5601/kibana/app/kibana"},"res":{"statusCode":200,"responseTime":582193,"contentLength":9},"message":"GET /api/index_patterns/_fields_for_wildcard?pattern=filebeat-*&meta_fields=_source&meta_fields=_id&meta_fields=_type&meta_fields=_index&meta_fields=_score 200 582193ms - 9.0B"}
kibana | {"type":"log","@timestamp":"2020-09-24T14:48:45Z","tags":["status","plugin:xpack_main@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from green to red - Request Timeout after 90000ms","prevState":"green","prevMsg":"Ready"}
kibana | {"type":"log","@timestamp":"2020-09-24T14:48:45Z","tags":["status","plugin:graph@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from green to red - Request Timeout after 90000ms","prevState":"green","prevMsg":"Ready"}
kibana | {"type":"log","@timestamp":"2020-09-24T14:48:45Z","tags":["status","plugin:spaces@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from green to red - Request Timeout after 90000ms","prevState":"green","prevMsg":"Ready"}
kibana | {"type":"log","@timestamp":"2020-09-24T14:48:45Z","tags":["status","plugin:searchprofiler@7.4.0","error"],"pid":6,"state":"red","message":"Status changed from green to red - Request Timeout after 90000ms","prevState":"green","prevMsg":"Ready"}
(..)
kibana | {"type":"response","@timestamp":"2020-09-24T15:07:48Z","tags":[],"pid":6,"method":"get","statusCode":200,"req":{"url":"/api/index_patterns/_fields_for_wildcard?pattern=filebeat-*&meta_fields=_source&meta_fields=_id&meta_fields=_type&meta_fields=_index&meta_fields=_score","method":"get","headers":{"host":"192.168.100.32:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:81.0) Gecko/20100101 Firefox/81.0","accept":"*/*","accept-language":"fr,fr-FR;q=0.8,en-US;q=0.5,en;q=0.3","accept-encoding":"gzip, deflate","referer":"http://192.168.100.32:5601/kibana/app/kibana","kbn-version":"7.4.0","content-type":"application/json","connection":"keep-alive","pragma":"no-cache","cache-control":"no-cache"},"remoteAddress":"172.16.14.171","userAgent":"172.16.14.171","referer":"http://192.168.100.32:5601/kibana/app/kibana"},"res":{"statusCode":200,"responseTime":568928,"contentLength":9},"message":"GET /api/index_patterns/_fields_for_wildcard?pattern=filebeat-*&meta_fields=_source&meta_fields=_id&meta_fields=_type&meta_fields=_index&meta_fields=_score 200 568928ms - 9.0B"}
kibana | {"type":"response","@timestamp":"2020-09-24T15:17:16Z","tags":[],"pid":6,"method":"get","statusCode":200,"req":{"url":"/api/index_patterns/_fields_for_wildcard?pattern=filebeat-*&meta_fields=_source&meta_fields=_id&meta_fields=_type&meta_fields=_index&meta_fields=_score","method":"get","headers":{"host":"192.168.100.32:5601","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:81.0) Gecko/20100101 Firefox/81.0","accept":"*/*","accept-language":"fr,fr-FR;q=0.8,en-US;q=0.5,en;q=0.3","accept-encoding":"gzip, deflate","referer":"http://192.168.100.32:5601/kibana/app/kibana","kbn-version":"7.4.0","content-type":"application/json","connection":"keep-alive","pragma":"no-cache","cache-control":"no-cache"},"remoteAddress":"172.16.14.171","userAgent":"172.16.14.171","referer":"http://192.168.100.32:5601/kibana/app/kibana"},"res":{"statusCode":200,"responseTime":575445,"contentLength":9},"message":"GET /api/index_patterns/_fields_for_wildcard?pattern=filebeat-*&meta_fields=_source&meta_fields=_id&meta_fields=_type&meta_fields=_index&meta_fields=_score 200 575445ms - 9.0B"}
