# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1111

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1112

---

## [Nested, flattened or object](https://discuss.elastic.co/t/nested-flattened-or-object/292974)

<div class="topic-metadata">

**Author:** [@ailengcon](https://discuss.elastic.co/u/ailengcon)\
**Replies:** 0\
**Last updated:** [December 27, 2021, 1:30pm UTC](https://discuss.elastic.co/t/nested-flattened-or-object/292974 "2021-12-27T13:30:19Z")

</div>

I am trying to figure out if I should use the datatype nested, flattened och object when using an index template to better map my index. I've got some large documents with some arrays and several objects within them. I …

---

## [TypeError : Cannot read properties of null ( reading time\_out)](https://discuss.elastic.co/t/typeerror-cannot-read-properties-of-null-reading-time-out/292864)

<div class="topic-metadata">

**Author:** [@Rahul\_Singh1](https://discuss.elastic.co/u/Rahul_Singh1)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 5:48pm UTC](https://discuss.elastic.co/t/typeerror-cannot-read-properties-of-null-reading-time-out/292864 "2021-12-29T17:48:06Z")

</div>

Hi everyone, @Badger Getting this error while searching and loading for data of indices in Kibana. TypeError : Cannot read properties of null ( reading timeout) . it is referring to response handle js files. Pls Sugg…

---

## [New third party certificate](https://discuss.elastic.co/t/new-third-party-certificate/292988)

<div class="topic-metadata">

**Author:** [@srkn66](https://discuss.elastic.co/u/srkn66)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 5:42pm UTC](https://discuss.elastic.co/t/new-third-party-certificate/292988 "2021-12-29T17:42:05Z")

</div>

I have a question. Today I created and configured new ceritificates for fleet, kibana and my nodes with letsencrypt, (previously it was Elasticsearch-cerutil). When I add the certificates in .yaml I get an authenticatio…

---

## [Elasticsearch as a database for Django](https://discuss.elastic.co/t/elasticsearch-as-a-database-for-django/293145)

<div class="topic-metadata">

**Author:** [@derekmizak](https://discuss.elastic.co/u/derekmizak)\
**Replies:** 0\
**Last updated:** [December 29, 2021, 5:35pm UTC](https://discuss.elastic.co/t/elasticsearch-as-a-database-for-django/293145 "2021-12-29T17:35:31Z")

</div>

I would like to explore possibility of using Elasticsearch as a backend database for Django. Did anyone had any experience with it? Can you recommend any resources? Basically I want to have forms in Django app where use…

---

## [Pb mix of indexes, using two or three conf file](https://discuss.elastic.co/t/pb-mix-of-indexes-using-two-or-three-conf-file/292999)

<div class="topic-metadata">

**Author:** [@Phildefer](https://discuss.elastic.co/u/Phildefer)\
**Replies:** 2\
**Last updated:** [December 29, 2021, 2:08pm UTC](https://discuss.elastic.co/t/pb-mix-of-indexes-using-two-or-three-conf-file/292999 "2021-12-29T14:08:30Z")

</div>

Hello, I have set up two logstach pipelines via two conf files. One is going to look for an rss feed and the other one for tweets. In both, I have a different index type variable to differentiate obviously the data colle…

---

## [Dynamic value substitution for date is NULL](https://discuss.elastic.co/t/dynamic-value-substitution-for-date-is-null/293144)

<div class="topic-metadata">

**Author:** [@4art4](https://discuss.elastic.co/u/4art4)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 5:07pm UTC](https://discuss.elastic.co/t/dynamic-value-substitution-for-date-is-null/293144 "2021-12-29T17:07:36Z")

</div>

To quote the docs: Writing to different indices: best practices You cannot use dynamic variable substitution when ilm\_enabled is true and when using ilm\_rollover\_alias. So what I think I want to do is make each new bat…

---

## [Elastic Search using Message Content Parse with Logstash](https://discuss.elastic.co/t/elastic-search-using-message-content-parse-with-logstash/293111)

<div class="topic-metadata">

**Author:** [@kiran\_tirumalasetti](https://discuss.elastic.co/u/kiran_tirumalasetti)\
**Replies:** 5\
**Last updated:** [December 29, 2021, 4:07pm UTC](https://discuss.elastic.co/t/elastic-search-using-message-content-parse-with-logstash/293111 "2021-12-29T16:07:25Z")

</div>

Hello, I am trying to push some data into Elasticsearch from an application via logstash and is there anyway to search/filter the json message in Elasticsearch for a particular field in the json message. I am using bel…

---

## [Upgrade Elasticserch single node cluster](https://discuss.elastic.co/t/upgrade-elasticserch-single-node-cluster/292858)

<div class="topic-metadata">

**Author:** [@Naga\_Prudhvi](https://discuss.elastic.co/u/Naga_Prudhvi)\
**Replies:** 3\
**Last updated:** [December 29, 2021, 3:33pm UTC](https://discuss.elastic.co/t/upgrade-elasticserch-single-node-cluster/292858 "2021-12-29T15:33:11Z")

</div>

How to upgrade a single node elasticserch cluster with out data loss

---

## [Fuzzy search doesn't return all available results](https://discuss.elastic.co/t/fuzzy-search-doesnt-return-all-available-results/292935)

<div class="topic-metadata">

**Author:** [@eladf](https://discuss.elastic.co/u/eladf)\
**Replies:** 11\
**Last updated:** [December 29, 2021, 3:25pm UTC](https://discuss.elastic.co/t/fuzzy-search-doesnt-return-all-available-results/292935 "2021-12-29T15:25:16Z")

</div>

Hi, I've been trying to use fuzziness in order to find typos for specific terms. My terms usually consist of a single word. Although there are thousands of possible results available that I'm aware of (fuzziness of 1 …

---

## [Using values from controls in string range filter](https://discuss.elastic.co/t/using-values-from-controls-in-string-range-filter/292725)

<div class="topic-metadata">

**Author:** [@Michael\_Ubry](https://discuss.elastic.co/u/Michael_Ubry)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 3:09pm UTC](https://discuss.elastic.co/t/using-values-from-controls-in-string-range-filter/292725 "2021-12-29T15:09:55Z")

</div>

Hi, I have column where are dates stored as string like this 20212, 20213,20214,20215….. Now I would like to have controls panel which consists of two dropdown menu FROM and TO, in which user would choose the range of …

---

## [How to parse additional kubernetes pods with json fomat logs?](https://discuss.elastic.co/t/how-to-parse-additional-kubernetes-pods-with-json-fomat-logs/293124)

<div class="topic-metadata">

**Author:** [@tarabhavi](https://discuss.elastic.co/u/tarabhavi)\
**Replies:** 0\
**Last updated:** [December 29, 2021, 1:45pm UTC](https://discuss.elastic.co/t/how-to-parse-additional-kubernetes-pods-with-json-fomat-logs/293124 "2021-12-29T13:45:11Z")

</div>

I have a ELK stack with Filebeat as an agent. Works great for collecting logs of existing pods. Here is the helm values for filebeat filebeatConfig: filebeat.yml: | logging.level: error filebeat.autodiscover:…

---

## [Logstash pipeline error](https://discuss.elastic.co/t/logstash-pipeline-error/293118)

<div class="topic-metadata">

**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\
**Replies:** 0\
**Last updated:** [December 29, 2021, 1:18pm UTC](https://discuss.elastic.co/t/logstash-pipeline-error/293118 "2021-12-29T13:18:54Z")

</div>

Hello team, I am getting following issuw on logstash side. can anyone help me. Error: \[2021-12-29T16:50:48,240\]\[ERROR\]\[logstash.agent \] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pip…

---

## [After installing a filter plugin with BouncyCastleFipsProvider, Logstash fails to start](https://discuss.elastic.co/t/after-installing-a-filter-plugin-with-bouncycastlefipsprovider-logstash-fails-to-start/293115)

<div class="topic-metadata">

**Author:** [@yon\_y](https://discuss.elastic.co/u/yon_y)\
**Replies:** 0\
**Last updated:** [December 29, 2021, 12:41pm UTC](https://discuss.elastic.co/t/after-installing-a-filter-plugin-with-bouncycastlefipsprovider-logstash-fails-to-start/293115 "2021-12-29T12:41:46Z")

</div>

I wrote a Java filter plugin, compiled it into a gem (after successfully unit-tests), installed it successfully to Logstash, but then Logstash fails to start. The problem is caused by a single line (when the line is remo…

---

## [Change long field format](https://discuss.elastic.co/t/change-long-field-format/293049)

<div class="topic-metadata">

**Author:** [@mangeshs](https://discuss.elastic.co/u/mangeshs)\
**Replies:** 3\
**Last updated:** [December 29, 2021, 12:24pm UTC](https://discuss.elastic.co/t/change-long-field-format/293049 "2021-12-29T12:24:18Z")

</div>

I have field called # user\_id\_s: 14,960,923,573 long as above name, value and type I want it should look like 14960923573 I try to change its type to string by mutate convert but not worked. I tried creating new s…

---

## [Kibana Pie Chart Issue Version 7.16](https://discuss.elastic.co/t/kibana-pie-chart-issue-version-7-16/293013)

<div class="topic-metadata">

**Author:** [@tanvi.sehgal](https://discuss.elastic.co/u/tanvi.sehgal)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 12:13pm UTC](https://discuss.elastic.co/t/kibana-pie-chart-issue-version-7-16/293013 "2021-12-29T12:13:35Z")

</div>

We have recently upgraded ELK from Version 7.5 to Version 7.16. After the version upgrade, facing some issue with the pie chart visualization. Earlier the pie chart's tooltip used to show the Custom Label defined for t…

---

## [How to process ResponseTimestamp-ClientIP-ReceivedTimestamp to show ReceivedTimestamp (23/Dec/2021:00:02:53 +0000) as @timestamp](https://discuss.elastic.co/t/how-to-process-responsetimestamp-clientip-receivedtimestamp-to-show-receivedtimestamp-23-dec-202102-53-0000-as-timestamp/293056)

<div class="topic-metadata">

**Author:** [@Melvin](https://discuss.elastic.co/u/Melvin)\
**Replies:** 4\
**Last updated:** [December 29, 2021, 10:36am UTC](https://discuss.elastic.co/t/how-to-process-responsetimestamp-clientip-receivedtimestamp-to-show-receivedtimestamp-23-dec-202102-53-0000-as-timestamp/293056 "2021-12-29T10:36:06Z")

</div>

Input example line in log: 2021-12-23T00:02:54.126Z 10.173.7.76 - - \[23/Dec/2021:00:02:53 +0000\] "POST /uri1/uri2?queryp=00-0A-12-34-56-78 HTTP/1.1" 403 2001 "-" "useragent" 0 \[500456\] Grok filter expression: filter {…

---

## [How to get an index rollover finished time](https://discuss.elastic.co/t/how-to-get-an-index-rollover-finished-time/292922)

<div class="topic-metadata">

**Author:** [@JohnPhilip](https://discuss.elastic.co/u/JohnPhilip)\
**Replies:** 5\
**Last updated:** [December 29, 2021, 10:28am UTC](https://discuss.elastic.co/t/how-to-get-an-index-rollover-finished-time/292922 "2021-12-29T10:28:53Z")

</div>

Hi, all, I want to know when does an index finished it's rollover action, is there any api to get this infomation? can \_ilm/explain show this info?

---

## [Elasticsearch 7.16.1 crashing randomly](https://discuss.elastic.co/t/elasticsearch-7-16-1-crashing-randomly/291827)

<div class="topic-metadata">

**Author:** [@ppuschmann](https://discuss.elastic.co/u/ppuschmann)\
**Replies:** 27\
**Last updated:** [December 29, 2021, 10:23am UTC](https://discuss.elastic.co/t/elasticsearch-7-16-1-crashing-randomly/291827 "2021-12-29T10:23:36Z")

</div>

Hi, after upgrading to Elasticsearch 7.16.1 (Debian-package from elastic.co), we're seeing some graver errors and crashes on some clusters: Instances are running with Debian Buster (10) \[2021-12-14T00:00:06,036\]\[ERRO…

---

## [Kibana server is not ready yet because upgrading elasticsearch](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-because-upgrading-elasticsearch/292646)

<div class="topic-metadata">

**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\
**Replies:** 12\
**Last updated:** [December 29, 2021, 10:12am UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-because-upgrading-elasticsearch/292646 "2021-12-29T10:12:46Z")

</div>

hi everyone i have a problem after i upgrade from 7.15.2 to 7.16.2 my kibana server is not ready yet. here' s the log i get \[root@bdi-uat-els elasticsearch\]# tail elasticsearch.log at org.elasticsearch.xpack.mo…

---

## [Incorrect/increasing elasticsearch count query after re-indexing!](https://discuss.elastic.co/t/incorrect-increasing-elasticsearch-count-query-after-re-indexing/293096)

<div class="topic-metadata">

**Author:** [@Ilia](https://discuss.elastic.co/u/Ilia)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 9:44am UTC](https://discuss.elastic.co/t/incorrect-increasing-elasticsearch-count-query-after-re-indexing/293096 "2021-12-29T09:44:06Z")

</div>

Some hours ago I've re-indexed one of my indices. The re-indexing process completed in about 2 hours and I've run the following query afterwards: GET myIndex/\_count { "query": { "bool": { "must": \[ {…

---

## [Self-managed Gold subscription infra required is 3-node with 64GB ram, 8 core cpu, 2TB ssd?](https://discuss.elastic.co/t/self-managed-gold-subscription-infra-required-is-3-node-with-64gb-ram-8-core-cpu-2tb-ssd/293090)

<div class="topic-metadata">

**Author:** [@Melvin](https://discuss.elastic.co/u/Melvin)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 7:18am UTC](https://discuss.elastic.co/t/self-managed-gold-subscription-infra-required-is-3-node-with-64gb-ram-8-core-cpu-2tb-ssd/293090 "2021-12-29T07:18:22Z")

</div>

Hi, Wanted to check with the community if there was a mistake in my understanding. I was told that Gold subscription is provided to self-managed instances only if the infra we have confirms to the following specs: 3 n…

---

## [Error while restarting elastic service when I add xpack.security.enabled: true to the .yml file](https://discuss.elastic.co/t/error-while-restarting-elastic-service-when-i-add-xpack-security-enabled-true-to-the-yml-file/292938)

<div class="topic-metadata">

**Author:** [@Ayoub\_Mouloua](https://discuss.elastic.co/u/Ayoub_Mouloua)\
**Replies:** 2\
**Last updated:** [December 29, 2021, 6:56am UTC](https://discuss.elastic.co/t/error-while-restarting-elastic-service-when-i-add-xpack-security-enabled-true-to-the-yml-file/292938 "2021-12-29T06:56:50Z")

</div>

Hello ppl, when I add xpack.security.enabled: true rule to .yml file and I restart the service using : sudo systemctl restart elasticsearch.service I got this error: Job for elasticsearch.service failed because the con…

---

## [Filebeat - Module Elasticsearch 7.16](https://discuss.elastic.co/t/filebeat-module-elasticsearch-7-16/293087)

<div class="topic-metadata">

**Author:** [@cmmourinho](https://discuss.elastic.co/u/cmmourinho)\
**Replies:** 0\
**Last updated:** [December 29, 2021, 5:49am UTC](https://discuss.elastic.co/t/filebeat-module-elasticsearch-7-16/293087 "2021-12-29T05:49:31Z")

</div>

version Fliebeat, elasticsearch 7.16.2 I use filebeat collect elasticsearch log to another cluster. when i configure var.paths in modules.d/elasticsearch.yml var.paths: \["/var/log/elasticsearch/\*\_server.json"\] f…

---

## [Enable http encryption on cluster](https://discuss.elastic.co/t/enable-http-encryption-on-cluster/293005)

<div class="topic-metadata">

**Author:** [@eh2021-elastic](https://discuss.elastic.co/u/eh2021-elastic)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 5:46am UTC](https://discuss.elastic.co/t/enable-http-encryption-on-cluster/293005 "2021-12-29T05:46:49Z")

</div>

I have an 8 node cluster running the basic license and is currently only configured with transport security. I am looking to enable http encryption on the cluster and the documentation mentions to shutdown all the nodes …

---

## [Setup elk 8 beta](https://discuss.elastic.co/t/setup-elk-8-beta/293022)

<div class="topic-metadata">

**Author:** [@swchandu](https://discuss.elastic.co/u/swchandu)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 5:43am UTC](https://discuss.elastic.co/t/setup-elk-8-beta/293022 "2021-12-29T05:43:21Z")

</div>

Hi, I have been using docker 8 alpha till now and wanted to try beta 1. I am surprised to see more secured options enabled for kibana while connecting to elastic. Did any one tried 8 beta 1? / share me the procedure t…

---

## [Sort After Aggregation](https://discuss.elastic.co/t/sort-after-aggregation/293081)

<div class="topic-metadata">

**Author:** [@aosrc](https://discuss.elastic.co/u/aosrc)\
**Replies:** 1\
**Last updated:** [December 29, 2021, 5:02am UTC](https://discuss.elastic.co/t/sort-after-aggregation/293081 "2021-12-29T05:02:09Z")

</div>

I need to aggregate by multi fields : \[srcMac, dstMac, srcIp, dstIp, srcPort, dstPort, protocol\], so I add a field "groupKey" and then aggregate by it. the mappings is: { "mappings": { "\_doc": { …

---

## [After deleting an index, a new one is created with invalid naming scheme](https://discuss.elastic.co/t/after-deleting-an-index-a-new-one-is-created-with-invalid-naming-scheme/292747)

<div class="topic-metadata">

**Author:** [@mdebord](https://discuss.elastic.co/u/mdebord)\
**Replies:** 6\
**Last updated:** [December 28, 2021, 9:21pm UTC](https://discuss.elastic.co/t/after-deleting-an-index-a-new-one-is-created-with-invalid-naming-scheme/292747 "2021-12-28T21:21:39Z")

</div>

Logstash 7.16.2 Elasticsearch 7.16.2 Summary In a scenario that beat processors are sending to logstash, and logstash has ilm configured, if the working index is deleted, a new one is created (as expected), but the n…

---

## [Unable to choose Fleet Agent Policy](https://discuss.elastic.co/t/unable-to-choose-fleet-agent-policy/292051)

<div class="topic-metadata">

**Author:** [@thedanielmatt](https://discuss.elastic.co/u/thedanielmatt)\
**Replies:** 3\
**Last updated:** [December 29, 2021, 3:48am UTC](https://discuss.elastic.co/t/unable-to-choose-fleet-agent-policy/292051 "2021-12-29T03:48:37Z")

</div>

Hello everyone, I'm trying to get a Fleet server set up on my on-premise stack for the first time. Server and Agent are RPM installed with version 7.16.1. When setting up the Fleet server, I am unable to select an Age…

---

## [\[ERROR\] logstash.filters.ruby](https://discuss.elastic.co/t/error-logstash-filters-ruby/291841)

<div class="topic-metadata">

**Author:** [@kyk](https://discuss.elastic.co/u/kyk)\
**Replies:** 4\
**Last updated:** [December 29, 2021, 3:14am UTC](https://discuss.elastic.co/t/error-logstash-filters-ruby/291841 "2021-12-29T03:14:16Z")

</div>

I have the next ruby code ruby { code =\> ' m = event.get("ip\_port").scan(/(\\d+.\\d+.\\d+.\\d+):(\\d+)-\>(\\d+.\\d+.\\d+.\\d+):(\\d+)/) w = ; x = ; y = ; z = m.each { |a| w \<\< a\[0\].to\_fo x \<\< a\[1\].to\_fo y \<\< a\[2\].to\_fo z \<…

---

## [Upload documenet/image as data into Elasticsearch](https://discuss.elastic.co/t/upload-documenet-image-as-data-into-elasticsearch/293058)

<div class="topic-metadata">

**Author:** [@Amisha\_Thakkar](https://discuss.elastic.co/u/Amisha_Thakkar)\
**Replies:** 3\
**Last updated:** [December 28, 2021, 11:38pm UTC](https://discuss.elastic.co/t/upload-documenet-image-as-data-into-elasticsearch/293058 "2021-12-28T23:38:37Z")

</div>

Hi Team, We would like to know if we can upload document/image as a data into Elasticsearch. And will it index the text which is there in that document/image. So that we can search the text present on that document/imag…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1110)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1112)
