# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=695

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 696

---

## [Setting Time Filter to a default date](https://discuss.elastic.co/t/setting-time-filter-to-a-default-date/321494)

<div class="topic-metadata">

**Author:** [@Hasan](https://discuss.elastic.co/u/Hasan)\
**Replies:** 2\
**Last updated:** [December 19, 2022, 8:27am UTC](https://discuss.elastic.co/t/setting-time-filter-to-a-default-date/321494 "2022-12-19T08:27:47Z")

</div>

Hello, I have a dashboard which is querying data on the basis of Time Filter values. As my data consists of values more than a year so I want to set the Time Filter to past 12 months as a default value from 15 mins. Plea…

---

## [Index Lifecycle Management Metricbeat](https://discuss.elastic.co/t/index-lifecycle-management-metricbeat/318757)

<div class="topic-metadata">

**Author:** [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\
**Replies:** 20\
**Last updated:** [December 19, 2022, 8:03am UTC](https://discuss.elastic.co/t/index-lifecycle-management-metricbeat/318757 "2022-12-19T08:03:15Z")

</div>

Hi Team, I have metricbeat installed on my servers to send data to ES. I want to have daily indexes for each day. Along with this, I also want to delete the indexes after few days using ILM. I am attaching my metricbea…

---

## [Need help in kibana customization](https://discuss.elastic.co/t/need-help-in-kibana-customization/321524)

<div class="topic-metadata">

**Author:** [@Maneesha](https://discuss.elastic.co/u/Maneesha)\
**Replies:** 7\
**Last updated:** [December 19, 2022, 7:35am UTC](https://discuss.elastic.co/t/need-help-in-kibana-customization/321524 "2022-12-19T07:35:35Z")

</div>

Is it possible to add dashboard name (custom dashboard name) on top of search query and time filter instead of top bar Because we are hiding the top bar as per requirement. if we hide top bar then dashboard name also hi…

---

## [Elasticsearch Java API client about source filtering function](https://discuss.elastic.co/t/elasticsearch-java-api-client-about-source-filtering-function/321173)

<div class="topic-metadata">

**Author:** [@cchuang4](https://discuss.elastic.co/u/cchuang4)\
**Replies:** 2\
**Last updated:** [December 19, 2022, 7:05am UTC](https://discuss.elastic.co/t/elasticsearch-java-api-client-about-source-filtering-function/321173 "2022-12-19T07:05:10Z")

</div>

Hello, I would like to migrate from High Level rest Java to new java api client. I have old method using the source filtering feature in High level rest java, like sourceBuilder.fetchSource(includeFields, excludeFiel…

---

## [EFK missing geo\_point](https://discuss.elastic.co/t/efk-missing-geo-point/321445)

<div class="topic-metadata">

**Author:** [@khteh](https://discuss.elastic.co/u/khteh)\
**Replies:** 2\
**Last updated:** [December 19, 2022, 12:48am UTC](https://discuss.elastic.co/t/efk-missing-geo-point/321445 "2022-12-19T00:48:37Z")

</div>

I am running EFK using ECK 8.5.3. fluentd ConfigMap: @type geoip # Specify one or more geoip lookup field which has ip address (default: host) geoip\_lookup\_keys IP # Specify optional geoip datab…

---

## [Should i use the same elasticsearch p12 keystore and truststore for every node in the cluster?](https://discuss.elastic.co/t/should-i-use-the-same-elasticsearch-p12-keystore-and-truststore-for-every-node-in-the-cluster/321514)

<div class="topic-metadata">

**Author:** [@mikhatanu](https://discuss.elastic.co/u/mikhatanu)\
**Replies:** 3\
**Last updated:** [December 19, 2022, 6:05am UTC](https://discuss.elastic.co/t/should-i-use-the-same-elasticsearch-p12-keystore-and-truststore-for-every-node-in-the-cluster/321514 "2022-12-19T06:05:12Z")

</div>

Hello, i'm updating the ssl transport with an external CA (not generated by elastic). The documentation tells to use the same p12 keystore and truststore for ever node: Set up basic security for the Elastic Stack | Elas…

---

## [Index Lifecycle Management](https://discuss.elastic.co/t/index-lifecycle-management/321411)

<div class="topic-metadata">

**Author:** [@Pankhuri\_Gupta](https://discuss.elastic.co/u/Pankhuri_Gupta)\
**Replies:** 2\
**Last updated:** [December 19, 2022, 5:01am UTC](https://discuss.elastic.co/t/index-lifecycle-management/321411 "2022-12-19T05:01:32Z")

</div>

Hi Team, I am running a python script which is sending data to elasticsearch on daily basis and creates index datewise. I want to apply ILM policy of deletion for the indexes to be automatically deleted after 2days and …

---

## [Empty fields in Kibana if you ingest an index using python](https://discuss.elastic.co/t/empty-fields-in-kibana-if-you-ingest-an-index-using-python/321426)

<div class="topic-metadata">

**Author:** [@Shashank02](https://discuss.elastic.co/u/Shashank02)\
**Replies:** 2\
**Last updated:** [December 19, 2022, 5:31am UTC](https://discuss.elastic.co/t/empty-fields-in-kibana-if-you-ingest-an-index-using-python/321426 "2022-12-19T05:31:39Z")

</div>

I am pushing a CSV file in Elasticsearch using python with a change in mappings. The error that I'm facing is that the mappings are getting updated by ingesting the CSV through python but while creating the data view man…

---

## [Monitoring shards number](https://discuss.elastic.co/t/monitoring-shards-number/320621)

<div class="topic-metadata">

**Author:** [@waitangi](https://discuss.elastic.co/u/waitangi)\
**Replies:** 6\
**Last updated:** [December 19, 2022, 5:18am UTC](https://discuss.elastic.co/t/monitoring-shards-number/320621 "2022-12-19T05:18:31Z")

</div>

Hello My customer would like to monitor shards number on Elasticsearch node. He would like to recive email alerting that the limit is about to exceed max value. How to arrange that? As far as i know shards number is in…

---

## [Logs isn't showing in kibana](https://discuss.elastic.co/t/logs-isnt-showing-in-kibana/319250)

<div class="topic-metadata">

**Author:** [@SUNA](https://discuss.elastic.co/u/SUNA)\
**Replies:** 2\
**Last updated:** [November 21, 2022, 5:20am UTC](https://discuss.elastic.co/t/logs-isnt-showing-in-kibana/319250 "2022-11-21T05:20:03Z")

</div>

Dear Team, Due to certain server dependency problems, my Elk server recently crashed. To recover Elk, I used an old Elk snapshot of the server and updated all configuration settings for the new IP. unable to access the…

---

## [Could use some guidance on creating a proper setup with compose](https://discuss.elastic.co/t/could-use-some-guidance-on-creating-a-proper-setup-with-compose/321498)

<div class="topic-metadata">

**Author:** [@Matt\_Pruett](https://discuss.elastic.co/u/Matt_Pruett)\
**Replies:** 2\
**Last updated:** [December 18, 2022, 11:33pm UTC](https://discuss.elastic.co/t/could-use-some-guidance-on-creating-a-proper-setup-with-compose/321498 "2022-12-18T23:33:21Z")

</div>

I have been following the instructions at: Install Kibana with Docker | Kibana Guide \[8.5\] | Elastic I was able to get it all up and running according to these instructions without using compose. However upgrading then …

---

## [Amazon like search feature](https://discuss.elastic.co/t/amazon-like-search-feature/321458)

<div class="topic-metadata">

**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\
**Replies:** 1\
**Last updated:** [December 18, 2022, 10:54pm UTC](https://discuss.elastic.co/t/amazon-like-search-feature/321458 "2022-12-18T22:54:43Z")

</div>

I have a query about Elasticsearch text search use case and I couldn't find any article/blogs on it. I want to implement a feature (similar to Amazon.com) where user can type "tshirt below 500" and the searches would re…

---

## [Can not configure elastic search when running elasticsearch.bat](https://discuss.elastic.co/t/can-not-configure-elastic-search-when-running-elasticsearch-bat/321410)

<div class="topic-metadata">

**Author:** [@sezohessen](https://discuss.elastic.co/u/sezohessen)\
**Replies:** 2\
**Last updated:** [December 18, 2022, 10:51pm UTC](https://discuss.elastic.co/t/can-not-configure-elastic-search-when-running-elasticsearch-bat/321410 "2022-12-18T22:51:02Z")

</div>

warning: ignoring JAVA\_HOME=C:\\Program Files\\Java\\jdk-19.0.1; using bundled JDK Exception in thread "main" java.lang.RuntimeException: starting java failed with \[1\] output: error: Unrecognized VM option 'UseConcMarkS…

---

## [How to make kibana alerting send email content to add report？](https://discuss.elastic.co/t/how-to-make-kibana-alerting-send-email-content-to-add-report/321080)

<div class="topic-metadata">

**Author:** [@qiang\_tang](https://discuss.elastic.co/u/qiang_tang)\
**Replies:** 2\
**Last updated:** [December 18, 2022, 10:40pm UTC](https://discuss.elastic.co/t/how-to-make-kibana-alerting-send-email-content-to-add-report/321080 "2022-12-18T22:40:52Z")

</div>

How does kibana send the automatically generated report to my mailbox by email, my Elastic It is "Amazon OpenSearch Service". Only the alarm set in the "Alerting" function has the function of sending emails. Can I add a…

---

## [Does kibana watcher action supports painless script?](https://discuss.elastic.co/t/does-kibana-watcher-action-supports-painless-script/317408)

<div class="topic-metadata">

**Author:** [@niveditakathal](https://discuss.elastic.co/u/niveditakathal)\
**Replies:** 0\
**Last updated:** [October 25, 2022, 11:41am UTC](https://discuss.elastic.co/t/does-kibana-watcher-action-supports-painless-script/317408 "2022-10-25T11:41:37Z")

</div>

Hi Experts, Is it possible to write painless script mentioned below under kibana watcher action? I checked foreach example mentioned in elastic.co documentation; however, I am not sure if it supports inner loops. scri…

---

## [Timing Questions with Logstash pipelines v. API Data](https://discuss.elastic.co/t/timing-questions-with-logstash-pipelines-v-api-data/321235)

<div class="topic-metadata">

**Author:** [@Broken08](https://discuss.elastic.co/u/Broken08)\
**Replies:** 0\
**Last updated:** [December 14, 2022, 6:46pm UTC](https://discuss.elastic.co/t/timing-questions-with-logstash-pipelines-v-api-data/321235 "2022-12-14T18:46:27Z")

</div>

I have 9 logstash Pipelines that run to ingest data into ES. I was trying to do some math initially by taking the time the pipeline starts ingest (Looking at the \*.pipeline.log file looking at the time the query started…

---

## [Elasticsearch Authentication problem in python](https://discuss.elastic.co/t/elasticsearch-authentication-problem-in-python/321293)

<div class="topic-metadata">

**Author:** [@cristian.salcedo](https://discuss.elastic.co/u/cristian.salcedo)\
**Replies:** 1\
**Last updated:** [December 18, 2022, 10:35pm UTC](https://discuss.elastic.co/t/elasticsearch-authentication-problem-in-python/321293 "2022-12-18T22:35:35Z")

</div>

Hí, I am making an application to query elasticsearch and I get an error when launching the query: ElasticsearchWarning: The client is unable to verify that the server is Elasticsearch due security privileges on the se…

---

## [Can the sorting order of doc\_values arrays be controlled?](https://discuss.elastic.co/t/can-the-sorting-order-of-doc-values-arrays-be-controlled/321304)

<div class="topic-metadata">

**Author:** [@David\_Michael\_Gang](https://discuss.elastic.co/u/David_Michael_Gang)\
**Replies:** 1\
**Last updated:** [December 18, 2022, 10:33pm UTC](https://discuss.elastic.co/t/can-the-sorting-order-of-doc-values-arrays-be-controlled/321304 "2022-12-18T22:33:00Z")

</div>

As written in the documentation Doc values are the on-disk data structure, built at document index time, which makes this data access pattern possible. They store the same values as the \_source but in a column-oriented…

---

## [Filebeat AWS module ignore older](https://discuss.elastic.co/t/filebeat-aws-module-ignore-older/321391)

<div class="topic-metadata">

**Author:** [@infernalz2](https://discuss.elastic.co/u/infernalz2)\
**Replies:** 0\
**Last updated:** [December 16, 2022, 9:30am UTC](https://discuss.elastic.co/t/filebeat-aws-module-ignore-older/321391 "2022-12-16T09:30:39Z")

</div>

Hello, I am using Filebeat 7.16.2 with AWS module to download VPC flow logs to elastics from S3. Is there a way to make ignore older files/log. Everytime filebeat gets restarted it writes to elastic everything from the …

---

## [Grouping nested fileds instead of creating new fields](https://discuss.elastic.co/t/grouping-nested-fileds-instead-of-creating-new-fields/319373)

<div class="topic-metadata">

**Author:** [@mehdi\_hadeli](https://discuss.elastic.co/u/mehdi_hadeli)\
**Replies:** 0\
**Last updated:** [November 20, 2022, 7:42pm UTC](https://discuss.elastic.co/t/grouping-nested-fileds-instead-of-creating-new-fields/319373 "2022-11-20T19:42:42Z")

</div>

Hi, I used kibana and elastic v7.13.3, I want my nested fields put inner outer filed in json format instead of creating seperate field for each of them. { "fields.ExceptionDetail.ValidationResultModel.Errors.Message.k…

---

## [Is it possible to create multiple index with multiple folder name](https://discuss.elastic.co/t/is-it-possible-to-create-multiple-index-with-multiple-folder-name/321457)

<div class="topic-metadata">

**Author:** [@guhi\_rockky](https://discuss.elastic.co/u/guhi_rockky)\
**Replies:** 18\
**Last updated:** [December 18, 2022, 2:43pm UTC](https://discuss.elastic.co/t/is-it-possible-to-create-multiple-index-with-multiple-folder-name/321457 "2022-12-18T14:43:05Z")

</div>

Am monitoring logs files in different folders. I have 3 folders, folder1,folder2,folder3. Is it possible to Create different index name with name of folders using logstash.?

---

## [Paser logs with grok](https://discuss.elastic.co/t/paser-logs-with-grok/321446)

<div class="topic-metadata">

**Author:** [@CodeRed](https://discuss.elastic.co/u/CodeRed)\
**Replies:** 9\
**Last updated:** [December 18, 2022, 12:45pm UTC](https://discuss.elastic.co/t/paser-logs-with-grok/321446 "2022-12-18T12:45:28Z")

</div>

I'm researching about ELK for my company's monitoring work, with the passer log I'm wondering that will only add grok-patterns to the grok-patterns config file but can't be added via kibana, I have find out Qradar has a …

---

## [Existing "elastic" user credentials continue to function after upgrading elasticsearch?](https://discuss.elastic.co/t/existing-elastic-user-credentials-continue-to-function-after-upgrading-elasticsearch/317240)

<div class="topic-metadata">

**Author:** [@SUNA](https://discuss.elastic.co/u/SUNA)\
**Replies:** 2\
**Last updated:** [October 25, 2022, 5:05am UTC](https://discuss.elastic.co/t/existing-elastic-user-credentials-continue-to-function-after-upgrading-elasticsearch/317240 "2022-10-25T05:05:34Z")

</div>

Hello, Team. I understand that the elastic and kibana versions should be the same. Please verify. Additionally, confirm Existing "elastic" user credentials continue to work after elasticsearch is upgraded? Alternative…

---

## [Passing store procedure parameters using jdbc connector in the logstash conf file](https://discuss.elastic.co/t/passing-store-procedure-parameters-using-jdbc-connector-in-the-logstash-conf-file/321485)

<div class="topic-metadata">

**Author:** [@Kamal\_Hamzat](https://discuss.elastic.co/u/Kamal_Hamzat)\
**Replies:** 0\
**Last updated:** [December 18, 2022, 8:55am UTC](https://discuss.elastic.co/t/passing-store-procedure-parameters-using-jdbc-connector-in-the-logstash-conf-file/321485 "2022-12-18T08:55:06Z")

</div>

Hi all, How do I add store procedure parameters when using jdbc connector in the logstash conf file. Regards Kamal

---

## [The \`network.protocol: http\` returns nothing for packetbeat](https://discuss.elastic.co/t/the-network-protocol-http-returns-nothing-for-packetbeat/321471)

<div class="topic-metadata">

**Author:** [@learningelastic](https://discuss.elastic.co/u/learningelastic)\
**Replies:** 3\
**Last updated:** [December 18, 2022, 5:57am UTC](https://discuss.elastic.co/t/the-network-protocol-http-returns-nothing-for-packetbeat/321471 "2022-12-18T05:57:21Z")

</div>

I installed packetbeat on a server and have it publish event data to elasticsearch version 8.5 and kibana version 8.5. It seems to be working. I set up a simple Rest API on the server with packetbeat and made a few htt…

---

## [Graph in lens shows different value compared to graph in TSVB](https://discuss.elastic.co/t/graph-in-lens-shows-different-value-compared-to-graph-in-tsvb/321379)

<div class="topic-metadata">

**Author:** [@sixsenseninja](https://discuss.elastic.co/u/sixsenseninja)\
**Replies:** 6\
**Last updated:** [December 18, 2022, 3:04am UTC](https://discuss.elastic.co/t/graph-in-lens-shows-different-value-compared-to-graph-in-tsvb/321379 "2022-12-18T03:04:42Z")

</div>

I am creating to 2 graph, from two different graph type, tsvb and graph. Both datasets using same filter and aggregation but i realize that there is a noticeable gap between both graph. See image attached. Top graph show…

---

## [How to edit the query of a lens?](https://discuss.elastic.co/t/how-to-edit-the-query-of-a-lens/321467)

<div class="topic-metadata">

**Author:** [@learningelastic](https://discuss.elastic.co/u/learningelastic)\
**Replies:** 2\
**Last updated:** [December 18, 2022, 2:30am UTC](https://discuss.elastic.co/t/how-to-edit-the-query-of-a-lens/321467 "2022-12-18T02:30:54Z")

</div>

Packetbeat made this lens for me: But it's not clear to me what constructed the query under Inspect\>Requests\>Data\>Requests and how I am supposed to edit it, see this image: I looked through all the other panel se…

---

## [Logstach configuration for ealsticsearch cluster with multiple nodes](https://discuss.elastic.co/t/logstach-configuration-for-ealsticsearch-cluster-with-multiple-nodes/321469)

<div class="topic-metadata">

**Author:** [@SaM9](https://discuss.elastic.co/u/SaM9)\
**Replies:** 3\
**Last updated:** [December 17, 2022, 7:33pm UTC](https://discuss.elastic.co/t/logstach-configuration-for-ealsticsearch-cluster-with-multiple-nodes/321469 "2022-12-17T19:33:02Z")

</div>

In my ealstic stack I have 3 master node (dedicated master and 2 Eligible master ) my question is in my logstach configuration file in the output pluging what should I set as destination : the ip address of all the thr…

---

## [Why do I get empty buckets when I aggregate on nested field?](https://discuss.elastic.co/t/why-do-i-get-empty-buckets-when-i-aggregate-on-nested-field/321465)

<div class="topic-metadata">

**Author:** [@learningelastic](https://discuss.elastic.co/u/learningelastic)\
**Replies:** 0\
**Last updated:** [December 17, 2022, 5:23pm UTC](https://discuss.elastic.co/t/why-do-i-get-empty-buckets-when-i-aggregate-on-nested-field/321465 "2022-12-17T17:23:27Z")

</div>

I'm trying to count() the network.protocol field when grouped by network.protocol. So I tried something like this: GET .ds-packetbeat-8.5.3-2022.12.14-000001/\_search { "aggs": { "network": { "nested": { …

---

## [Detect ftp commands in ELK](https://discuss.elastic.co/t/detect-ftp-commands-in-elk/321461)

<div class="topic-metadata">

**Author:** [@raph3401](https://discuss.elastic.co/u/raph3401)\
**Replies:** 0\
**Last updated:** [December 17, 2022, 4:57pm UTC](https://discuss.elastic.co/t/detect-ftp-commands-in-elk/321461 "2022-12-17T16:57:19Z")

</div>

Hi all, I'm working on a school lab on the following scenario: a "hacker" got access to my ubuntu server (22.04), installed vsftpd and downloaded some files. I can see the ftp authentication and the traffic on port 21 …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=694)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=696)
