# Latest **URL:** https://discuss.elastic.co/latest.md?page=1507 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1508 --- ## [How to manage data retention time in ElasticSearch](https://discuss.elastic.co/t/how-to-manage-data-retention-time-in-elasticsearch/282541)
**Author:** [@vp096](https://discuss.elastic.co/u/vp096)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 9:25am UTC](https://discuss.elastic.co/t/how-to-manage-data-retention-time-in-elasticsearch/282541 "2021-08-26T09:25:21Z")
Hello to all! I'm using Logastash to send syslog data to ElasticSearch and I'm browsing it using Kibana. I have 2 questions regarding log backup: I would like to keep this data for at least 1 year before it is deleted… --- ## [Stack monitoring page not loading](https://discuss.elastic.co/t/stack-monitoring-page-not-loading/282389)
**Author:** [@Ramalakshmi](https://discuss.elastic.co/u/Ramalakshmi)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 9:05am UTC](https://discuss.elastic.co/t/stack-monitoring-page-not-loading/282389 "2021-08-26T09:05:54Z")
Hi, Metricbeat beat installed in elasticsearch master nodes and enable the modules for elasticsearch but when opening the stack monitoring page it's not loading cluster info, Please help me out. Thank you --- ## [Logstash pipeline graceful shutdown: потеря in-memory данных?](https://discuss.elastic.co/t/logstash-pipeline-graceful-shutdown-in-memory/281978)
**Author:** [@ep4sh](https://discuss.elastic.co/u/ep4sh)\ **Replies:** 4\ **Last updated:** [August 26, 2021, 8:50am UTC](https://discuss.elastic.co/t/logstash-pipeline-graceful-shutdown-in-memory/281978 "2021-08-26T08:50:29Z")
Ребят всем привет! Подскажите у нас имеется Logstash версии 6.x (latest) который отправляет данные в Elasticsearch, он установлен на AWS ASG. Я пытаюсь понять, при терминировании инстанса ASG (ASG делает нечто вроде sh… --- ## [How to set the "MaxCallRecvMsgSize" of APM server?](https://discuss.elastic.co/t/how-to-set-the-maxcallrecvmsgsize-of-apm-server/282485)
**Author:** [@tttoad](https://discuss.elastic.co/u/tttoad)\ **Replies:** 5\ **Last updated:** [August 26, 2021, 8:16am UTC](https://discuss.elastic.co/t/how-to-set-the-maxcallrecvmsgsize-of-apm-server/282485 "2021-08-26T08:16:10Z")
openTelemetry: otlp/elastic rpc error: code = ResourceExhausted desc = grpc :received message larger than max (5454409 vs. 4194304) How to set the "MaxCallRecvMsgSize" of APM server? --- ## [Unable to install fleet server](https://discuss.elastic.co/t/unable-to-install-fleet-server/282481)
**Author:** [@geetika\_gopi](https://discuss.elastic.co/u/geetika_gopi)\ **Replies:** 1\ **Last updated:** [August 25, 2021, 1:17pm UTC](https://discuss.elastic.co/t/unable-to-install-fleet-server/282481 "2021-08-25T13:17:08Z")
Hi Everyone, I am trying to install fleet server on one of my elastic data nodes. However im facing this error. Could someone help me out please? ./elastic-agent install -f --fleet-server-es=https://xyz:9200 --fleet-se… --- ## [Set up error transaction percentage alert email](https://discuss.elastic.co/t/set-up-error-transaction-percentage-alert-email/282210)
**Author:** [@helloworld3112](https://discuss.elastic.co/u/helloworld3112)\ **Replies:** 3\ **Last updated:** [August 26, 2021, 7:56am UTC](https://discuss.elastic.co/t/set-up-error-transaction-percentage-alert-email/282210 "2021-08-26T07:56:07Z")
Hi all, I have data with the following structure: I need an alert email every 30 seconds to count the number of each Name have ErrorCode in list \[001, 002, 003\] and the percentage of each Name to the total (all of Er… --- ## [Kibana not ready error](https://discuss.elastic.co/t/kibana-not-ready-error/282531)
**Author:** [@Jedrick](https://discuss.elastic.co/u/Jedrick)\ **Replies:** 6\ **Last updated:** [August 26, 2021, 7:54am UTC](https://discuss.elastic.co/t/kibana-not-ready-error/282531 "2021-08-26T07:54:07Z")
Hi I would like to have an assistance about my Kibana. I'm currently building wazuh. But once I access in into the browser it says kibana isnot yet ready --- ## [ELK installation on windows](https://discuss.elastic.co/t/elk-installation-on-windows/282163)
**Author:** [@AbdulVaseem](https://discuss.elastic.co/u/AbdulVaseem)\ **Replies:** 3\ **Last updated:** [August 26, 2021, 7:14am UTC](https://discuss.elastic.co/t/elk-installation-on-windows/282163 "2021-08-26T07:14:22Z")
Hi, I am trying to install ELK on windows and having hard time to configure elasticsearch mapping to hostname or IP instead of localhost:9200 It is a fresh installation. I have updated the host file on the machine. My… --- ## [My Kibana dashboard shows " No Results found" for my system module of metricbeat](https://discuss.elastic.co/t/my-kibana-dashboard-shows-no-results-found-for-my-system-module-of-metricbeat/282205)
**Author:** [@Shubh\_Garg](https://discuss.elastic.co/u/Shubh_Garg)\ **Replies:** 2\ **Last updated:** [August 25, 2021, 12:37pm UTC](https://discuss.elastic.co/t/my-kibana-dashboard-shows-no-results-found-for-my-system-module-of-metricbeat/282205 "2021-08-25T12:37:08Z")
The kibana dashboard for system shows "No Result found" for all the fields that i have configured. Here is my system module config : # Module: system # Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.x/metric… --- ## [How to query private IP range in kibana?](https://discuss.elastic.co/t/how-to-query-private-ip-range-in-kibana/282532)
**Author:** [@111418](https://discuss.elastic.co/u/111418)\ **Replies:** 1\ **Last updated:** [August 26, 2021, 6:02am UTC](https://discuss.elastic.co/t/how-to-query-private-ip-range-in-kibana/282532 "2021-08-26T06:02:08Z")
I want to query sourceIP in private IP.For example: 10.0.0.0-10.255.255.255 or 172.16.0.0 – 172.31.255.255 or 192.168.0.0 – 192.168.255.255 But I user sourceIP:\[10.0.0.0 TO 10.255.255.255\] don't work.The sourceIP field… --- ## [Provide order of ids and retrieve docs in the provided order](https://discuss.elastic.co/t/provide-order-of-ids-and-retrieve-docs-in-the-provided-order/282535)
**Author:** [@voldemort02](https://discuss.elastic.co/u/voldemort02)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 5:52am UTC](https://discuss.elastic.co/t/provide-order-of-ids-and-retrieve-docs-in-the-provided-order/282535 "2021-08-26T05:52:17Z")
I have I have order of ids, \[1, 4, 2, 5\] and some filters { match: {...} } and I want the resulting documents to be returned in the order \[1, 4, 2, 5\]. What would be the best way to achieve this? Sample document: { … --- ## [Do not show results on page load](https://discuss.elastic.co/t/do-not-show-results-on-page-load/281975)
**Author:** [@anuragchoudhary01](https://discuss.elastic.co/u/anuragchoudhary01)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 5:31am UTC](https://discuss.elastic.co/t/do-not-show-results-on-page-load/281975 "2021-08-26T05:31:57Z")
Hi Team, Is there any flag that I need to set to not display the results during the page load? I am using search-ui. I need the search bar only when a page is loaded, only when a user puts certain text to the search ba… --- ## [Delete API for duplicate records](https://discuss.elastic.co/t/delete-api-for-duplicate-records/282438)
**Author:** [@onkark](https://discuss.elastic.co/u/onkark)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 5:02am UTC](https://discuss.elastic.co/t/delete-api-for-duplicate-records/282438 "2021-08-26T05:02:12Z")
I have documents with duplicate data say like Doc 1 :- { id : 1, empid : 1, name : Peter } Doc 2 :- { id : 2, empid : 2, name : Leo} Doc 3 :- { id : 1, empid : 1, name : Peter } Doc 4 :- { id : 3, empid : 3, name : D… --- ## [Kibana report not reading \_source](https://discuss.elastic.co/t/kibana-report-not-reading-source/281625)
**Author:** [@fidsamurai](https://discuss.elastic.co/u/fidsamurai)\ **Replies:** 10\ **Last updated:** [August 26, 2021, 3:40am UTC](https://discuss.elastic.co/t/kibana-report-not-reading-source/281625 "2021-08-26T03:40:56Z")
Hi Team, Kibana version 7.13.4. I've enabled read fields from \_source in Kibana advanced settings. Issue - I've saved a search in Kibana and tried to generate the CSV, however only the Timestamp has a value. \_source… --- ## [APM JAVA/NodeJS - Capture Body Request for Backend connections](https://discuss.elastic.co/t/apm-java-nodejs-capture-body-request-for-backend-connections/282506)
**Author:** [@Ramon\_Sanchez\_Villan](https://discuss.elastic.co/u/Ramon_Sanchez_Villan)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 3:12am UTC](https://discuss.elastic.co/t/apm-java-nodejs-capture-body-request-for-backend-connections/282506 "2021-08-26T03:12:08Z")
If you are asking about a problem you are experiencing, please use the following template, as it will help us help you. If you have a different problem, please delete all of this text :slight\_smile: TIP 1: select at lea… --- ## [Applying Elastic Common Scheman(ECS) in multi language environments](https://discuss.elastic.co/t/applying-elastic-common-scheman-ecs-in-multi-language-environments/282431)
**Author:** [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 1:31am UTC](https://discuss.elastic.co/t/applying-elastic-common-scheman-ecs-in-multi-language-environments/282431 "2021-08-26T01:31:08Z")
Hello, We are operating Filebeat on about 2,000 Machines and 2~30 K8S Clusters. Also we accept ECS as the structured logging format standard for our company. Currently, we applied ECS layout to services that are writt… --- ## [Problem downloading results that contain the # character](https://discuss.elastic.co/t/problem-downloading-results-that-contain-the-character/282520)
**Author:** [@Vince\_D](https://discuss.elastic.co/u/Vince_D)\ **Replies:** 5\ **Last updated:** [August 26, 2021, 1:03am UTC](https://discuss.elastic.co/t/problem-downloading-results-that-contain-the-character/282520 "2021-08-26T01:03:30Z")
I am having a problem downloading results obtained using the Kibana SQL Workbench. It appears that the downloaded file is truncated when a "#" character appears in the text. For example, here is the last record in the … --- ## [Blacklisting with Ruby Filter](https://discuss.elastic.co/t/blacklisting-with-ruby-filter/282517)
**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\ **Replies:** 2\ **Last updated:** [August 26, 2021, 12:28am UTC](https://discuss.elastic.co/t/blacklisting-with-ruby-filter/282517 "2021-08-26T00:28:47Z")
Hi, I'm looking to blacklist 1000+ nested fields. I've read in another forum that it's not possible to use the prune filter for nested filters, but I can with a ruby filter. I wanted to know is there a way to blacklist … --- ## [Cannot deploy functionbeat 7.14.0](https://discuss.elastic.co/t/cannot-deploy-functionbeat-7-14-0/282217)
**Author:** [@sproctor](https://discuss.elastic.co/u/sproctor)\ **Replies:** 4\ **Last updated:** [August 25, 2021, 10:52pm UTC](https://discuss.elastic.co/t/cannot-deploy-functionbeat-7-14-0/282217 "2021-08-25T22:52:16Z")
Did something change in the process needed to deploy functionbeat 7.14.0? I can deploy 7.13.4 fine. If I try to deploy 7.14.0, I get the following error: Function: st-cw-logs, could not deploy, error: bucket 'st-fb-dep… --- ## [Is there a guideline or any tips on linking Kibana to Power BI?](https://discuss.elastic.co/t/is-there-a-guideline-or-any-tips-on-linking-kibana-to-power-bi/282522)
**Author:** [@bailarch](https://discuss.elastic.co/u/bailarch)\ **Replies:** 1\ **Last updated:** [August 25, 2021, 10:37pm UTC](https://discuss.elastic.co/t/is-there-a-guideline-or-any-tips-on-linking-kibana-to-power-bi/282522 "2021-08-25T22:37:05Z")
Hello, I'm trying to connect Kibana with Power BI. I've looked into tutorials / guidelines that are I related to this matter but still couldn't figure out entirely. Can anyone please let me know any tips or guide me to… --- ## [Configure proxy for Elasticsearch](https://discuss.elastic.co/t/configure-proxy-for-elasticsearch/282479)
**Author:** [@etrpchevska](https://discuss.elastic.co/u/etrpchevska)\ **Replies:** 0\ **Last updated:** [August 25, 2021, 11:01am UTC](https://discuss.elastic.co/t/configure-proxy-for-elasticsearch/282479 "2021-08-25T11:01:22Z")
Hello! We have an Elasticsearch setup running in on-prem data center as a Kubernetes application. I would like to configure SAML realm for SSO login to the cluster and Kibana, but in order to get authenticated to the Id… --- ## [ILM Index Lifecycle Rolleover](https://discuss.elastic.co/t/ilm-index-lifecycle-rolleover/282493)
**Author:** [@selin](https://discuss.elastic.co/u/selin)\ **Replies:** 1\ **Last updated:** [August 25, 2021, 10:10pm UTC](https://discuss.elastic.co/t/ilm-index-lifecycle-rolleover/282493 "2021-08-25T22:10:26Z")
Hi friend i using index template. Please refer below myindex \<- alias myindex-20210825 \<- index My question is when it perofrm rolleover after few x gv what will be the name. will it be as belo… --- ## [Approx sizing for indexes and shard counts per data node](https://discuss.elastic.co/t/approx-sizing-for-indexes-and-shard-counts-per-data-node/282524)
**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\ **Replies:** 1\ **Last updated:** [August 25, 2021, 10:08pm UTC](https://discuss.elastic.co/t/approx-sizing-for-indexes-and-shard-counts-per-data-node/282524 "2021-08-25T22:08:45Z")
I know what I'm asking can be subjective but I'm wondering if I have say 5 data nodes with access to 29gb Ram in the JVM (64gb of physical ram), with 5 data nodes, what is the best way to estimate when I need to add a ne… --- ## [Impact of default indices refresh time on Bulk Indexing](https://discuss.elastic.co/t/impact-of-default-indices-refresh-time-on-bulk-indexing/282441)
**Author:** [@Pathak18](https://discuss.elastic.co/u/Pathak18)\ **Replies:** 8\ **Last updated:** [August 25, 2021, 10:05pm UTC](https://discuss.elastic.co/t/impact-of-default-indices-refresh-time-on-bulk-indexing/282441 "2021-08-25T22:05:21Z")
Hi Group, During Bulk Indexing, when the index.refresh\_interval defaults to 1sec and RefreshPolicy set to NONE. Query: In my case - Save Bulk Request runs in batches with 1k records in each batch. Out of 1k records, su… --- ## [Multi tenant architecture. multiple engines vs filter field](https://discuss.elastic.co/t/multi-tenant-architecture-multiple-engines-vs-filter-field/282403)
**Author:** [@gpribi](https://discuss.elastic.co/u/gpribi)\ **Replies:** 1\ **Last updated:** [August 25, 2021, 9:54pm UTC](https://discuss.elastic.co/t/multi-tenant-architecture-multiple-engines-vs-filter-field/282403 "2021-08-25T21:54:39Z")
I have a multi-tenant marketplace, consisting in up to 5 tenants, each one having 1M documents to be searched. What are the performance considerations between having 5 identical engines of 1M documents, or have 1 engine… --- ## [How to get only the average system metrics from Cloudwatch to Elasticsearch?](https://discuss.elastic.co/t/how-to-get-only-the-average-system-metrics-from-cloudwatch-to-elasticsearch/282488)
**Author:** [@missdoctor](https://discuss.elastic.co/u/missdoctor)\ **Replies:** 0\ **Last updated:** [August 25, 2021, 1:02pm UTC](https://discuss.elastic.co/t/how-to-get-only-the-average-system-metrics-from-cloudwatch-to-elasticsearch/282488 "2021-08-25T13:02:13Z")
Current setup: Cloudwatch collecting metrics from different namespaces and the data gets ingested to Elasticsearch. With the below configuration (i.e AWS/EC2 namespace, metric name: CPUUtilization) Cloudwatch is getting … --- ## [How can I create a table with fields from different index patterns?](https://discuss.elastic.co/t/how-can-i-create-a-table-with-fields-from-different-index-patterns/282424)
**Author:** [@Marcos\_K\_Minkoves](https://discuss.elastic.co/u/Marcos_K_Minkoves)\ **Replies:** 3\ **Last updated:** [August 25, 2021, 9:36pm UTC](https://discuss.elastic.co/t/how-can-i-create-a-table-with-fields-from-different-index-patterns/282424 "2021-08-25T21:36:13Z")
Hi, I'm trying to create a table that contains data from fields that are allocated in different index patterns. Whenever I try to drag and drop a field that belongs to a different index, the table resets and only show t… --- ## [Snapshot and restore](https://discuss.elastic.co/t/snapshot-and-restore/282516)
**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\ **Replies:** 2\ **Last updated:** [August 25, 2021, 9:15pm UTC](https://discuss.elastic.co/t/snapshot-and-restore/282516 "2021-08-25T21:15:10Z")
Hello all, As per the documentation about registering a snapshot repository, first, I am supposed to add following to elasticsearch.yml file. i understand that I can store backup on my network drive which would be th… --- ## [Best option for Displaying Metric with $ Value for YeartoDate, MonthtoDate in Dashboard](https://discuss.elastic.co/t/best-option-for-displaying-metric-with-value-for-yeartodate-monthtodate-in-dashboard/281863)
**Author:** [@Athul\_Devkar](https://discuss.elastic.co/u/Athul_Devkar)\ **Replies:** 3\ **Last updated:** [August 18, 2021, 7:36pm UTC](https://discuss.elastic.co/t/best-option-for-displaying-metric-with-value-for-yeartodate-monthtodate-in-dashboard/281863 "2021-08-18T19:36:11Z")
Dear All, I am trying to find the best option to display sum of $value for YtD, MtD and QtD in Dashboard. Tried multiple options. However, running in to some issues. Currently issues with these 2 options #1: Created … --- ## [Upgrading Elastic from 7.13.1 to 7.14](https://discuss.elastic.co/t/upgrading-elastic-from-7-13-1-to-7-14/282478)
**Author:** [@Ashwin\_Patil1](https://discuss.elastic.co/u/Ashwin_Patil1)\ **Replies:** 2\ **Last updated:** [August 25, 2021, 7:57pm UTC](https://discuss.elastic.co/t/upgrading-elastic-from-7-13-1-to-7-14/282478 "2021-08-25T19:57:45Z")
I am trying to upgrade elastic from 7.13.1 to 7.14.0 by following the steps in Rolling upgrades | Elasticsearch Guide \[7.14\] | Elastic I am getting the conflict error as follows localhost:~ # sudo rpm --install elastic… [Previous page](https://discuss.elastic.co/latest.md?page=1506) [Next page](https://discuss.elastic.co/latest.md?page=1508)