# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=111 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 112 --- ## [How to Configure ILm policy in logstash and elastic search](https://discuss.elastic.co/t/how-to-configure-ilm-policy-in-logstash-and-elastic-search/373469)
**Author:** [@Ramisetti\_Vamsi\_Kris](https://discuss.elastic.co/u/Ramisetti_Vamsi_Kris)\ **Replies:** 2\ **Last updated:** [January 22, 2025, 11:22am UTC](https://discuss.elastic.co/t/how-to-configure-ilm-policy-in-logstash-and-elastic-search/373469 "2025-01-22T11:22:47Z")
Hey i am facing some issue with configuring ILM policy in Elasticsearch. While configuring the ilm policy i am facing rollover issues. Can you give me the implementation of ilm policy configuration in logstash and Elasti… --- ## [Oracle Integration in Elastic](https://discuss.elastic.co/t/oracle-integration-in-elastic/373492)
**Author:** [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\ **Replies:** 0\ **Last updated:** [January 22, 2025, 5:00am UTC](https://discuss.elastic.co/t/oracle-integration-in-elastic/373492 "2025-01-22T05:00:07Z")
Hi Team, During the Oracle Integration, i faced the below attached error. (upload://dyJsAvKaG9uFfCDyUxHDdPjoQuV.png) However, I have fixed it by using the below procedure and now getting the error as: Steps: Che… --- ## [Filebeat vs filebeat-oss](https://discuss.elastic.co/t/filebeat-vs-filebeat-oss/373464)
**Author:** [@Rihards](https://discuss.elastic.co/u/Rihards)\ **Replies:** 2\ **Last updated:** [January 22, 2025, 8:22am UTC](https://discuss.elastic.co/t/filebeat-vs-filebeat-oss/373464 "2025-01-22T08:22:22Z")
Is there any documentation on which functionality in filebeat is proprietary (Elastic-licensed)? As in, not included in filebeat-oss. filebeat on-disk (8.16.1, Linux) is 50+% bigger than filebeat-oss. Has anybody compa… --- ## [Issue with Elasticsearch Docker Deployment on Apple Silicon (M4 Processor, macOS 15.2)](https://discuss.elastic.co/t/issue-with-elasticsearch-docker-deployment-on-apple-silicon-m4-processor-macos-15-2/373214)
**Author:** [@deepflyz](https://discuss.elastic.co/u/deepflyz)\ **Replies:** 4\ **Last updated:** [January 22, 2025, 4:47am UTC](https://discuss.elastic.co/t/issue-with-elasticsearch-docker-deployment-on-apple-silicon-m4-processor-macos-15-2/373214 "2025-01-22T04:47:31Z")
There is a current issue with deploying Elasticsearch via Docker on Mac computers equipped with Apple silicon (M4 processor) and running macOS 15.2. Here is the error log: 2025-01-15 11:55:22 # 2025-01-15 11:55:22 # A … --- ## [Metricbeat.yml's keepfiles max value is 90?](https://discuss.elastic.co/t/metricbeat-ymls-keepfiles-max-value-is-90/373433)
**Author:** [@xiaotiger](https://discuss.elastic.co/u/xiaotiger)\ **Replies:** 1\ **Last updated:** [January 22, 2025, 2:00am UTC](https://discuss.elastic.co/t/metricbeat-ymls-keepfiles-max-value-is-90/373433 "2025-01-22T02:00:51Z")
What is the maximum value of metricbeat.yml's keepfiles? --- ## [Elasticsearch java.lang.NullPointerException: null](https://discuss.elastic.co/t/elasticsearch-java-lang-nullpointerexception-null/373318)
**Author:** [@Mendiu](https://discuss.elastic.co/u/Mendiu)\ **Replies:** 3\ **Last updated:** [January 21, 2025, 9:06pm UTC](https://discuss.elastic.co/t/elasticsearch-java-lang-nullpointerexception-null/373318 "2025-01-21T21:06:16Z")
Hi after update from 7.17.13 -\> 7.17.18 Elastic v 7.17.18 Logstash 7.17.18 Java 11.0.18 I have err from logstash: logstash\[12445\]: \[2025-01-17T13:14:53,148\]\[ERROR\]\[logstash.outputs.elasticsearch\]\[main\]\[id\] Encounte… --- ## [ES|QL Visualization: Metric Format Title](https://discuss.elastic.co/t/es-ql-visualization-metric-format-title/373470)
**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\ **Replies:** 4\ **Last updated:** [January 21, 2025, 7:17pm UTC](https://discuss.elastic.co/t/es-ql-visualization-metric-format-title/373470 "2025-01-21T19:17:39Z")
Hello, I created a metric visualization using ES|QL. I was wondering if I am doing it wrong but I can't seem to format the name with spaces. FROM logs-\* | WHERE host.name IS NOT NULL | STATS count = COUNT(\*) BY host.na… --- ## [Integrate Elasticsearch with PostGres in nodejs app](https://discuss.elastic.co/t/integrate-elasticsearch-with-postgres-in-nodejs-app/359316)
**Author:** [@DubStep](https://discuss.elastic.co/u/DubStep)\ **Replies:** 5\ **Last updated:** [January 21, 2025, 6:23pm UTC](https://discuss.elastic.co/t/integrate-elasticsearch-with-postgres-in-nodejs-app/359316 "2025-01-21T18:23:31Z")
Hello! I'm kinda new to Elastic Search(I'm a noob in this particular technology) and I would like learn more about Elastic from the community. I'm building a nodejs app using PostGreSQL as the database and I want Elast… --- ## [Indices managed by Index Lifecycle Policy don't get deleted](https://discuss.elastic.co/t/indices-managed-by-index-lifecycle-policy-dont-get-deleted/373296)
**Author:** [@artschooldropout](https://discuss.elastic.co/u/artschooldropout)\ **Replies:** 10\ **Last updated:** [January 21, 2025, 3:21pm UTC](https://discuss.elastic.co/t/indices-managed-by-index-lifecycle-policy-dont-get-deleted/373296 "2025-01-21T15:21:59Z")
I'm using Filebeat to ingest network logs. I have an Index Lifecycle Policy that applies to all Filebeat indices\*. I have set the Delete Phase to move data into the phase when it's 30 days old. However, indices don't see… --- ## [Troubleshooting 502 Errors During Elasticsearch Indexing](https://discuss.elastic.co/t/troubleshooting-502-errors-during-elasticsearch-indexing/373450)
**Author:** [@Rayliotta](https://discuss.elastic.co/u/Rayliotta)\ **Replies:** 1\ **Last updated:** [January 21, 2025, 1:39pm UTC](https://discuss.elastic.co/t/troubleshooting-502-errors-during-elasticsearch-indexing/373450 "2025-01-21T13:39:11Z")
Hi I've been encountering 502 errors when attempting to index large documents. Has anyone else faced similar issues, and how did you troubleshoot and resolve them? I'm particularly interested in understanding potential … --- ## [Activate sso with keyclock](https://discuss.elastic.co/t/activate-sso-with-keyclock/373436)
**Author:** [@rezgui](https://discuss.elastic.co/u/rezgui)\ **Replies:** 0\ **Last updated:** [January 21, 2025, 9:23am UTC](https://discuss.elastic.co/t/activate-sso-with-keyclock/373436 "2025-01-21T09:23:07Z")
hello, in kibana i have many spaces with custom rule for eatch user. each user can acced only on his space throw his rule. the problem after activate sso with rule mapping ,the user connecte to all space throw the rule… --- ## [502 error when indexing a large (?) document](https://discuss.elastic.co/t/502-error-when-indexing-a-large-document/373209)
**Author:** [@catmanjan](https://discuss.elastic.co/u/catmanjan)\ **Replies:** 13\ **Last updated:** [January 21, 2025, 6:09am UTC](https://discuss.elastic.co/t/502-error-when-indexing-a-large-document/373209 "2025-01-21T06:09:03Z")
Hello I am having trouble diagnosing and resolving a large document upload issue... I'm using elasticsearch SaaS and there is a document which is approximately 42MB, when my software attempts to index it I get an error: … --- ## [Elastic Search Setup in Docker Swarm with xpack.security](https://discuss.elastic.co/t/elastic-search-setup-in-docker-swarm-with-xpack-security/373236)
**Author:** [@MarvinObert](https://discuss.elastic.co/u/MarvinObert)\ **Replies:** 1\ **Last updated:** [January 21, 2025, 2:42am UTC](https://discuss.elastic.co/t/elastic-search-setup-in-docker-swarm-with-xpack-security/373236 "2025-01-21T02:42:59Z")
Hi, I want to create an elastic with kibana and 3 nods. I have my docker compose which I use to setup the config in my docker swarm. On es01 I get the error: Caused by: org.elasticsearch.common.ssl.SslConfigException: … --- ## [Is there a way to return to the Kibana 8.16 interface?](https://discuss.elastic.co/t/is-there-a-way-to-return-to-the-kibana-8-16-interface/373420)
**Author:** [@iTiago](https://discuss.elastic.co/u/iTiago)\ **Replies:** 3\ **Last updated:** [January 20, 2025, 11:51pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-return-to-the-kibana-8-16-interface/373420 "2025-01-20T23:51:12Z")
Team, I have a question. Is there a way to return to the Kibana 8.16 interface? I updated my kibana to 8.17 and it has been somewhat cumbersome to locate us, elastic promises to be easy navigation but it has been a prob… --- ## [A huge number of Listblobs commands are being executed from filebeat to Azure Storage](https://discuss.elastic.co/t/a-huge-number-of-listblobs-commands-are-being-executed-from-filebeat-to-azure-storage/359772)
**Author:** [@syo04suke26](https://discuss.elastic.co/u/syo04suke26)\ **Replies:** 5\ **Last updated:** [January 20, 2025, 7:50pm UTC](https://discuss.elastic.co/t/a-huge-number-of-listblobs-commands-are-being-executed-from-filebeat-to-azure-storage/359772 "2025-01-20T19:50:19Z")
\[background\] I am building a data pipeline to visualize application logs using Elastic Stack. Application log files are stored as json format blob files on Azure Storage. The architecture overview is as follows. Appl… --- ## [Elasticsearch-Pyspark Problem](https://discuss.elastic.co/t/elasticsearch-pyspark-problem/372495)
**Author:** [@tmslara.a](https://discuss.elastic.co/u/tmslara.a)\ **Replies:** 2\ **Last updated:** [January 20, 2025, 6:48pm UTC](https://discuss.elastic.co/t/elasticsearch-pyspark-problem/372495 "2025-01-20T18:48:52Z")
Hello, I'm trying to connect PySpark with Elasticsearch so that I can manipulate Elasticsearch docs using PySpark. However, I'm currently facing issues when trying to retrieve documents. I've tried different approaches,… --- ## [Bulk indexing using logstash jdbc plugin](https://discuss.elastic.co/t/bulk-indexing-using-logstash-jdbc-plugin/373418)
**Author:** [@sandhya\_revuri](https://discuss.elastic.co/u/sandhya_revuri)\ **Replies:** 0\ **Last updated:** [January 20, 2025, 6:31pm UTC](https://discuss.elastic.co/t/bulk-indexing-using-logstash-jdbc-plugin/373418 "2025-01-20T18:31:29Z")
Hello, I'm indexing five years of data from MySQL to Elasticsearch using the Logstash JDBC plugin. My SQL query joins around 15 tables, yielding separate rows for each order\_item of an order. Issue 1: Delayed Aggregati… --- ## [Python bulk index update not indexing all documents](https://discuss.elastic.co/t/python-bulk-index-update-not-indexing-all-documents/361345)
**Author:** [@Mario\_Betterplace](https://discuss.elastic.co/u/Mario_Betterplace)\ **Replies:** 5\ **Last updated:** [January 20, 2025, 5:39pm UTC](https://discuss.elastic.co/t/python-bulk-index-update-not-indexing-all-documents/361345 "2025-01-20T17:39:23Z")
We're bulk indexing documents with this function: async def bulk\_update\_index(index: str, docs: dict\[str, dict\]): actions = \[ { "\_index": index, "\_op\_type": "index", "\_i… --- ## [Snapshot restore -- How to check how long the restore took?](https://discuss.elastic.co/t/snapshot-restore-how-to-check-how-long-the-restore-took/367071)
**Author:** [@Dave\_Houser](https://discuss.elastic.co/u/Dave_Houser)\ **Replies:** 6\ **Last updated:** [January 20, 2025, 4:05pm UTC](https://discuss.elastic.co/t/snapshot-restore-how-to-check-how-long-the-restore-took/367071 "2025-01-20T16:05:31Z")
I was able to restore a snapshot recently. Is there a way for Elastic / Kibana to show how long the restore took (Full time)? There does not appear to be a definitive way. I seemed to find two ways to find this data: … --- ## [Kibana Dashboard: Create line graph from a list of floats](https://discuss.elastic.co/t/kibana-dashboard-create-line-graph-from-a-list-of-floats/373131)
**Author:** [@Pasjonsfrukt](https://discuss.elastic.co/u/Pasjonsfrukt)\ **Replies:** 17\ **Last updated:** [January 20, 2025, 3:48pm UTC](https://discuss.elastic.co/t/kibana-dashboard-create-line-graph-from-a-list-of-floats/373131 "2025-01-20T15:48:06Z")
Hi, I have a list of floats that I am passing to ES/Kibana through the Python API. I am able to see the document in Discover, and the list is visible there as expected. Now, I want to create a graph that iterates over … --- ## [How to Make Vega Visualization Scrollable in Kibana Dashboard for All Data?](https://discuss.elastic.co/t/how-to-make-vega-visualization-scrollable-in-kibana-dashboard-for-all-data/373408)
**Author:** [@Yokesh\_GK](https://discuss.elastic.co/u/Yokesh_GK)\ **Replies:** 2\ **Last updated:** [January 20, 2025, 3:13pm UTC](https://discuss.elastic.co/t/how-to-make-vega-visualization-scrollable-in-kibana-dashboard-for-all-data/373408 "2025-01-20T15:13:04Z")
Hi everyone, I'm using Vega to create a table visualization in Kibana. The issue I'm facing is that the table only shows data up to the height of the visualization. If I expand the visualization panel, more rows become … --- ## [Kibana security must be enabled to use Fleet](https://discuss.elastic.co/t/kibana-security-must-be-enabled-to-use-fleet/372628)
**Author:** [@aalaskapedh](https://discuss.elastic.co/u/aalaskapedh)\ **Replies:** 1\ **Last updated:** [January 20, 2025, 3:11pm UTC](https://discuss.elastic.co/t/kibana-security-must-be-enabled-to-use-fleet/372628 "2025-01-20T15:11:38Z")
Dec 30 22:33:17 master kibana\[2375\]: \[2024-12-30T22:33:17.627+05:45\]\[INFO \] \[plugins.fleet.fleet\_authz\_router\] Kibana security must be enabled to use Fleet This is the error that I have been getting When I attempt t… --- ## [Fleet server cannot display offline elastic agent](https://discuss.elastic.co/t/fleet-server-cannot-display-offline-elastic-agent/373390)
**Author:** [@ym2011](https://discuss.elastic.co/u/ym2011)\ **Replies:** 2\ **Last updated:** [January 20, 2025, 3:02pm UTC](https://discuss.elastic.co/t/fleet-server-cannot-display-offline-elastic-agent/373390 "2025-01-20T15:02:43Z")
The versions both of elasticsearch, kibana, elastic -agent and fleet server are 8.16.1. The fleet server in kibana warn：\_hit$\_source4.components.map is not a function when i check the offline agent. what is the prob… --- ## [Logstah doesn't split log into separate fields in elastic index](https://discuss.elastic.co/t/logstah-doesnt-split-log-into-separate-fields-in-elastic-index/373049)
**Author:** [@andp](https://discuss.elastic.co/u/andp)\ **Replies:** 4\ **Last updated:** [January 20, 2025, 1:38pm UTC](https://discuss.elastic.co/t/logstah-doesnt-split-log-into-separate-fields-in-elastic-index/373049 "2025-01-20T13:38:50Z")
Hi everyone! I am trying to import logs to elastic index using Filebeat and Logstah. The index is created but whole log line is present in one field message. For start I'm trying to separate datetime to a separate … --- ## [Applying ml jobs on raw data without installing network packet beats or other beats](https://discuss.elastic.co/t/applying-ml-jobs-on-raw-data-without-installing-network-packet-beats-or-other-beats/373402)
**Author:** [@Snow](https://discuss.elastic.co/u/Snow)\ **Replies:** 0\ **Last updated:** [January 20, 2025, 12:47pm UTC](https://discuss.elastic.co/t/applying-ml-jobs-on-raw-data-without-installing-network-packet-beats-or-other-beats/373402 "2025-01-20T12:47:21Z")
I have forwarded my raw log to elastic (custom udp integration), i have not installed beats(eg: packetbeat and other). I could see some of rules like below, DNS Tunneling "query": { "bool": { "filter": \[ { "term":… --- ## [Full file snapshot ingest](https://discuss.elastic.co/t/full-file-snapshot-ingest/373399)
**Author:** [@catn0b0t](https://discuss.elastic.co/u/catn0b0t)\ **Replies:** 0\ **Last updated:** [January 20, 2025, 11:16am UTC](https://discuss.elastic.co/t/full-file-snapshot-ingest/373399 "2025-01-20T11:16:32Z")
We have a case where we want to monitor a specific file on a lot of hosts enrolled in our fleet and we want to read the entire file every time it changes. Currently we are struggling with the custom log ingest since it i… --- ## [Where can I find the traffic filtering rejection logs?](https://discuss.elastic.co/t/where-can-i-find-the-traffic-filtering-rejection-logs/373389)
**Author:** [@Richard\_Zhang](https://discuss.elastic.co/u/Richard_Zhang)\ **Replies:** 0\ **Last updated:** [January 20, 2025, 8:46am UTC](https://discuss.elastic.co/t/where-can-i-find-the-traffic-filtering-rejection-logs/373389 "2025-01-20T08:46:59Z")
Hi everyone, As per official document, if a request to ES is rejected by traffic filter rules, they will be included in proxy logs. Can anyone help guide me where I can find these logs? I'm not sure what the proxy logs … --- ## [Elastic search refuses to start after update](https://discuss.elastic.co/t/elastic-search-refuses-to-start-after-update/373394)
**Author:** [@masara](https://discuss.elastic.co/u/masara)\ **Replies:** 1\ **Last updated:** [January 20, 2025, 10:28am UTC](https://discuss.elastic.co/t/elastic-search-refuses-to-start-after-update/373394 "2025-01-20T10:28:43Z")
So downgraded my Elasticsearch to 7.17 for me to achieve the all in one deployment with wazuh which was i have been using all along until someone updated the server and in then update the server. I then regenerated th… --- ## [Slowlog differences between 8.17 and 7.17](https://discuss.elastic.co/t/slowlog-differences-between-8-17-and-7-17/373379)
**Author:** [@kpachar](https://discuss.elastic.co/u/kpachar)\ **Replies:** 1\ **Last updated:** [January 20, 2025, 8:52am UTC](https://discuss.elastic.co/t/slowlog-differences-between-8-17-and-7-17/373379 "2025-01-20T08:52:40Z")
Hello, The request shown below works fine on Elasticsearch 7.17 but fails on 8.17 (also on 8.10 that I tried) curl -X PUT "http://localhost:9200/my\_index3" -H 'Content-Type: application/json' -d' { "settings": { … --- ## [Cant Install Agent on Windows Machines But work on Linux](https://discuss.elastic.co/t/cant-install-agent-on-windows-machines-but-work-on-linux/373378)
**Author:** [@syed\_naqvi](https://discuss.elastic.co/u/syed_naqvi)\ **Replies:** 0\ **Last updated:** [January 20, 2025, 5:14am UTC](https://discuss.elastic.co/t/cant-install-agent-on-windows-machines-but-work-on-linux/373378 "2025-01-20T05:14:04Z")
Hi All ! I need help as tried many times and read blogs too. However facing an issue for installing Elastic agent though fleet on windows machines. It failes as log below . However same thing /policy worked on Linux mac… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=110) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=112)