# Latest **URL:** https://discuss.elastic.co/latest.md?page=1287 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1288 --- ## [Automatic heap sizing](https://discuss.elastic.co/t/automatic-heap-sizing/293386)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 9\ **Last updated:** [January 28, 2022, 10:03am UTC](https://discuss.elastic.co/t/automatic-heap-sizing/293386 "2022-01-28T10:03:46Z")
I'm testing the automatic heap size feature in 7.16.2. In a 12G VM I was specifying a 4G heap, I removed that setting, restarted Elasticsearch and it used 1G for heap. That seams small to me. Does it grow the heap if … --- ## [Pagination - re-indexing](https://discuss.elastic.co/t/pagination-re-indexing/295648)
**Author:** [@harsh19](https://discuss.elastic.co/u/harsh19)\ **Replies:** 3\ **Last updated:** [January 28, 2022, 10:03am UTC](https://discuss.elastic.co/t/pagination-re-indexing/295648 "2022-01-28T10:03:11Z")
I have question regarding pagination in Elasticsearch, let i have log record more then 10,000 so i am gone a do pagination on it, so main question is that -- is it required re-indexing when data is more then 10,000 ??? --- ## [Cannot add a Fleet server](https://discuss.elastic.co/t/cannot-add-a-fleet-server/295670)
**Author:** [@Billz1026](https://discuss.elastic.co/u/Billz1026)\ **Replies:** 2\ **Last updated:** [January 28, 2022, 9:38am UTC](https://discuss.elastic.co/t/cannot-add-a-fleet-server/295670 "2022-01-28T09:38:09Z")
Hi All, I am using Elastic Security feature for some time using beats applications to collect logs from the endpoints. Recently I tried to check the Elastic Agent feature and I encountered following issues when I tried … --- ## [Check for a dialog box during process](https://discuss.elastic.co/t/check-for-a-dialog-box-during-process/295363)
**Author:** [@Garry](https://discuss.elastic.co/u/Garry)\ **Replies:** 5\ **Last updated:** [January 28, 2022, 9:25am UTC](https://discuss.elastic.co/t/check-for-a-dialog-box-during-process/295363 "2022-01-28T09:25:21Z")
I have an application that, after login, may sometimes present a dialog box that you would click on an 'ok' button to remove. Other times the dialog box may not appear. Is their any method to check if the dialog box ap… --- ## [Aggregate multiple in logstash](https://discuss.elastic.co/t/aggregate-multiple-in-logstash/295602)
**Author:** [@marc0069urca](https://discuss.elastic.co/u/marc0069urca)\ **Replies:** 3\ **Last updated:** [January 28, 2022, 9:24am UTC](https://discuss.elastic.co/t/aggregate-multiple-in-logstash/295602 "2022-01-28T09:24:00Z")
Hello I am having trouble merging data from different SQL data tables. I can see that the data is saved in ELK as the different SQL entries are made but when arriving at the aggregation filter, it renames the fields we… --- ## [Optimising Kibana Indicator Match alert](https://discuss.elastic.co/t/optimising-kibana-indicator-match-alert/295668)
**Author:** [@pruttle](https://discuss.elastic.co/u/pruttle)\ **Replies:** 0\ **Last updated:** [January 28, 2022, 8:39am UTC](https://discuss.elastic.co/t/optimising-kibana-indicator-match-alert/295668 "2022-01-28T08:39:31Z")
Hi I am trying to alert against a large set of indices covered by the Indicator Index Pattern. These indices go back 3 years so there is a lot of data. When activated the alerting rule requires a lot of system resources… --- ## [Filebeat. "from kafka to kafka transfer"](https://discuss.elastic.co/t/filebeat-from-kafka-to-kafka-transfer/295342)
**Author:** [@faringot](https://discuss.elastic.co/u/faringot)\ **Replies:** 8\ **Last updated:** [January 28, 2022, 7:31am UTC](https://discuss.elastic.co/t/filebeat-from-kafka-to-kafka-transfer/295342 "2022-01-28T07:31:26Z")
Good day, I'm trying to set up data transfer from one Kafka to another using Filebeat. The current version does not work with SASL\_SSL and I have downloaded 8.0.0-rc1. Found a new error: "Exiting: module kafka is confi… --- ## [Reindex 2.4 to 5.6](https://discuss.elastic.co/t/reindex-2-4-to-5-6/295642)
**Author:** [@mario12](https://discuss.elastic.co/u/mario12)\ **Replies:** 7\ **Last updated:** [January 28, 2022, 7:17am UTC](https://discuss.elastic.co/t/reindex-2-4-to-5-6/295642 "2022-01-28T07:17:19Z")
We are in the process of re-indexing 2.4 to 5.6. During the re-indexing process the application is able to perform inserts/updates/delete operation to 2.4. So, we are planning to re-index again to copy the missing docume… --- ## [Apply ILM on rollup or transform index](https://discuss.elastic.co/t/apply-ilm-on-rollup-or-transform-index/294039)
**Author:** [@Achraf\_MENSI](https://discuss.elastic.co/u/Achraf_MENSI)\ **Replies:** 7\ **Last updated:** [January 28, 2022, 6:50am UTC](https://discuss.elastic.co/t/apply-ilm-on-rollup-or-transform-index/294039 "2022-01-28T06:50:59Z")
Hello, does anyone have successfully applied ILM on a transform or rollup index? or it's possible only with normal index? thanks --- ## [Display dynamic data in columns](https://discuss.elastic.co/t/display-dynamic-data-in-columns/294812)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 13\ **Last updated:** [January 28, 2022, 5:22am UTC](https://discuss.elastic.co/t/display-dynamic-data-in-columns/294812 "2022-01-28T05:22:18Z")
Hi all, In my project, the field names are dynamic as new indices keep getting pushed with different columns names. I cannot select a column name as they are not constant for all indices except time field and name fiel… --- ## [Logstash scheduling for every 5 mins hour using rss input](https://discuss.elastic.co/t/logstash-scheduling-for-every-5-mins-hour-using-rss-input/295544)
**Author:** [@saik1](https://discuss.elastic.co/u/saik1)\ **Replies:** 2\ **Last updated:** [January 28, 2022, 4:37am UTC](https://discuss.elastic.co/t/logstash-scheduling-for-every-5-mins-hour-using-rss-input/295544 "2022-01-28T04:37:42Z")
Hi, EveryOne, how can i schedule logstash for every 5mins using rss input? Regads kiran --- ## [日付ヒストグラムを週間隔にしたときに、開始を月曜日ではなく、他の曜日にできますか](https://discuss.elastic.co/t/topic/295006)
**Author:** [@chibivader](https://discuss.elastic.co/u/chibivader)\ **Replies:** 2\ **Last updated:** [January 28, 2022, 2:02am UTC](https://discuss.elastic.co/t/topic/295006 "2022-01-28T02:02:58Z")
kibanaでグラフを作成する際に、日付ヒストグラムで週間隔にすると、 月曜日から日曜日までの集計になります。 これを例えば、木曜日から水曜日までの集計にすることはできますでしょうか。 添付の図で言えば 2021-12-27から開始ではなく、2021-12-30から開始にしたいと思っています。 --- ## [Statically Extract Kibana Dashboard](https://discuss.elastic.co/t/statically-extract-kibana-dashboard/295631)
**Author:** [@nsimi](https://discuss.elastic.co/u/nsimi)\ **Replies:** 2\ **Last updated:** [January 28, 2022, 12:22am UTC](https://discuss.elastic.co/t/statically-extract-kibana-dashboard/295631 "2022-01-28T00:22:00Z")
Hello All, I have a dashboard that I would like to effectively export a snapshot of, and then host behind a CRM to people that don't have access to my Kibana and ES servers. Is there a good way to statically extract a d… --- ## [Questions about performance](https://discuss.elastic.co/t/questions-about-performance/295518)
**Author:** [@EnJay](https://discuss.elastic.co/u/EnJay)\ **Replies:** 5\ **Last updated:** [January 27, 2022, 11:26pm UTC](https://discuss.elastic.co/t/questions-about-performance/295518 "2022-01-27T23:26:04Z")
Hello dear community :hugs: Sorry for the possibly incorrect questions below. I'm just trying to learn the miracle of Elasticsearch :slight\_smile: I want to store ~10 billion records with data history of different cryp… --- ## [Not enough free space for cache file of size \[8757706752\] in path \[/usr/share/elasticsearch/data/nodes/0\]](https://discuss.elastic.co/t/not-enough-free-space-for-cache-file-of-size-8757706752-in-path-usr-share-elasticsearch-data-nodes-0/295612)
**Author:** [@chaishiqi](https://discuss.elastic.co/u/chaishiqi)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 10:24pm UTC](https://discuss.elastic.co/t/not-enough-free-space-for-cache-file-of-size-8757706752-in-path-usr-share-elasticsearch-data-nodes-0/295612 "2022-01-27T22:24:12Z")
I ran a container of frozen node with image tag 7.16.2,here is the Elasticsearch.yml cluster.name: "docker-cluster" network.host: 192.168.56.13 discovery.seed\_hosts: \["192.168.56.13", "192.168.56.12", "192.168.56.14"\] n… --- ## [Date range java api examples](https://discuss.elastic.co/t/date-range-java-api-examples/295505)
**Author:** [@nandan-g](https://discuss.elastic.co/u/nandan-g)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 8:02pm UTC](https://discuss.elastic.co/t/date-range-java-api-examples/295505 "2022-01-27T20:02:33Z")
Hi, I am trying to search the documents using a date range filter along with some keywords. I couldn't find any java api samples to do so. Could you please help me. Normal search works with the following code: But am af… --- ## [Configure highlighted part](https://discuss.elastic.co/t/configure-highlighted-part/295164)
**Author:** [@Pavel\_Maltsev](https://discuss.elastic.co/u/Pavel_Maltsev)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 10:14pm UTC](https://discuss.elastic.co/t/configure-highlighted-part/295164 "2022-01-27T22:14:01Z")
Main question The user is looking for a name and enters the part of it, let's say au, and the document with the text paul is found. I would like to have the doc highlighted like p\au\l. How can I achieve it if … --- ## [ECE fundamentals on demand accessing LAB URL prompted for username/password](https://discuss.elastic.co/t/ece-fundamentals-on-demand-accessing-lab-url-prompted-for-username-password/261232)
**Author:** [@RRE](https://discuss.elastic.co/u/RRE)\ **Replies:** 15\ **Last updated:** [January 27, 2022, 10:11pm UTC](https://discuss.elastic.co/t/ece-fundamentals-on-demand-accessing-lab-url-prompted-for-username-password/261232 "2022-01-27T22:11:01Z")
Hi, I am trying to access the public DNS for the lab of the ECE fundamentals and I am prompted for a username/password. Where can I find this? --- ## [Kibana privilige to save Timelines or Cases, but without maintaining Rules](https://discuss.elastic.co/t/kibana-privilige-to-save-timelines-or-cases-but-without-maintaining-rules/295562)
**Author:** [@filip.wozniak](https://discuss.elastic.co/u/filip.wozniak)\ **Replies:** 0\ **Last updated:** [January 27, 2022, 9:23am UTC](https://discuss.elastic.co/t/kibana-privilige-to-save-timelines-or-cases-but-without-maintaining-rules/295562 "2022-01-27T09:23:37Z")
Greetings! I would like to assign privilige to save Timelines or Cases, but in the same time users mustn't maintain rules (edit; turning off/on etc.). Is it possible? I've tried with privilige Kibana -\> Security -\> All … --- ## [Elastic Security inside Kibana periodically stops responding and requires a Kibana restart](https://discuss.elastic.co/t/elastic-security-inside-kibana-periodically-stops-responding-and-requires-a-kibana-restart/295273)
**Author:** [@kossde](https://discuss.elastic.co/u/kossde)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 9:31pm UTC](https://discuss.elastic.co/t/elastic-security-inside-kibana-periodically-stops-responding-and-requires-a-kibana-restart/295273 "2022-01-27T21:31:35Z")
We are on 7.13.2. At least once a day, access to Elastic Security breaks down. Other areas of Kibana continue to work (Dashboard, Dev tools, etc.) but the Security area loads to a blank screen. When I bring up Kibana… --- ## [Sequence numbers & indexing bottleneck](https://discuss.elastic.co/t/sequence-numbers-indexing-bottleneck/295614)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 9:07pm UTC](https://discuss.elastic.co/t/sequence-numbers-indexing-bottleneck/295614 "2022-01-27T21:07:48Z")
Hello, We are trying to debug a problem where indexing a document halts the ingestion pipeline on that particular shard Taking into account the way sequence numbers are implemented, do documents get processed sequentia… --- ## [Processor and memory utilization on RDS servers](https://discuss.elastic.co/t/processor-and-memory-utilization-on-rds-servers/295415)
**Author:** [@ARDiver86](https://discuss.elastic.co/u/ARDiver86)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 8:26pm UTC](https://discuss.elastic.co/t/processor-and-memory-utilization-on-rds-servers/295415 "2022-01-27T20:26:36Z")
We have recently started testing the endpoint product built in to Elastic and have noticed a considerable amount of CPU usage as well as higher memory utilization than one would expect. The CPU usage seems to mostly come… --- ## [Vega Visualization and custom data source](https://discuss.elastic.co/t/vega-visualization-and-custom-data-source/295502)
**Author:** [@tstadler](https://discuss.elastic.co/u/tstadler)\ **Replies:** 2\ **Last updated:** [January 27, 2022, 6:57pm UTC](https://discuss.elastic.co/t/vega-visualization-and-custom-data-source/295502 "2022-01-27T18:57:48Z")
Is there way to parse the selected time range or query to the data url in a Vega visualization if the data source is not Elasticsearch? e.g. { "$schema": "https://vega.github.io/schema/vega-lite/v5.json", "data… --- ## [Custom Metric For Drilldown Documents](https://discuss.elastic.co/t/custom-metric-for-drilldown-documents/295535)
**Author:** [@heshan](https://discuss.elastic.co/u/heshan)\ **Replies:** 5\ **Last updated:** [January 27, 2022, 6:50pm UTC](https://discuss.elastic.co/t/custom-metric-for-drilldown-documents/295535 "2022-01-27T18:50:56Z")
{ "index" : { } } {"BATCH\_ID": "2021-08-19 08:27:16", "ENV":"DEV","TEST\_CASE": "test\_case2", "COMPARISON": "POL", "OLD\_PURCHASE\_ORDER\_NUMBER": "ADDQYU5B", "NEW\_PURCHASE\_ORDER\_NUMBER":"100018718", "OLD\_OC\_NUMBER":"U0056A… --- ## [Deletion of old output files](https://discuss.elastic.co/t/deletion-of-old-output-files/295622)
**Author:** [@smzd](https://discuss.elastic.co/u/smzd)\ **Replies:** 0\ **Last updated:** [January 27, 2022, 6:45pm UTC](https://discuss.elastic.co/t/deletion-of-old-output-files/295622 "2022-01-27T18:45:15Z")
Hello, my logstash is outputing logs in files to then be ingested by elastic agent. In order to not have huge amount of disk being consumed by logs, I would like to rotate logs and then delete the old ones (after 3 day… --- ## [Index can not assign to a default ilm policy](https://discuss.elastic.co/t/index-can-not-assign-to-a-default-ilm-policy/295607)
**Author:** [@baalchina](https://discuss.elastic.co/u/baalchina)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 6:27pm UTC](https://discuss.elastic.co/t/index-can-not-assign-to-a-default-ilm-policy/295607 "2022-01-27T18:27:29Z")
Hi, I am using logstash to collect my switch's syslog. Here is the logstash config like: input{ syslog{ type =\> "syslog-sw-hw-128" host =\> "1.2.3.4" port =\> 580 } } output{ if \[type\]… --- ## [Logstash configuration](https://discuss.elastic.co/t/logstash-configuration/295423)
**Author:** [@puneet\_makhija](https://discuss.elastic.co/u/puneet_makhija)\ **Replies:** 12\ **Last updated:** [January 27, 2022, 4:26pm UTC](https://discuss.elastic.co/t/logstash-configuration/295423 "2022-01-27T16:26:22Z")
Hello everyone, I am stuck in log stash configuration here below is my configuration please let me know what is wrong in this configuration # Sample Logstash configuration for creating a simple # Beats -\> Logstash -\> … --- ## [Issue with index - set fielddata=true](https://discuss.elastic.co/t/issue-with-index-set-fielddata-true/295594)
**Author:** [@Penchev](https://discuss.elastic.co/u/Penchev)\ **Replies:** 1\ **Last updated:** [January 27, 2022, 4:05pm UTC](https://discuss.elastic.co/t/issue-with-index-set-fielddata-true/295594 "2022-01-27T16:05:40Z")
Hello, When working with my dashboards I got this error message: "Text fields are not optimised for operations that require per-document field data like aggregations and sorting, so these operations are disabled by de… --- ## [Elasticsearch-users tool with](https://discuss.elastic.co/t/elasticsearch-users-tool-with/295600)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 0\ **Last updated:** [January 27, 2022, 3:44pm UTC](https://discuss.elastic.co/t/elasticsearch-users-tool-with/295600 "2022-01-27T15:44:13Z")
Hey there, in order to create from scratch a cluster using also file realm, I would like to know if is it possible to integrate the elasticsearch-users tool usage with a pipeline executed via Jenkins/Ansible or Terrafor… --- ## [Log json in an array](https://discuss.elastic.co/t/log-json-in-an-array/295561)
**Author:** [@adouren](https://discuss.elastic.co/u/adouren)\ **Replies:** 6\ **Last updated:** [January 27, 2022, 3:20pm UTC](https://discuss.elastic.co/t/log-json-in-an-array/295561 "2022-01-27T15:20:47Z")
Hello, I am being asked to have the data as a table in kibana. I don't see what to do? My input json logs: {"indexName":"aaa-bbb","ip":"XXX.XXX.XXX.XXX","ipServer":"XXX.XXX.XXX.XXX","userAgent":"Mozilla/5.0 (Windows N… [Previous page](https://discuss.elastic.co/latest.md?page=1286) [Next page](https://discuss.elastic.co/latest.md?page=1288)