# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=323 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 324 --- ## [Storage on elastic search](https://discuss.elastic.co/t/storage-on-elastic-search/321996)
**Author:** [@mail2shanth](https://discuss.elastic.co/u/mail2shanth)\ **Replies:** 13\ **Last updated:** [December 26, 2022, 11:44pm UTC](https://discuss.elastic.co/t/storage-on-elastic-search/321996 "2022-12-26T23:44:30Z")
Hi, I am trying to build a benchmark on how much storage likely needed for Elasticsearch, below are some stats whenever I sent new records from logstash to Elasticsearch. I checked in Elasticsearch after every interval,… --- ## [It's not clear that it's not possible to access the \`ctx\['\_source'\]\` inside a function in a painless script](https://discuss.elastic.co/t/its-not-clear-that-its-not-possible-to-access-the-ctx-source-inside-a-function-in-a-painless-script/322013)
**Author:** [@RafaelAdao](https://discuss.elastic.co/u/RafaelAdao)\ **Replies:** 0\ **Last updated:** [December 26, 2022, 9:24pm UTC](https://discuss.elastic.co/t/its-not-clear-that-its-not-possible-to-access-the-ctx-source-inside-a-function-in-a-painless-script/322013 "2022-12-26T21:24:50Z")
It's not clear to me that it's not possible to access the ctx\['\_source'\] inside a function in a painless script. I looked in the documentation and couldn't find anything about it. Below is an example of the code I was t… --- ## [No system Metrics reported by \_cat/nodes](https://discuss.elastic.co/t/no-system-metrics-reported-by-cat-nodes/321969)
**Author:** [@ben75020](https://discuss.elastic.co/u/ben75020)\ **Replies:** 6\ **Last updated:** [December 26, 2022, 6:22pm UTC](https://discuss.elastic.co/t/no-system-metrics-reported-by-cat-nodes/321969 "2022-12-26T18:22:21Z")
Hello ! I'm a beginner and I might have missed something important. Elasticsearch is not returning any system metrics when I'm invoking the following command GET \_cat/nodes?v=true ip heap.percent ram.percent … --- ## [Elasticsearch config issue](https://discuss.elastic.co/t/elasticsearch-config-issue/321999)
**Author:** [@Lakshmi\_Kumari](https://discuss.elastic.co/u/Lakshmi_Kumari)\ **Replies:** 2\ **Last updated:** [December 26, 2022, 6:11pm UTC](https://discuss.elastic.co/t/elasticsearch-config-issue/321999 "2022-12-26T18:11:05Z")
Running a duplicate node for the first time in the server, getting below issue. \[ERROR\]\[o.e.b.Elasticsearch \] \[node-1\] fatal exception while booting Elasticsearch org.elasticsearch.http.BindHttpException: Failed to… --- ## [Entire data is not coming in watcher's PDF](https://discuss.elastic.co/t/entire-data-is-not-coming-in-watchers-pdf/322000)
**Author:** [@darshan\_folane](https://discuss.elastic.co/u/darshan_folane)\ **Replies:** 0\ **Last updated:** [December 26, 2022, 5:46pm UTC](https://discuss.elastic.co/t/entire-data-is-not-coming-in-watchers-pdf/322000 "2022-12-26T17:46:21Z")
Hello, I have set up a basic watcher which will generate a PDF every 10min, but when I get a PDF on my mail it is like only a screenshot of that dashboard, the entire data is not coming. In the dashboard, I have a tabl… --- ## [What happens when warm tier gets filled up?](https://discuss.elastic.co/t/what-happens-when-warm-tier-gets-filled-up/321975)
**Author:** [@darshan\_folane](https://discuss.elastic.co/u/darshan_folane)\ **Replies:** 3\ **Last updated:** [December 26, 2022, 5:27pm UTC](https://discuss.elastic.co/t/what-happens-when-warm-tier-gets-filled-up/321975 "2022-12-26T17:27:17Z")
Currently, I'm having three warm nodes, and ILM continuously ingesting data in warm nodes. Warm nodes is holding 85%, 80%, and 86% of the data, and data is continuously ingested. So what happens when the warm tier gets … --- ## [String to IP Convert](https://discuss.elastic.co/t/string-to-ip-convert/321984)
**Author:** [@nonameo](https://discuss.elastic.co/u/nonameo)\ **Replies:** 5\ **Last updated:** [December 26, 2022, 12:59pm UTC](https://discuss.elastic.co/t/string-to-ip-convert/321984 "2022-12-26T12:59:16Z")
Hi everyone, I have a problem converting the string field to IP datatype. I'm trying to convert via convert processor in the pipeline, also tried with the grok but nothing. How can I do that? Why the processors do not w… --- ## [Pagination issue on elasticsearch query result](https://discuss.elastic.co/t/pagination-issue-on-elasticsearch-query-result/321990)
**Author:** [@Manzoor\_Faisal](https://discuss.elastic.co/u/Manzoor_Faisal)\ **Replies:** 0\ **Last updated:** [December 26, 2022, 12:52pm UTC](https://discuss.elastic.co/t/pagination-issue-on-elasticsearch-query-result/321990 "2022-12-26T12:52:47Z")
Hy, I hope you are good and doing well. I am facing issue during search query result of ELS. I configured ELS with my Code and When I search using ELS it shows result fine but the issue is it shows loading sign (three do… --- ## ["The heap is empty" error on KNN search](https://discuss.elastic.co/t/the-heap-is-empty-error-on-knn-search/321550)
**Author:** [@abay.kenzhekhan](https://discuss.elastic.co/u/abay.kenzhekhan)\ **Replies:** 10\ **Last updated:** [December 26, 2022, 12:28pm UTC](https://discuss.elastic.co/t/the-heap-is-empty-error-on-knn-search/321550 "2022-12-26T12:28:35Z")
I am doing following KNN search request { "filter": { "bool": { "must\_not": { "term": { "some\_field": 14642652 } }, "must": { "term": { "some\_field2": true } } } }, "knn": { … --- ## [What type to choose for Dates Column](https://discuss.elastic.co/t/what-type-to-choose-for-dates-column/321979)
**Author:** [@Hasan](https://discuss.elastic.co/u/Hasan)\ **Replies:** 0\ **Last updated:** [December 26, 2022, 9:26am UTC](https://discuss.elastic.co/t/what-type-to-choose-for-dates-column/321979 "2022-12-26T09:26:42Z")
Hello, I have got the dataset consisting of a date column. The Format for the date in my data file is MM-DD-YYYY. While importing the dataset to Kibana what type should I choose in the pipeline and in mappings to make it… --- ## [How to start Elastic Observability](https://discuss.elastic.co/t/how-to-start-elastic-observability/321978)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 0\ **Last updated:** [December 26, 2022, 9:13am UTC](https://discuss.elastic.co/t/how-to-start-elastic-observability/321978 "2022-12-26T09:13:09Z")
We are using heartbeat for node availability and filebeat for logs shipment. Now we want to explore elastic observability features. In kibana observability section there is uptime option with heartbeat we have used one o… --- ## [Document is not saved](https://discuss.elastic.co/t/document-is-not-saved/321976)
**Author:** [@dave3](https://discuss.elastic.co/u/dave3)\ **Replies:** 0\ **Last updated:** [December 26, 2022, 8:18am UTC](https://discuss.elastic.co/t/document-is-not-saved/321976 "2022-12-26T08:18:59Z")
I have created a documet with many fields, some of them are lists of Strings as follows: @Field(type = FieldType.Nested) private Set\ locationList = new HashSet\<\>(); but when I try to save this document, i get t… --- ## [Upgrade from 7.16.2 to 7.171.7](https://discuss.elastic.co/t/upgrade-from-7-16-2-to-7-171-7/320439)
**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\ **Replies:** 4\ **Last updated:** [December 26, 2022, 7:37am UTC](https://discuss.elastic.co/t/upgrade-from-7-16-2-to-7-171-7/320439 "2022-12-26T07:37:07Z")
Hi, I have a three-node cluster version 716.2 and I want to upgrade it to 7.17.7. in my current cluster, TLS setting is activated by following: xpack.security.enabled: true xpack.security.transport.ssl.enabled: true xpa… --- ## [Bad elastic document](https://discuss.elastic.co/t/bad-elastic-document/321904)
**Author:** [@thuy\_do\_thi](https://discuss.elastic.co/u/thuy_do_thi)\ **Replies:** 5\ **Last updated:** [December 25, 2022, 2:49pm UTC](https://discuss.elastic.co/t/bad-elastic-document/321904 "2022-12-25T14:49:11Z")
Why is the Elastic document so bad? I am a devops engineer. I spent a week on deploy elasticsearch+logstash+kibana+kafka. After Xpack is enabled by default, I try to modify the user name of elasticsearch. It took me a… --- ## [Safe usage of \`\_forcemerge\` with \`only\_expunge\_deletes\`](https://discuss.elastic.co/t/safe-usage-of-forcemerge-with-only-expunge-deletes/321964)
**Author:** [@Au6ojlut](https://discuss.elastic.co/u/Au6ojlut)\ **Replies:** 0\ **Last updated:** [December 25, 2022, 10:31am UTC](https://discuss.elastic.co/t/safe-usage-of-forcemerge-with-only-expunge-deletes/321964 "2022-12-25T10:31:37Z")
Hello Team I am using the Elasticsearch 8.4.2. I have several indices, that is receiving updates (or deletes). On some indices update operation goes with the optimistic-concurrency-control. After some time, when the p… --- ## [Logstash configuration](https://discuss.elastic.co/t/logstash-configuration/321963)
**Author:** [@SaM9](https://discuss.elastic.co/u/SaM9)\ **Replies:** 0\ **Last updated:** [December 25, 2022, 9:59am UTC](https://discuss.elastic.co/t/logstash-configuration/321963 "2022-12-25T09:59:41Z")
in my elastic stack i have the following components : elastic agnet , fleet server , logstach and ealsticsearch cluster in my logstach output config do I have to send data directory to ealstcisearch data nodes or to flee… --- ## [Translog\_ops too slow while moving shards](https://discuss.elastic.co/t/translog-ops-too-slow-while-moving-shards/321960)
**Author:** [@DJ\_Zhu](https://discuss.elastic.co/u/DJ_Zhu)\ **Replies:** 0\ **Last updated:** [December 25, 2022, 8:52am UTC](https://discuss.elastic.co/t/translog-ops-too-slow-while-moving-shards/321960 "2022-12-25T08:52:14Z")
I have serval ES cluster that will do shards moving periodically(from hot node to cold node). Recently I notice that some of the shards are moved very slow compared to others. Here is one of the slow cluster: $ curl -XG… --- ## [Filtering expired child document while searching](https://discuss.elastic.co/t/filtering-expired-child-document-while-searching/321957)
**Author:** [@Lokesh\_Reddy1](https://discuss.elastic.co/u/Lokesh_Reddy1)\ **Replies:** 0\ **Last updated:** [December 24, 2022, 10:50pm UTC](https://discuss.elastic.co/t/filtering-expired-child-document-while-searching/321957 "2022-12-24T22:50:26Z")
Hi Everyone, I am struck with this unique problem and hopefully one of you might know the answer. Here is the situation: I have an object hierarchy Asset -\> Media Items (One to Many). Some of the Media Items may expir… --- ## [Upgrade from 7.17.1 to 8.5.3 failed](https://discuss.elastic.co/t/upgrade-from-7-17-1-to-8-5-3-failed/321946)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 8\ **Last updated:** [December 24, 2022, 11:03pm UTC](https://discuss.elastic.co/t/upgrade-from-7-17-1-to-8-5-3-failed/321946 "2022-12-24T23:03:01Z")
here is error. java.lang.IllegalStateException: cannot upgrade node because incompatible indices created with version \[6.5.4\] exist, while the minimum compatible index version is \[7.0.0\]. Upgrade your older indices by … --- ## [Records field not getting updated in Kibana dashboard](https://discuss.elastic.co/t/records-field-not-getting-updated-in-kibana-dashboard/321345)
**Author:** [@Shashank02](https://discuss.elastic.co/u/Shashank02)\ **Replies:** 1\ **Last updated:** [December 24, 2022, 6:24pm UTC](https://discuss.elastic.co/t/records-field-not-getting-updated-in-kibana-dashboard/321345 "2022-12-24T18:24:51Z")
I'm pushing my CSV data directly to Elasticsearch using python. Because of that, an index is getting created. But, then I am creating a data view manually in order to use it for KIBANA DASHBOARDS. The error I am facing i… --- ## [Send “raw log” and “filter log” from single server to elastic server](https://discuss.elastic.co/t/send-raw-log-and-filter-log-from-single-server-to-elastic-server/321824)
**Author:** [@Indeed2000](https://discuss.elastic.co/u/Indeed2000)\ **Replies:** 7\ **Last updated:** [December 24, 2022, 1:42pm UTC](https://discuss.elastic.co/t/send-raw-log-and-filter-log-from-single-server-to-elastic-server/321824 "2022-12-24T13:42:40Z")
Hi Need to Send “raw log” and “filter log” from single server to elastic server, but in different index. Like this: Host1 (rawlog) \> elastic (rawindex) Host1 (filter log) \> elastic (filterindex) Is it possible? Any… --- ## [Order documents by multiple geolocations](https://discuss.elastic.co/t/order-documents-by-multiple-geolocations/321449)
**Author:** [@merianos](https://discuss.elastic.co/u/merianos)\ **Replies:** 1\ **Last updated:** [December 24, 2022, 9:14am UTC](https://discuss.elastic.co/t/order-documents-by-multiple-geolocations/321449 "2022-12-24T09:14:28Z")
I am new to Elasticsearch and I try to create an index for companies that come with multiple branches in the city. Each of the branches it has it's own geolocation point. My companies document looks like this: { "… --- ## [Esrally benchmark run with(/out) refresh\_interval param doesn't show any difference in runtime](https://discuss.elastic.co/t/esrally-benchmark-run-with-out-refresh-interval-param-doesnt-show-any-difference-in-runtime/321668)
**Author:** [@Mahesh3](https://discuss.elastic.co/u/Mahesh3)\ **Replies:** 7\ **Last updated:** [December 24, 2022, 5:59am UTC](https://discuss.elastic.co/t/esrally-benchmark-run-with-out-refresh-interval-param-doesnt-show-any-difference-in-runtime/321668 "2022-12-24T05:59:58Z")
I have done two benchmark runs using the esrally, one with default refresh interval and second with "refresh\_interval" set to "-1" (disabled). Both runs took same amount of time. (382 seconds) I am hoping that second be… --- ## [Significant\_terms aggregation with sampling](https://discuss.elastic.co/t/significant-terms-aggregation-with-sampling/321944)
**Author:** [@colinvdh](https://discuss.elastic.co/u/colinvdh)\ **Replies:** 1\ **Last updated:** [December 23, 2022, 10:19pm UTC](https://discuss.elastic.co/t/significant-terms-aggregation-with-sampling/321944 "2022-12-23T22:19:39Z")
Hi there, I am looking to extract top 100 most significant terms out of a very large index. In particular, terms that have increased the most significantly in frequency between some defined "background set" and "foregro… --- ## [Sequence Independent Correlation with EQL](https://discuss.elastic.co/t/sequence-independent-correlation-with-eql/321941)
**Author:** [@jmaurio](https://discuss.elastic.co/u/jmaurio)\ **Replies:** 0\ **Last updated:** [December 23, 2022, 5:54pm UTC](https://discuss.elastic.co/t/sequence-independent-correlation-with-eql/321941 "2022-12-23T17:54:41Z")
Is it possible to create a custom rule that is the AND of three events that is order independent? For example, I would like to trigger when event A, event B and event C are satisfied, but I don't care what order they wer… --- ## [Elasticsearch NEST (C# Client)](https://discuss.elastic.co/t/elasticsearch-nest-c-client/321854)
**Author:** [@diegovita](https://discuss.elastic.co/u/diegovita)\ **Replies:** 2\ **Last updated:** [December 23, 2022, 5:37pm UTC](https://discuss.elastic.co/t/elasticsearch-nest-c-client/321854 "2022-12-23T17:37:23Z")
Hello, I want to translate this Filter Agregation to C# (using NEST client) but I don't know how to: "aggs": { "Condiciones": { "filter": { "bool": { "filter": \[ { "terms":{ "genre": \[ "M", "F", "I", "X" \] } }, { … --- ## [Restoring snapshot in elastic delete some indices once restored](https://discuss.elastic.co/t/restoring-snapshot-in-elastic-delete-some-indices-once-restored/321926)
**Author:** [@marone](https://discuss.elastic.co/u/marone)\ **Replies:** 0\ **Last updated:** [December 23, 2022, 2:55pm UTC](https://discuss.elastic.co/t/restoring-snapshot-in-elastic-delete-some-indices-once-restored/321926 "2022-12-23T14:55:35Z")
Hello, I have an elastic cluster using ECK, running version 8.4.3, testing and understand snapshot restoration and here is what I did: (the questions are listed a the end, started with steps I did) Created a snapshot r… --- ## [Elasticsearch Report Download of size more than 10000 using aggregation](https://discuss.elastic.co/t/elasticsearch-report-download-of-size-more-than-10000-using-aggregation/321927)
**Author:** [@PRASHANT\_MEHTA](https://discuss.elastic.co/u/PRASHANT_MEHTA)\ **Replies:** 1\ **Last updated:** [December 23, 2022, 3:47pm UTC](https://discuss.elastic.co/t/elasticsearch-report-download-of-size-more-than-10000-using-aggregation/321927 "2022-12-23T15:47:13Z")
Hello All, I'm facing issue when I'm trying to download data more than 10000 records. I've 25000 documents in my elastic index and all these documents are unique(logsatsh doc\_as\_upsert) used.The challenge is elastic re… --- ## [Kinana error:Your query is taking time](https://discuss.elastic.co/t/kinana-error-your-query-is-taking-time/321933)
**Author:** [@PRASHANT\_MEHTA](https://discuss.elastic.co/u/PRASHANT_MEHTA)\ **Replies:** 0\ **Last updated:** [December 23, 2022, 3:54pm UTC](https://discuss.elastic.co/t/kinana-error-your-query-is-taking-time/321933 "2022-12-23T15:54:47Z")
Hello All, I am trying to fetch the aggregation data of around 20000 records and visual I'm using is data table. I'm teasting in test server with 8 core cpus and with jvm size of 8GB. Can someone help me understand wh… --- ## [Security\_exception: current license is non-compliant for \[searchable-snapshots\]](https://discuss.elastic.co/t/security-exception-current-license-is-non-compliant-for-searchable-snapshots/321925)
**Author:** [@Frobeniusnorm](https://discuss.elastic.co/u/Frobeniusnorm)\ **Replies:** 3\ **Last updated:** [December 23, 2022, 3:16pm UTC](https://discuss.elastic.co/t/security-exception-current-license-is-non-compliant-for-searchable-snapshots/321925 "2022-12-23T15:16:41Z")
In my Index Management i get the warning: Index lifecycle error security\_exception: current license is non-compliant for \[searchable-snapshots\] But when i go to the policies, searchable snapshots are not activated. H… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=322) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=324)