# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=501 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 502 --- ## [LOG4J vulenrability](https://discuss.elastic.co/t/log4j-vulenrability/295847)
**Author:** [@eden\_shirazi](https://discuss.elastic.co/u/eden_shirazi)\ **Replies:** 3\ **Last updated:** [February 1, 2022, 2:10pm UTC](https://discuss.elastic.co/t/log4j-vulenrability/295847 "2022-02-01T14:10:00Z")
Hi, I didn't found any official information about the log4j vulnerability in elastic. what is the official version of elastic that protect from log4j vulnerability? Thank for the help. --- ## [Transforming Indexes](https://discuss.elastic.co/t/transforming-indexes/295932)
**Author:** [@Arya\_Yellapu](https://discuss.elastic.co/u/Arya_Yellapu)\ **Replies:** 5\ **Last updated:** [February 1, 2022, 1:37pm UTC](https://discuss.elastic.co/t/transforming-indexes/295932 "2022-02-01T13:37:03Z")
Transforming Indexes is considering the timestamp field under "\_source" while comparing the data. How to exclude this field while comparison? Below is the query I am using to transform the data from two indexes: PUT /\_… --- ## [REINDEX : identify fields to remove with a regular expression?](https://discuss.elastic.co/t/reindex-identify-fields-to-remove-with-a-regular-expression/295275)
**Author:** [@TheEvilDonut](https://discuss.elastic.co/u/TheEvilDonut)\ **Replies:** 8\ **Last updated:** [February 1, 2022, 1:03pm UTC](https://discuss.elastic.co/t/reindex-identify-fields-to-remove-with-a-regular-expression/295275 "2022-02-01T13:03:24Z")
Hello. Here's the situation. A source shipping logs to our cluster has messed up and sent us a large number of documents containing undesirable fields. The thing is that the fields names are almost random, there is no w… --- ## [Stringify object during reindexing](https://discuss.elastic.co/t/stringify-object-during-reindexing/295900)
**Author:** [@Animesh\_Agarwal](https://discuss.elastic.co/u/Animesh_Agarwal)\ **Replies:** 5\ **Last updated:** [February 1, 2022, 11:38am UTC](https://discuss.elastic.co/t/stringify-object-during-reindexing/295900 "2022-02-01T11:38:30Z")
Hi Team, I am looking for a solution to convert an object to string during reindexing. I searched for solutions using painless scripting but was unable to do so as it seems painless doesn't support JSON ( might be wrong… --- ## [Scrolling Search Template in elasticsearch-java 7.16](https://discuss.elastic.co/t/scrolling-search-template-in-elasticsearch-java-7-16/294869)
**Author:** [@jps](https://discuss.elastic.co/u/jps)\ **Replies:** 2\ **Last updated:** [February 1, 2022, 11:32am UTC](https://discuss.elastic.co/t/scrolling-search-template-in-elasticsearch-java-7-16/294869 "2022-02-01T11:32:08Z")
Hi. Recently I've migrated from Elasticsearch-rest-high-level-client to Elasticsearch-java. My question is how can I scroll across SearchTemplateResponse? In SearchTemplateRequest we can put a scroll but it doesn't app… --- ## [Can Elasticsearch provide offsets of highlighted words?](https://discuss.elastic.co/t/can-elasticsearch-provide-offsets-of-highlighted-words/295323)
**Author:** [@astrodi](https://discuss.elastic.co/u/astrodi)\ **Replies:** 4\ **Last updated:** [February 1, 2022, 11:18am UTC](https://discuss.elastic.co/t/can-elasticsearch-provide-offsets-of-highlighted-words/295323 "2022-02-01T11:18:38Z")
We are having OCRed text of PDFs searchable in Elasticsearch. Also we have stored original PDFs, passing highlighted terms from Elasticsearch in URL and with custom library we highlight the words in PDFs. But we would … --- ## [Hi all, I am trying to ingest json file in Elasticsearch using python , but index is not getting created](https://discuss.elastic.co/t/hi-all-i-am-trying-to-ingest-json-file-in-elasticsearch-using-python-but-index-is-not-getting-created/295903)
**Author:** [@Chinmay\_Bhusate](https://discuss.elastic.co/u/Chinmay_Bhusate)\ **Replies:** 1\ **Last updated:** [February 1, 2022, 9:55am UTC](https://discuss.elastic.co/t/hi-all-i-am-trying-to-ingest-json-file-in-elasticsearch-using-python-but-index-is-not-getting-created/295903 "2022-02-01T09:55:54Z")
Code is running , I'm not getting any error . But at a same time index is not created . Here is my code. import sys import json from pprint import pprint from elasticsearch import Elasticsearch es = Elasticsearch( … --- ## [ELK Alerting for AD logs](https://discuss.elastic.co/t/elk-alerting-for-ad-logs/295823)
**Author:** [@AbdulVaseem](https://discuss.elastic.co/u/AbdulVaseem)\ **Replies:** 1\ **Last updated:** [February 1, 2022, 9:54am UTC](https://discuss.elastic.co/t/elk-alerting-for-ad-logs/295823 "2022-02-01T09:54:24Z")
How to set up an alert when an Admin or Enterprise admin is created on Local AD in kibana --- ## [Is Delete by query a clean operation?](https://discuss.elastic.co/t/is-delete-by-query-a-clean-operation/295778)
**Author:** [@yash\_196](https://discuss.elastic.co/u/yash_196)\ **Replies:** 9\ **Last updated:** [February 1, 2022, 7:02am UTC](https://discuss.elastic.co/t/is-delete-by-query-a-clean-operation/295778 "2022-02-01T07:02:00Z")
Hi Everyone, I wanted to know if delete by query is a clean API? Are the resources (Memory or I/O) released gracefully after the query is complete or does it still hold some resource which might affect perormance? --- ## [Cannot upload Large CSV file, Timeout](https://discuss.elastic.co/t/cannot-upload-large-csv-file-timeout/295774)
**Author:** [@N\_Q](https://discuss.elastic.co/u/N_Q)\ **Replies:** 1\ **Last updated:** [February 1, 2022, 5:31am UTC](https://discuss.elastic.co/t/cannot-upload-large-csv-file-timeout/295774 "2022-02-01T05:31:25Z")
HI Team, I am evaluating Elasticsearch for its multivariate anomaly detection capabilities on data from Manufacturing systems. I have a dataset which is comma separated but whenever I try to upload the full file(around … --- ## [LifeCycle policy doesn't delete index because of wrong index age](https://discuss.elastic.co/t/lifecycle-policy-doesnt-delete-index-because-of-wrong-index-age/295859)
**Author:** [@ashit\_pupu](https://discuss.elastic.co/u/ashit_pupu)\ **Replies:** 4\ **Last updated:** [February 1, 2022, 5:03am UTC](https://discuss.elastic.co/t/lifecycle-policy-doesnt-delete-index-because-of-wrong-index-age/295859 "2022-02-01T05:03:13Z")
Hi I have created an ILM which would delete an index after 5 days of creation. I have disabled the index rollover so my policy has the hot phase and delete phase . Below is the policy for reference . PUT \_ilm/policy/se… --- ## [ELK Alerting on one of the host memory high utilization](https://discuss.elastic.co/t/elk-alerting-on-one-of-the-host-memory-high-utilization/295822)
**Author:** [@AbdulVaseem](https://discuss.elastic.co/u/AbdulVaseem)\ **Replies:** 2\ **Last updated:** [February 1, 2022, 4:52am UTC](https://discuss.elastic.co/t/elk-alerting-on-one-of-the-host-memory-high-utilization/295822 "2022-02-01T04:52:04Z")
How to set up an alert for a server when RAM/CPU reaches a threshold (like 85%) --- ## [Create a query with OR & And condition in elasticsearch](https://discuss.elastic.co/t/create-a-query-with-or-and-condition-in-elasticsearch/295799)
**Author:** [@Mojahid\_Ahmad](https://discuss.elastic.co/u/Mojahid_Ahmad)\ **Replies:** 1\ **Last updated:** [February 1, 2022, 1:48am UTC](https://discuss.elastic.co/t/create-a-query-with-or-and-condition-in-elasticsearch/295799 "2022-02-01T01:48:34Z")
Hi, I am trying to convert this sql query to the DSL query to query in Python select count(\*) from dean\_acc\_p\_alm\_asset where (substring(cast(sys\_updated\_on as varchar),1,10) \>= '2021-11-01' and substring(cast(sys\_upda… --- ## [Enable https on elasticsearchs](https://discuss.elastic.co/t/enable-https-on-elasticsearchs/295702)
**Author:** [@nikssssss](https://discuss.elastic.co/u/nikssssss)\ **Replies:** 0\ **Last updated:** [January 28, 2022, 12:36pm UTC](https://discuss.elastic.co/t/enable-https-on-elasticsearchs/295702 "2022-01-28T12:36:55Z")
hello, I just want to have https for the Elasticsearch... i have my .pem certification from my company with private key. What i have to do to enable https? the above configuration in yml is ok? xpack.security.enabled… --- ## [Elasticsearch Immutable Documents in Indexes](https://discuss.elastic.co/t/elasticsearch-immutable-documents-in-indexes/295825)
**Author:** [@nirvanah](https://discuss.elastic.co/u/nirvanah)\ **Replies:** 4\ **Last updated:** [February 1, 2022, 12:11am UTC](https://discuss.elastic.co/t/elasticsearch-immutable-documents-in-indexes/295825 "2022-02-01T00:11:19Z")
I am using Elastic Stack to store logs of multiple servers. I need to make the logs/document immutable, i.e. Write-once only. There is a compliance requirement to prevent alteration of logs. I am using Elasticsearch 7.10… --- ## [Gateway settings](https://discuss.elastic.co/t/gateway-settings/295848)
**Author:** [@njain213](https://discuss.elastic.co/u/njain213)\ **Replies:** 1\ **Last updated:** [February 1, 2022, 12:06am UTC](https://discuss.elastic.co/t/gateway-settings/295848 "2022-02-01T00:06:05Z")
Hello Team, I am using ES version 7.9.3. I just want to confirm regarding gateway settings. I am having hot,warm and cold architecture. Master nodes : 3 Data nodes: 13 (hot nodes : 3, cold nodes: 6, warm nodes : 4) W… --- ## [Spike in response time during deleteByQuery](https://discuss.elastic.co/t/spike-in-response-time-during-deletebyquery/295766)
**Author:** [@bradptp](https://discuss.elastic.co/u/bradptp)\ **Replies:** 23\ **Last updated:** [February 1, 2022, 12:05am UTC](https://discuss.elastic.co/t/spike-in-response-time-during-deletebyquery/295766 "2022-02-01T00:05:57Z")
We're using a deletebyQuery to remove a large number of records from Elasticsearch using a query similar to this: let query = { "query": { "bool": { "must\_not": { … --- ## [Has anyone seen automatic heap sizing work?](https://discuss.elastic.co/t/has-anyone-seen-automatic-heap-sizing-work/295887)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 0\ **Last updated:** [January 31, 2022, 10:53pm UTC](https://discuss.elastic.co/t/has-anyone-seen-automatic-heap-sizing-work/295887 "2022-01-31T22:53:19Z")
All postings I've seen are complaints where it doesn't. If it works for you, can you explain how it works? Does it start with the default 1G heap and grow? Does it set a reasonable heap size \> 1G at startup? My test … --- ## [Mapping explosion vs. the filebeat template](https://discuss.elastic.co/t/mapping-explosion-vs-the-filebeat-template/295886)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 0\ **Last updated:** [January 31, 2022, 10:49pm UTC](https://discuss.elastic.co/t/mapping-explosion-vs-the-filebeat-template/295886 "2022-01-31T22:49:10Z")
I'm struggling trying to figure out how to convert from the way we used legacy templates to the new index and component templates. I used to add our own templates with higher priority on top of the supplied filebeat tem… --- ## [Yellow index (primary shard seems fine)](https://discuss.elastic.co/t/yellow-index-primary-shard-seems-fine/295563)
**Author:** [@Michael\_Ubry](https://discuss.elastic.co/u/Michael_Ubry)\ **Replies:** 4\ **Last updated:** [January 31, 2022, 9:48pm UTC](https://discuss.elastic.co/t/yellow-index-primary-shard-seems-fine/295563 "2022-01-31T21:48:37Z")
Hi, most of my indices are yellow. I am curious about one particular index, which is important to me. Due to confidentiallity I have to rename it in Paint and in codes bellow. When I use this code I get result whats in… --- ## ['Refresh' setting for a bulk update request](https://discuss.elastic.co/t/refresh-setting-for-a-bulk-update-request/295641)
**Author:** [@Kaushik\_Lingarkar](https://discuss.elastic.co/u/Kaushik_Lingarkar)\ **Replies:** 7\ **Last updated:** [January 31, 2022, 9:22pm UTC](https://discuss.elastic.co/t/refresh-setting-for-a-bulk-update-request/295641 "2022-01-31T21:22:29Z")
Hello all, This is my first post here and thank you for this amazing tool. I am using the Elasticsearch-rest-client and I wanted a clarification with the behaviour of Refresh setting with the Bulk API. Does the 'refre… --- ## [How to benachamr single decumnt indexing](https://discuss.elastic.co/t/how-to-benachamr-single-decumnt-indexing/295852)
**Author:** [@marek\_duciuc](https://discuss.elastic.co/u/marek_duciuc)\ **Replies:** 3\ **Last updated:** [January 31, 2022, 6:11pm UTC](https://discuss.elastic.co/t/how-to-benachamr-single-decumnt-indexing/295852 "2022-01-31T18:11:53Z")
Is this correct way how to index benchmark single document in rally? { "operation": { "name": "small", "operation-type": "bulk", "bulk-size": "1", "ingest-percentage": "1", … --- ## [\[JAVA\] Unexpected JSON event 'VALUE\_TRUE' instead of '\[KEY\_NAME, VALUE\_STRING\]'](https://discuss.elastic.co/t/java-unexpected-json-event-value-true-instead-of-key-name-value-string/295740)
**Author:** [@wxh](https://discuss.elastic.co/u/wxh)\ **Replies:** 10\ **Last updated:** [January 31, 2022, 5:43pm UTC](https://discuss.elastic.co/t/java-unexpected-json-event-value-true-instead-of-key-name-value-string/295740 "2022-01-31T17:43:53Z")
I am writing some code to manage Elasticsearch templates. When running the code snippet below I am getting co.elastic.clients.json.UnexpectedJsonEventException: Unexpected JSON event 'VALUE\_FALSE' instead of '\[KEY\_NAME,… --- ## [Snapshots occasionally fail](https://discuss.elastic.co/t/snapshots-occasionally-fail/295866)
**Author:** [@AnotherCorpoDrone](https://discuss.elastic.co/u/AnotherCorpoDrone)\ **Replies:** 0\ **Last updated:** [January 31, 2022, 5:20pm UTC](https://discuss.elastic.co/t/snapshots-occasionally-fail/295866 "2022-01-31T17:20:24Z")
Hi all, We're having fairly frequent issues with our pre-prod environment snapshots failing. We're using Azure as our repo, all nodes can see it and it passes the normal validation steps. I can only see a couple of lin… --- ## [7.16 Java Client - UpdateRequest example](https://discuss.elastic.co/t/7-16-java-client-updaterequest-example/295846)
**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\ **Replies:** 3\ **Last updated:** [January 31, 2022, 4:25pm UTC](https://discuss.elastic.co/t/7-16-java-client-updaterequest-example/295846 "2022-01-31T16:25:35Z")
Hi, I'm struggling to understand how to do an UpdateRequest with the latest java client. For example, this: client.update(new UpdateRequest.Builder\<\>() .index(index) .id(id) … --- ## [Elasticsearch warning logs while stopping tomcat](https://discuss.elastic.co/t/elasticsearch-warning-logs-while-stopping-tomcat/295845)
**Author:** [@Ram\_N](https://discuss.elastic.co/u/Ram_N)\ **Replies:** 1\ **Last updated:** [January 31, 2022, 3:21pm UTC](https://discuss.elastic.co/t/elasticsearch-warning-logs-while-stopping-tomcat/295845 "2022-01-31T15:21:39Z")
Hi Im using ELK 7.10.2 and uses below code to connect to Elasticsearch using java Settings settings = Settings.builder() .put("cluster.name", elkUtil.getClusterName(Constants.ELASTICSEARCH\_YAML\_PATH)).build(); … --- ## [Bulk API - can't add more than one row](https://discuss.elastic.co/t/bulk-api-cant-add-more-than-one-row/295718)
**Author:** [@yamaga](https://discuss.elastic.co/u/yamaga)\ **Replies:** 3\ **Last updated:** [January 31, 2022, 12:34pm UTC](https://discuss.elastic.co/t/bulk-api-cant-add-more-than-one-row/295718 "2022-01-31T12:34:35Z")
Hi I am trying to add some data with Bulk API, but it takes only the last record of my JSON input data. Here an example with 3 record: input data: \[ { "ID\_PROD": "15136", "UNIT": "UN", "RATE": 1 }, … --- ## [Store binary files in elastic search](https://discuss.elastic.co/t/store-binary-files-in-elastic-search/295805)
**Author:** [@Arpita11](https://discuss.elastic.co/u/Arpita11)\ **Replies:** 8\ **Last updated:** [January 31, 2022, 11:36am UTC](https://discuss.elastic.co/t/store-binary-files-in-elastic-search/295805 "2022-01-31T11:36:19Z")
For my project, we are storing the data in Elasticsearch. I have new requirement regarding documents (i.e. the actual binaries): Store documents and be able to search the text within the document binary. Allow the use… --- ## [How do I use match query inside a nested aggregation?](https://discuss.elastic.co/t/how-do-i-use-match-query-inside-a-nested-aggregation/295811)
**Author:** [@dotel](https://discuss.elastic.co/u/dotel)\ **Replies:** 2\ **Last updated:** [January 31, 2022, 11:17am UTC](https://discuss.elastic.co/t/how-do-i-use-match-query-inside-a-nested-aggregation/295811 "2022-01-31T11:17:06Z")
Is there a way to do a match query inside nested aggregation? The query below works fine for my use case but it uses a term filter instead of a match. So searching for "nursery" will result in 0 buckets. GET sushant-ten… --- ## [Index Health often red](https://discuss.elastic.co/t/index-health-often-red/294367)
**Author:** [@it-dept](https://discuss.elastic.co/u/it-dept)\ **Replies:** 10\ **Last updated:** [January 31, 2022, 10:24am UTC](https://discuss.elastic.co/t/index-health-often-red/294367 "2022-01-31T10:24:17Z")
Good day. We have Elasticsearch version 7.13.3 on separated server, not a cluster. And often one of the indexes turns red. We are deleting it. But after a while it turns red again. May be there is a solution to how to … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=500) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=502)