# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=779

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 780

---

## [Is Fuzzy sentence search in elasticsearch based on edit distance of words?](https://discuss.elastic.co/t/is-fuzzy-sentence-search-in-elasticsearch-based-on-edit-distance-of-words/315464)

<div class="topic-metadata">

**Author:** [@swapnil3597](https://discuss.elastic.co/u/swapnil3597)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 1:57pm UTC](https://discuss.elastic.co/t/is-fuzzy-sentence-search-in-elasticsearch-based-on-edit-distance-of-words/315464 "2022-09-29T13:57:19Z")

</div>

For a given index I have added documents like: \[ {"expression": "tell me something about elasticsearch"}, {"expression": "this is a new feature for elasticsearch"}, {"expression": "tell me something about kibana"}, # ..…

---

## [Heartbeat.config.monitors path to c:/program files](https://discuss.elastic.co/t/heartbeat-config-monitors-path-to-c-program-files/315458)

<div class="topic-metadata">

**Author:** [@miguelbatista](https://discuss.elastic.co/u/miguelbatista)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 1:35pm UTC](https://discuss.elastic.co/t/heartbeat-config-monitors-path-to-c-program-files/315458 "2022-09-29T13:35:59Z")

</div>

Hi, I've installed Heartbeat on a Windows server VM in here "C:\\Program Files\\Heartbeat" and can't get heartbeat.yml config.monitors path right to read the monitors.d files.

---

## [Elasticsearch "snapshot\_restore\_exception" "reason": snapshot does not exist" when snapshot status is SUCCESS](https://discuss.elastic.co/t/elasticsearch-snapshot-restore-exception-reason-snapshot-does-not-exist-when-snapshot-status-is-success/315457)

<div class="topic-metadata">

**Author:** [@arozaki](https://discuss.elastic.co/u/arozaki)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 1:24pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-restore-exception-reason-snapshot-does-not-exist-when-snapshot-status-is-success/315457 "2022-09-29T13:24:49Z")

</div>

I am using the Java/Groovy client for Elasticsearch and I am trying to restore an ES snapshot during an upgrade. I am using the Groovy code I have so far for setting up my old and new clients and making them create & res…

---

## [Sharing resources (Data views and Dashboards) across Spaces](https://discuss.elastic.co/t/sharing-resources-data-views-and-dashboards-across-spaces/312933)

<div class="topic-metadata">

**Author:** [@yelloyonder](https://discuss.elastic.co/u/yelloyonder)\
**Replies:** 3\
**Last updated:** [September 29, 2022, 1:10pm UTC](https://discuss.elastic.co/t/sharing-resources-data-views-and-dashboards-across-spaces/312933 "2022-09-29T13:10:06Z")

</div>

Hi, I've been trying to setup Spaces in Kibana (Elastic cloud) for non-admin teams so they only see the Kibana resources they need e.g. Discover and Dashboards under Analytics and not Security. When moving to the new S…

---

## [Query document array is a subset of search input](https://discuss.elastic.co/t/query-document-array-is-a-subset-of-search-input/315419)

<div class="topic-metadata">

**Author:** [@bwly](https://discuss.elastic.co/u/bwly)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 1:03pm UTC](https://discuss.elastic.co/t/query-document-array-is-a-subset-of-search-input/315419 "2022-09-29T13:03:13Z")

</div>

I have document that has the this array attribute {array\_attr: \[ { id: "A", name: "A\_name" }, { id: "B", name: "B\_name" }, { id: "C", name: "B\_name" } \]} In my search query, I have…

---

## [Pyspark: from curl to correct settings](https://discuss.elastic.co/t/pyspark-from-curl-to-correct-settings/314999)

<div class="topic-metadata">

**Author:** [@obi134](https://discuss.elastic.co/u/obi134)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 12:58pm UTC](https://discuss.elastic.co/t/pyspark-from-curl-to-correct-settings/314999 "2022-09-29T12:58:17Z")

</div>

Hi there, I'm trying to push data from databricks/pyspark to elasticsearch following these instructions: ElasticSearch | Databricks on AWS Unfortunately I'm getting this error: org.elasticsearch.hadoop.EsHadoopIllega…

---

## [Issue with implement proxy in elasticsearch/kibana](https://discuss.elastic.co/t/issue-with-implement-proxy-in-elasticsearch-kibana/315452)

<div class="topic-metadata">

**Author:** [@lgriger](https://discuss.elastic.co/u/lgriger)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 12:41pm UTC](https://discuss.elastic.co/t/issue-with-implement-proxy-in-elasticsearch-kibana/315452 "2022-09-29T12:41:23Z")

</div>

elasticsearch config xpack.http.proxy.host: http:// xpack.http.proxy.port: 8080 xpack.http.proxy.scheme:http kibana config xpack.fleet.registryProxyUrl: http://\<user:password@url\> xpack.actions.proxyUrl: http://\<us…

---

## [Stemming and the near span query](https://discuss.elastic.co/t/stemming-and-the-near-span-query/315449)

<div class="topic-metadata">

**Author:** [@af1](https://discuss.elastic.co/u/af1)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 11:51am UTC](https://discuss.elastic.co/t/stemming-and-the-near-span-query/315449 "2022-09-29T11:51:59Z")

</div>

Hello community, hope to get your help on an issue we are having, we are using the english stemming and are running a near span query that basically searches for "buying near before" now if I search for a match phras…

---

## [Packetbeat interfere with defender for identity on Windows Server 2012-2022](https://discuss.elastic.co/t/packetbeat-interfere-with-defender-for-identity-on-windows-server-2012-2022/314509)

<div class="topic-metadata">

**Author:** [@splitmessage88](https://discuss.elastic.co/u/splitmessage88)\
**Replies:** 3\
**Last updated:** [September 29, 2022, 10:51am UTC](https://discuss.elastic.co/t/packetbeat-interfere-with-defender-for-identity-on-windows-server-2012-2022/314509 "2022-09-29T10:51:58Z")

</div>

Hi, We are using Packetbeat for capturing DNS traffic from our Windows servers (10 servers) and are having an issue with packetbeat interfering with the defender sensor. We are getting the following error message from D…

---

## [Granular user-document level permissions](https://discuss.elastic.co/t/granular-user-document-level-permissions/315438)

<div class="topic-metadata">

**Author:** [@mattkallo](https://discuss.elastic.co/u/mattkallo)\
**Replies:** 5\
**Last updated:** [September 29, 2022, 10:33am UTC](https://discuss.elastic.co/t/granular-user-document-level-permissions/315438 "2022-09-29T10:33:54Z")

</div>

Hi, In our search index we want to specify access at very granular level. For eg. Say we have doc1, doc2, doc3 in index and user1 has access to doc1 and doc2, similarly user2 to doc2 and doc3, user3 to doc3 and doc1. T…

---

## [Logstash: Variable substitution FAILS for "api\_key" in elasticsearch output](https://discuss.elastic.co/t/logstash-variable-substitution-fails-for-api-key-in-elasticsearch-output/315339)

<div class="topic-metadata">

**Author:** [@George\_Kossionis](https://discuss.elastic.co/u/George_Kossionis)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 10:29am UTC](https://discuss.elastic.co/t/logstash-variable-substitution-fails-for-api-key-in-elasticsearch-output/315339 "2022-09-29T10:29:14Z")

</div>

Hello, I have configured logstash to use logstash.keystore to store secure credentials. The ${ES\_PASSWD} substitutions are working perfectly on the following configuration: elasticsearch { ... user…

---

## [Search\_phase\_execution\_exception in partitioned terms aggregation](https://discuss.elastic.co/t/search-phase-execution-exception-in-partitioned-terms-aggregation/315443)

<div class="topic-metadata">

**Author:** [@Sederfo](https://discuss.elastic.co/u/Sederfo)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 10:00am UTC](https://discuss.elastic.co/t/search-phase-execution-exception-in-partitioned-terms-aggregation/315443 "2022-09-29T10:00:04Z")

</div>

I have an index which contains millions of documents that I want to aggregate. This is the query I am using to obtain the aggregated results. aggs = { "0": { "terms": { …

---

## [Failed Reroute unassigned index](https://discuss.elastic.co/t/failed-reroute-unassigned-index/315437)

<div class="topic-metadata">

**Author:** [@GithubRyze](https://discuss.elastic.co/u/GithubRyze)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 9:17am UTC](https://discuss.elastic.co/t/failed-reroute-unassigned-index/315437 "2022-09-29T09:17:58Z")

</div>

Elasticsearch Version docker image 8.1.3 Installed Plugins No response Java Version openJDK 8 OS Version linux Problem Description index shard prirep state node unassigned.r…

---

## [Lens Metric: split by keyword](https://discuss.elastic.co/t/lens-metric-split-by-keyword/310755)

<div class="topic-metadata">

**Author:** [@obi134](https://discuss.elastic.co/u/obi134)\
**Replies:** 3\
**Last updated:** [September 29, 2022, 9:17am UTC](https://discuss.elastic.co/t/lens-metric-split-by-keyword/310755 "2022-09-29T09:17:43Z")

</div>

Hi there, Currently I am using Metric visualization to show a status of different devices: In this metric I am showing the last status and split the group by device id. Additionally I defined ranges and selected a co…

---

## [Convert es (Bucket aggregation) query to java](https://discuss.elastic.co/t/convert-es-bucket-aggregation-query-to-java/315321)

<div class="topic-metadata">

**Author:** [@Shubh](https://discuss.elastic.co/u/Shubh)\
**Replies:** 8\
**Last updated:** [September 29, 2022, 9:15am UTC](https://discuss.elastic.co/t/convert-es-bucket-aggregation-query-to-java/315321 "2022-09-29T09:15:05Z")

</div>

Hi, Can anyone help me convert this query in java program and how would i get only the aggreagtion result from query. The query is given below. GET /\_search { "size": 0, "query": { "bool": { "filter": \[ …

---

## [How to create a kibana dashboard which could search through index relations?](https://discuss.elastic.co/t/how-to-create-a-kibana-dashboard-which-could-search-through-index-relations/315276)

<div class="topic-metadata">

**Author:** [@Ibrahim\_Z\_HIDIR](https://discuss.elastic.co/u/Ibrahim_Z_HIDIR)\
**Replies:** 8\
**Last updated:** [September 29, 2022, 8:25am UTC](https://discuss.elastic.co/t/how-to-create-a-kibana-dashboard-which-could-search-through-index-relations/315276 "2022-09-29T08:25:16Z")

</div>

Hi everybody I have 3 different indices, A, B and C A and B both sharing a field suppose F1 B and C also sharing another field suppose F2 I've added 3 different saved search to a dash board. So when I want to sear…

---

## [Deleting index suddenly](https://discuss.elastic.co/t/deleting-index-suddenly/315334)

<div class="topic-metadata">

**Author:** [@Emre\_Kurt](https://discuss.elastic.co/u/Emre_Kurt)\
**Replies:** 8\
**Last updated:** [September 29, 2022, 8:03am UTC](https://discuss.elastic.co/t/deleting-index-suddenly/315334 "2022-09-29T08:03:20Z")

</div>

Hi everyone, I've been having a very annoying problem lately. Something deleting my indexes suddenly. Here is my situations; 9200 port is closed to outside. Only server ip can access the port. There is a lot of docker…

---

## [Index origination date based on logs age](https://discuss.elastic.co/t/index-origination-date-based-on-logs-age/315159)

<div class="topic-metadata">

**Author:** [@booboo](https://discuss.elastic.co/u/booboo)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 7:59am UTC](https://discuss.elastic.co/t/index-origination-date-based-on-logs-age/315159 "2022-09-29T07:59:11Z")

</div>

Hello everyone, I am trying to set a dynamic lifecycle "origination\_date" in order in inject old logs into Elastic, does anybody know how to do this ? Here is my situation. I need monthly indexes so I can't use "parse\_…

---

## [ILM Pattern suffix reach max count](https://discuss.elastic.co/t/ilm-pattern-suffix-reach-max-count/315425)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 4\
**Last updated:** [September 29, 2022, 7:54am UTC](https://discuss.elastic.co/t/ilm-pattern-suffix-reach-max-count/315425 "2022-09-29T07:54:17Z")

</div>

Hello, I want to ask about ILM pattern count, what will happen if the pattern reach 999999? lets give an example I have : index-000001 then what happen if someday my index reached : index-999999 does the number re…

---

## [Rolling Restart doubt](https://discuss.elastic.co/t/rolling-restart-doubt/315429)

<div class="topic-metadata">

**Author:** [@S-elk](https://discuss.elastic.co/u/S-elk)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 7:49am UTC](https://discuss.elastic.co/t/rolling-restart-doubt/315429 "2022-09-29T07:49:01Z")

</div>

hello! i have a cluster with 20 data nodes, 3 masters and 2 ml. We want to do a rolling restart so that there is no loss of service. i know the method to follow.... disable shard allocation, temporarily stop ml jobs, r…

---

## [Windows system configuration](https://discuss.elastic.co/t/windows-system-configuration/315427)

<div class="topic-metadata">

**Author:** [@avnere](https://discuss.elastic.co/u/avnere)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 6:46am UTC](https://discuss.elastic.co/t/windows-system-configuration/315427 "2022-09-29T06:46:24Z")

</div>

In documentation there are explanation on configuration related to Linux, such file descriptor, virtual memory, etc. Is there any special configuration for Windows?

---

## [Multiple indices from one log file](https://discuss.elastic.co/t/multiple-indices-from-one-log-file/315290)

<div class="topic-metadata">

**Author:** [@kkovacs](https://discuss.elastic.co/u/kkovacs)\
**Replies:** 3\
**Last updated:** [September 29, 2022, 6:38am UTC](https://discuss.elastic.co/t/multiple-indices-from-one-log-file/315290 "2022-09-29T06:38:25Z")

</div>

Dear Community! I have a question regarding filebeat configuration. Is there any method to make two separate index from the same log file? My purpose is to make two separate index for Kibana from the same log file - to…

---

## [JsonParsingException: expected:',', actual:'"application/pdf; version=1.7"', at offset:428](https://discuss.elastic.co/t/jsonparsingexception-expected-actual-application-pdf-version-1-7-at-offset-428/314857)

<div class="topic-metadata">

**Author:** [@Roman\_Cerny](https://discuss.elastic.co/u/Roman_Cerny)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 6:08am UTC](https://discuss.elastic.co/t/jsonparsingexception-expected-actual-application-pdf-version-1-7-at-offset-428/314857 "2022-09-29T06:08:34Z")

</div>

Hello there, I'm new to Elasticsearch and I'm trying to set up a cloud solution of Elasticsearch on azure with .Net 6.0 and a NEST, but I encoutered a problem when working with 7.17.4 NEST and 8.x version of Elasticsear…

---

## [Elasticsearch \[6.8\] Shard distribution based on traffic](https://discuss.elastic.co/t/elasticsearch-6-8-shard-distribution-based-on-traffic/315422)

<div class="topic-metadata">

**Author:** [@srivatsa](https://discuss.elastic.co/u/srivatsa)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 5:32am UTC](https://discuss.elastic.co/t/elasticsearch-6-8-shard-distribution-based-on-traffic/315422 "2022-09-29T05:32:37Z")

</div>

Hi Folks, We are seeing scenarios where the cluster is allocating 6 -10 shards(primaries & replicas) of an index with shard sizes around 50GB on a single node of the cluster even though all nodes in the cluster are of t…

---

## [Logstash 8.4.2 Extremely High CPU Loading](https://discuss.elastic.co/t/logstash-8-4-2-extremely-high-cpu-loading/315417)

<div class="topic-metadata">

**Author:** [@ivanchak](https://discuss.elastic.co/u/ivanchak)\
**Replies:** 3\
**Last updated:** [September 29, 2022, 4:35am UTC](https://discuss.elastic.co/t/logstash-8-4-2-extremely-high-cpu-loading/315417 "2022-09-29T04:35:38Z")

</div>

My Logstash loading has been about avg. ~10% loading for couple months. Without any change on grokking and configuration, even event/s is about the same rate, just upgrading my Logstash to v8.4.2 causing CPU loading jump…

---

## [Extract attribute from XML field in search results](https://discuss.elastic.co/t/extract-attribute-from-xml-field-in-search-results/315420)

<div class="topic-metadata">

**Author:** [@Eddie\_Vuong](https://discuss.elastic.co/u/Eddie_Vuong)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 3:45am UTC](https://discuss.elastic.co/t/extract-attribute-from-xml-field-in-search-results/315420 "2022-09-29T03:45:20Z")

</div>

I have a field that contains XML string in my data and I want to, instead of retrieving the full XML, extract a few attributes from it in the final results. In practice I can do it using Python (query all the needed dat…

---

## [Kibana startup stuck when elasticsearch use http](https://discuss.elastic.co/t/kibana-startup-stuck-when-elasticsearch-use-http/315414)

<div class="topic-metadata">

**Author:** [@acerphoenix](https://discuss.elastic.co/u/acerphoenix)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 3:11am UTC](https://discuss.elastic.co/t/kibana-startup-stuck-when-elasticsearch-use-http/315414 "2022-09-29T03:11:15Z")

</div>

Hello, I install es and kibana version 8.4.2, they enable https by default. but i prefer http in private network. so i follow the official instruction, download es and start it, and get some security information indicat…

---

## [Kibana dashboard error](https://discuss.elastic.co/t/kibana-dashboard-error/315332)

<div class="topic-metadata">

**Author:** [@wodhgud](https://discuss.elastic.co/u/wodhgud)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 2:19am UTC](https://discuss.elastic.co/t/kibana-dashboard-error/315332 "2022-09-29T02:19:28Z")

</div>

I am currently using version 7.11.1. When dashboarding in kibana " \[parent\] data too large, data for \[index:data/read/search\[step/query\]\] is \[1045822710/997.3mb\], It is larger than the limit of \[1020054732/972.7mb\]. A…

---

## [Specify ILM process with cron syntax](https://discuss.elastic.co/t/specify-ilm-process-with-cron-syntax/315396)

<div class="topic-metadata">

**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Replies:** 2\
**Last updated:** [September 28, 2022, 10:00pm UTC](https://discuss.elastic.co/t/specify-ilm-process-with-cron-syntax/315396 "2022-09-28T22:00:35Z")

</div>

Running a very busy cluster, we want to be able to specify when ILM tasks are running. Example: we run Spark job during 2 jours, and sometimes shrink'ing happen, which completely kill search scroll performance (less sha…

---

## [ML Job low severity score](https://discuss.elastic.co/t/ml-job-low-severity-score/315408)

<div class="topic-metadata">

**Author:** [@Camilo\_Otalora](https://discuss.elastic.co/u/Camilo_Otalora)\
**Replies:** 0\
**Last updated:** [September 28, 2022, 9:59pm UTC](https://discuss.elastic.co/t/ml-job-low-severity-score/315408 "2022-09-28T21:59:14Z")

</div>

Hello! I was developing a Machine Learning task so I could automate some anomaly detection between people’s activity. We have activity x12 times higher than usual, but the severity is way lower than what we expected (\< 1…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=778)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=780)
