# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=536

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 537

---

## [Pagination, slice vs search\_after](https://discuss.elastic.co/t/pagination-slice-vs-search-after/290098)

<div class="topic-metadata">

**Author:** [@tamis-laan](https://discuss.elastic.co/u/tamis-laan)\
**Replies:** 0\
**Last updated:** [November 24, 2021, 5:37pm UTC](https://discuss.elastic.co/t/pagination-slice-vs-search-after/290098 "2021-11-24T17:37:49Z")

</div>

When looking at the documentation two methods are used for skipping pages namely search\_after and slice: What are the pro's and con's? Are they both equally efficient? Slice looks easier to use but is never mentioned…

---

## [Send user input to elasticsearch](https://discuss.elastic.co/t/send-user-input-to-elasticsearch/290065)

<div class="topic-metadata">

**Author:** [@AlexM566](https://discuss.elastic.co/u/AlexM566)\
**Replies:** 1\
**Last updated:** [November 24, 2021, 5:30pm UTC](https://discuss.elastic.co/t/send-user-input-to-elasticsearch/290065 "2021-11-24T17:30:30Z")

</div>

Hello everyone, I have a web form and I want user input to be stored in Elasticsearch into an index. I do no know how to do that, I have a method written in php but is not working :frowning: . The elk stack version is …

---

## [Curator is failing during authentication for elastic search on AWS](https://discuss.elastic.co/t/curator-is-failing-during-authentication-for-elastic-search-on-aws/289978)

<div class="topic-metadata">

**Author:** [@hudar01](https://discuss.elastic.co/u/hudar01)\
**Replies:** 2\
**Last updated:** [November 24, 2021, 5:27pm UTC](https://discuss.elastic.co/t/curator-is-failing-during-authentication-for-elastic-search-on-aws/289978 "2021-11-24T17:27:58Z")

</div>

I've setup an Elasticsearch backup and restore on S3, and I was trying to delete the backups using Curator (but it's always failing - i tried both ways using url\_prefix and without it). Could you please help how I can ma…

---

## [Ingest pipeline GeoIP processor lacking parent fields on ingestion?](https://discuss.elastic.co/t/ingest-pipeline-geoip-processor-lacking-parent-fields-on-ingestion/289950)

<div class="topic-metadata">

**Author:** [@chippey5](https://discuss.elastic.co/u/chippey5)\
**Replies:** 3\
**Last updated:** [November 24, 2021, 3:37pm UTC](https://discuss.elastic.co/t/ingest-pipeline-geoip-processor-lacking-parent-fields-on-ingestion/289950 "2021-11-24T15:37:49Z")

</div>

In our environment we have custom logs coming in of which a remote IP is ingested to a field called remoteAddr. In our ingest pipeline we're using a GeoIP processor which we use the source field remoteAddr to the target …

---

## [Facing issue while reindexing document using elasticsearch-7.9.0.jar to Elasticsearch](https://discuss.elastic.co/t/facing-issue-while-reindexing-document-using-elasticsearch-7-9-0-jar-to-elasticsearch/290085)

<div class="topic-metadata">

**Author:** [@bikas](https://discuss.elastic.co/u/bikas)\
**Replies:** 0\
**Last updated:** [November 24, 2021, 2:50pm UTC](https://discuss.elastic.co/t/facing-issue-while-reindexing-document-using-elasticsearch-7-9-0-jar-to-elasticsearch/290085 "2021-11-24T14:50:09Z")

</div>

Hi Team, We are using Elasticsearch 7.9.0 having single node cluster. We have developed a plugin which is sitting inside plugins folder of Elasticsearch. We are using Elasticsearch SDK (org.Elasticsearch:Elasticsearch:…

---

## [Extend cluster, new data nodes, identical disk space?](https://discuss.elastic.co/t/extend-cluster-new-data-nodes-identical-disk-space/289931)

<div class="topic-metadata">

**Author:** [@benoitp](https://discuss.elastic.co/u/benoitp)\
**Replies:** 7\
**Last updated:** [November 24, 2021, 1:07pm UTC](https://discuss.elastic.co/t/extend-cluster-new-data-nodes-identical-disk-space/289931 "2021-11-24T13:07:14Z")

</div>

Hello, I have a cluster with 4 data nodes, each with a storage of 4 To dedicated to the ES datas. Can i add 2 more data nodes, but only with 2 To of disk dedicated to the ES datas ? I don’t know if ES will handle this…

---

## [Curator - shard has exceeded the maximum number of retries \[1\]](https://discuss.elastic.co/t/curator-shard-has-exceeded-the-maximum-number-of-retries-1/290059)

<div class="topic-metadata">

**Author:** [@KaZuKi\_Yashiro](https://discuss.elastic.co/u/KaZuKi_Yashiro)\
**Replies:** 0\
**Last updated:** [November 24, 2021, 12:16pm UTC](https://discuss.elastic.co/t/curator-shard-has-exceeded-the-maximum-number-of-retries-1/290059 "2021-11-24T12:16:48Z")

</div>

Good afternoon. Current cnfiguration: ES version 6.8.8 in docker "docker.elastic.co/elasticsearch/elasticsearch:6.8.8" heap\_size: 31g "number\_of\_nodes" : 3, "number\_of\_data\_nodes" : 3, "active\_primary\_shards" : 125…

---

## [Problem re-adding the same fields to start with a lowercase letter when updating](https://discuss.elastic.co/t/problem-re-adding-the-same-fields-to-start-with-a-lowercase-letter-when-updating/290015)

<div class="topic-metadata">

**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\
**Replies:** 2\
**Last updated:** [November 24, 2021, 10:01am UTC](https://discuss.elastic.co/t/problem-re-adding-the-same-fields-to-start-with-a-lowercase-letter-when-updating/290015 "2021-11-24T10:01:44Z")

</div>

Hello dear friends. I am encountering a problem while updating. The problem I'm having is, for example, I want to update the Title field, but I see that a new field has been created for the Title field in the document. (…

---

## [Elasticsearch index stopped](https://discuss.elastic.co/t/elasticsearch-index-stopped/290021)

<div class="topic-metadata">

**Author:** [@bahman\_shahrzad\_asr](https://discuss.elastic.co/u/bahman_shahrzad_asr)\
**Replies:** 1\
**Last updated:** [November 24, 2021, 8:16am UTC](https://discuss.elastic.co/t/elasticsearch-index-stopped/290021 "2021-11-24T08:16:38Z")

</div>

have graylog 4.x on ubuntu 20.04. standard installation. I can log in to my gralog but all data is one week old. services says running but : graylog-server.service: Failed with result ‘timeout’. in graylog log i have …

---

## [Elastic Cluster Performance Issue](https://discuss.elastic.co/t/elastic-cluster-performance-issue/289701)

<div class="topic-metadata">

**Author:** [@Clyton](https://discuss.elastic.co/u/Clyton)\
**Replies:** 2\
**Last updated:** [November 24, 2021, 8:02am UTC](https://discuss.elastic.co/t/elastic-cluster-performance-issue/289701 "2021-11-24T08:02:01Z")

</div>

Hi All, We have a set-up of Pipeline: Beats Agents--\>AWS MSK--\>LogStash--\>Elasticsearch. In which application team sends their application logs through this pipeline. We have 8 AWS ec2 instances which is running on Auto…

---

## [How to send Azure Linux VM auth logs to Elastic cloud using Event Hubs](https://discuss.elastic.co/t/how-to-send-azure-linux-vm-auth-logs-to-elastic-cloud-using-event-hubs/290022)

<div class="topic-metadata">

**Author:** [@lgr](https://discuss.elastic.co/u/lgr)\
**Replies:** 0\
**Last updated:** [November 24, 2021, 7:55am UTC](https://discuss.elastic.co/t/how-to-send-azure-linux-vm-auth-logs-to-elastic-cloud-using-event-hubs/290022 "2021-11-24T07:55:59Z")

</div>

Hi, i have small environment using couple of Azure technologies compatible with LAW (Log Analytics Workspace \[Sentinel\]). Is there a way to send Azure linux VM (auth) logs from LAW to Elastic cloud using Event Hubs? The…

---

## [How do I get the \_id which is the document id using NEST?](https://discuss.elastic.co/t/how-do-i-get-the-id-which-is-the-document-id-using-nest/288841)

<div class="topic-metadata">

**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\
**Replies:** 2\
**Last updated:** [November 24, 2021, 6:17am UTC](https://discuss.elastic.co/t/how-do-i-get-the-id-which-is-the-document-id-using-nest/288841 "2021-11-24T06:17:34Z")

</div>

Hello dear friends, I have a question. I want to retrieve the \_id of a document, how can I do that with using Nest? The field I want to reach is the following "\_id" field : "\_id" : "4912ba5cfb86ea63541c7007b1791ab3a6f0…

---

## [Elastic Agent, single custom log to multiple indices via ingest pipeline](https://discuss.elastic.co/t/elastic-agent-single-custom-log-to-multiple-indices-via-ingest-pipeline/290002)

<div class="topic-metadata">

**Author:** [@rappersdelight](https://discuss.elastic.co/u/rappersdelight)\
**Replies:** 6\
**Last updated:** [November 24, 2021, 3:06am UTC](https://discuss.elastic.co/t/elastic-agent-single-custom-log-to-multiple-indices-via-ingest-pipeline/290002 "2021-11-24T03:06:13Z")

</div>

I am using elastic agent to capture the custom log from a pihole server, but I would like to split out the dns logs and the dhcp logs that are both found in pihole.log into different indexes. Things are working well, pr…

---

## [Index rollover and hot to warm node move](https://discuss.elastic.co/t/index-rollover-and-hot-to-warm-node-move/289982)

<div class="topic-metadata">

**Author:** [@keiransteele](https://discuss.elastic.co/u/keiransteele)\
**Replies:** 1\
**Last updated:** [November 24, 2021, 1:44am UTC](https://discuss.elastic.co/t/index-rollover-and-hot-to-warm-node-move/289982 "2021-11-24T01:44:05Z")

</div>

I'm trying to understand how ILM works with the default 50GB/30days policy if I also want to move indicies longer than 7 days to warm nodes and it takes longer than 7 days to fill an index. Should I actually be making th…

---

## [Is possible to listen index changes?](https://discuss.elastic.co/t/is-possible-to-listen-index-changes/289988)

<div class="topic-metadata">

**Author:** [@thewasta](https://discuss.elastic.co/u/thewasta)\
**Replies:** 2\
**Last updated:** [November 24, 2021, 1:25am UTC](https://discuss.elastic.co/t/is-possible-to-listen-index-changes/289988 "2021-11-24T01:25:31Z")

</div>

I need to 'listen' for changes on my index, at first I started by writing a script in nodejs which is executed every 5min. For now I think it works... But can I do it in realtime? When a new document is insert or update. …

---

## [Full text search on both Parent and Child](https://discuss.elastic.co/t/full-text-search-on-both-parent-and-child/289990)

<div class="topic-metadata">

**Author:** [@annasunny](https://discuss.elastic.co/u/annasunny)\
**Replies:** 0\
**Last updated:** [November 23, 2021, 10:20pm UTC](https://discuss.elastic.co/t/full-text-search-on-both-parent-and-child/289990 "2021-11-23T22:20:14Z")

</div>

Hi, I'm looking for a query ( or multiple queries) to do a full text search on both Parent and Child. Thank you in advance! I'm using the parent-child type. For example, my Parent documents will be a Choice, and its s…

---

## [How does the new (7.14+) GeoIP Processor Work?](https://discuss.elastic.co/t/how-does-the-new-7-14-geoip-processor-work/289957)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 4\
**Last updated:** [November 23, 2021, 6:00pm UTC](https://discuss.elastic.co/t/how-does-the-new-7-14-geoip-processor-work/289957 "2021-11-23T18:00:24Z")

</div>

Hi, In 7.14+ Elasticsearch enabled the GeoIP downloader and made the DB reloadable. But I was wondering how does this actually work. Looking at the docs, it seems like all this process does now is download the DB file, …

---

## [Query a result set from another query](https://discuss.elastic.co/t/query-a-result-set-from-another-query/289964)

<div class="topic-metadata">

**Author:** [@antonkallenberg](https://discuss.elastic.co/u/antonkallenberg)\
**Replies:** 0\
**Last updated:** [November 23, 2021, 3:46pm UTC](https://discuss.elastic.co/t/query-a-result-set-from-another-query/289964 "2021-11-23T15:46:32Z")

</div>

Hi, Is it possible to query a result set from another query? Example List all employees by organization with ID #1 \> returns 10 employees. From those 10 employees \> List all employees working at department with ID #1 …

---

## [Highlights not matching between annotated\_text and other fields](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937)

<div class="topic-metadata">

**Author:** [@evoluc](https://discuss.elastic.co/u/evoluc)\
**Replies:** 4\
**Last updated:** [November 23, 2021, 3:26pm UTC](https://discuss.elastic.co/t/highlights-not-matching-between-annotated-text-and-other-fields/289937 "2021-11-23T15:26:06Z")

</div>

Executing a query\_string search on an index the returned matched highlights sometimes don't really match (this is needed to get the annotated metadata). From what I've seen there is not much support for this kind of feat…

---

## [Unable to start elasticsearch on windows "The system cannot find the path specified."](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-windows-the-system-cannot-find-the-path-specified/289914)

<div class="topic-metadata">

**Author:** [@tahseen\_fatima](https://discuss.elastic.co/u/tahseen_fatima)\
**Replies:** 1\
**Last updated:** [November 23, 2021, 2:17pm UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-windows-the-system-cannot-find-the-path-specified/289914 "2021-11-23T14:17:20Z")

</div>

Hi, Use case : I have to perform an upgrade activity in production environment. Upgrade from 7.7.1 version to 7.15.0 on windows 2016 64 bit OS. Before performing I am doing a testing in a lower environment. Where I h…

---

## [Syslogging Struggle - newbie alert](https://discuss.elastic.co/t/syslogging-struggle-newbie-alert/289861)

<div class="topic-metadata">

**Author:** [@Orpheus](https://discuss.elastic.co/u/Orpheus)\
**Replies:** 4\
**Last updated:** [November 23, 2021, 2:07pm UTC](https://discuss.elastic.co/t/syslogging-struggle-newbie-alert/289861 "2021-11-23T14:07:45Z")

</div>

Hi, I'm just getting familiar with Elastic Stack, and implementing ELK with Filebeat to a syslog server that receives the syslogs from various routers on a network. The routers are running RouterOS on mikrotik routers, …

---

## [Multiget (mget) API performance](https://discuss.elastic.co/t/multiget-mget-api-performance/289813)

<div class="topic-metadata">

**Author:** [@jon\_cabrera](https://discuss.elastic.co/u/jon_cabrera)\
**Replies:** 4\
**Last updated:** [November 23, 2021, 2:02pm UTC](https://discuss.elastic.co/t/multiget-mget-api-performance/289813 "2021-11-23T14:02:22Z")

</div>

Hello! I am working on a search engine and I have introduced the use of the mget API to obtain a series of documents from a series of ids. My question is related to a series of issues that I have been able to observe i…

---

## [Receiving data via HTTPs or Ingest Pipelines](https://discuss.elastic.co/t/receiving-data-via-https-or-ingest-pipelines/289849)

<div class="topic-metadata">

**Author:** [@sc12](https://discuss.elastic.co/u/sc12)\
**Replies:** 6\
**Last updated:** [November 23, 2021, 11:44am UTC](https://discuss.elastic.co/t/receiving-data-via-https-or-ingest-pipelines/289849 "2021-11-23T11:44:53Z")

</div>

Hello, I've been searching on the forums and haven't been able to find an answer to the problem I'm facing. The issue I'm facing: I am trying to send data via REST Api to an Elastic Cloud instance, in my head, I am su…

---

## [Query with multiple keywords](https://discuss.elastic.co/t/query-with-multiple-keywords/289929)

<div class="topic-metadata">

**Author:** [@Leitner](https://discuss.elastic.co/u/Leitner)\
**Replies:** 2\
**Last updated:** [November 23, 2021, 10:23am UTC](https://discuss.elastic.co/t/query-with-multiple-keywords/289929 "2021-11-23T10:23:32Z")

</div>

Hi everyone, I'm new on Elasticsearch. So sorry for my question :slight\_smile: I want build a query in the console. With a single keyword it works great: But with multiple keywords the Value of the hits is always 0…

---

## [High level rest client connection](https://discuss.elastic.co/t/high-level-rest-client-connection/289899)

<div class="topic-metadata">

**Author:** [@111505](https://discuss.elastic.co/u/111505)\
**Replies:** 4\
**Last updated:** [November 23, 2021, 9:58am UTC](https://discuss.elastic.co/t/high-level-rest-client-connection/289899 "2021-11-23T09:58:23Z")

</div>

Hello. Questions about maintaining the connection of "Elasticsearch-Rest-High-Level-Client" in Java. RestClient.builder is created using a connection. But when i am using it on a 365-day server, do i have to connect and…

---

## [Snapshot repository fails to verify](https://discuss.elastic.co/t/snapshot-repository-fails-to-verify/289902)

<div class="topic-metadata">

**Author:** [@vishnu\_rao](https://discuss.elastic.co/u/vishnu_rao)\
**Replies:** 0\
**Last updated:** [November 23, 2021, 6:24am UTC](https://discuss.elastic.co/t/snapshot-repository-fails-to-verify/289902 "2021-11-23T06:24:26Z")

</div>

Continuing the discussion from Snapshot to minio S3 error: @DavidTurner When you say each node.. is it worker node of the cluster or the pods on which the Elasticsearch Application is hosted ? Kindly let me know pls an…

---

## [Is it possible to search in random files with random texts in it with Elastic Search?](https://discuss.elastic.co/t/is-it-possible-to-search-in-random-files-with-random-texts-in-it-with-elastic-search/289863)

<div class="topic-metadata">

**Author:** [@Sahin\_Kasap](https://discuss.elastic.co/u/Sahin_Kasap)\
**Replies:** 4\
**Last updated:** [November 23, 2021, 8:25am UTC](https://discuss.elastic.co/t/is-it-possible-to-search-in-random-files-with-random-texts-in-it-with-elastic-search/289863 "2021-11-23T08:25:48Z")

</div>

Hello, I am developing a backend and I have big pdf files(~20 MB), which I want to search words inside. I could upload the texts inside them to Sql or somewhere and search inside them, but this would be slow and pdf's h…

---

## [ES 7.10 docker performance issues](https://discuss.elastic.co/t/es-7-10-docker-performance-issues/289911)

<div class="topic-metadata">

**Author:** [@Pieter\_Agenbag](https://discuss.elastic.co/u/Pieter_Agenbag)\
**Replies:** 0\
**Last updated:** [November 23, 2021, 7:11am UTC](https://discuss.elastic.co/t/es-7-10-docker-performance-issues/289911 "2021-11-23T07:11:28Z")

</div>

Good morning. I'm running some tests on using docker to spin up multiple nodes and cluster them together on a single bare metal server.... but having major query performance issues. For my test I only have 2 nodes with…

---

## [Elasticseach multi data path，every shard only stored into one data path](https://discuss.elastic.co/t/elasticseach-multi-data-path-every-shard-only-stored-into-one-data-path/289895)

<div class="topic-metadata">

**Author:** [@qixian](https://discuss.elastic.co/u/qixian)\
**Replies:** 6\
**Last updated:** [November 23, 2021, 6:29am UTC](https://discuss.elastic.co/t/elasticseach-multi-data-path-every-shard-only-stored-into-one-data-path/289895 "2021-11-23T06:29:38Z")

</div>

when i use Elasticsearch to store my data,i have a Confuse，every Elasticsearch process I have config multi data path，but I find every shard of indices is only stored one data path，I want to know if one shard can be store…

---

## [Closing the Index released the RAM and Inodes?](https://discuss.elastic.co/t/closing-the-index-released-the-ram-and-inodes/289897)

<div class="topic-metadata">

**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\
**Replies:** 7\
**Last updated:** [November 23, 2021, 5:49am UTC](https://discuss.elastic.co/t/closing-the-index-released-the-ram-and-inodes/289897 "2021-11-23T05:49:12Z")

</div>

Hi Team, I have around 150 Indices open and my server has around 64 GB of RAM and 8 core CPU. Soon I believe my system would start complaining about RAM and inodes. Hence wanted to confirm if I close the index will that…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=535)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=537)
