# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=553

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 554

---

## [Physically Moving Indices To New Drive](https://discuss.elastic.co/t/physically-moving-indices-to-new-drive/287611)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 5:46pm UTC](https://discuss.elastic.co/t/physically-moving-indices-to-new-drive/287611 "2021-10-25T17:46:02Z")

</div>

I have a need to move where indices are stored to a new drive. How do I go about migrating to the new drive? Change Elasticsearch.yml to the new drive and then reindex all the existing data? I'd hate to do that with t…

---

## [Elasticsearch Postgresql Module Ingest Pipeline Not Parsing Postgresql 10](https://discuss.elastic.co/t/elasticsearch-postgresql-module-ingest-pipeline-not-parsing-postgresql-10/287604)

<div class="topic-metadata">

**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\
**Replies:** 0\
**Last updated:** [October 25, 2021, 4:09pm UTC](https://discuss.elastic.co/t/elasticsearch-postgresql-module-ingest-pipeline-not-parsing-postgresql-10/287604 "2021-10-25T16:09:02Z")

</div>

Elasticsearch ingest pipeline for postgresql module doesn't appear to parse postgresql 10 logs. This is with filebeat-7.15.0 and associated ingest pipelines under elasticsearch-7.14.1. We're using Postgresql 10. The fol…

---

## [Elasticsearch high level java client mock test](https://discuss.elastic.co/t/elasticsearch-high-level-java-client-mock-test/287571)

<div class="topic-metadata">

**Author:** [@111505](https://discuss.elastic.co/u/111505)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 3:39pm UTC](https://discuss.elastic.co/t/elasticsearch-high-level-java-client-mock-test/287571 "2021-10-25T15:39:41Z")

</div>

I am using a RestHighlevelclient in the Spring Boot environment. I want to create a JUnit Test Code, but I can not find a way. Is there no test method to officially provide? I want to test the normal operation of basi…

---

## [Term query wrong behaviour?](https://discuss.elastic.co/t/term-query-wrong-behaviour/287530)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 4\
**Last updated:** [October 25, 2021, 3:11pm UTC](https://discuss.elastic.co/t/term-query-wrong-behaviour/287530 "2021-10-25T15:11:12Z")

</div>

Hi, according to the documentation a term query search for the exact match. but when I do the below search I get results and when I look for the exact match in uppercase I dont get any results This should not hap…

---

## [Snmp network traffic and trends](https://discuss.elastic.co/t/snmp-network-traffic-and-trends/287585)

<div class="topic-metadata">

**Author:** [@leostereo](https://discuss.elastic.co/u/leostereo)\
**Replies:** 0\
**Last updated:** [October 25, 2021, 2:22pm UTC](https://discuss.elastic.co/t/snmp-network-traffic-and-trends/287585 "2021-10-25T14:22:21Z")

</div>

Hi guys. I have same experience using elk with neflow beat. Now im looking for some way to bring traffic from my router , create graphs , similar than librenms , cacti , an so. But I would also add some intelligence t…

---

## [Help with query in CLI](https://discuss.elastic.co/t/help-with-query-in-cli/287584)

<div class="topic-metadata">

**Author:** [@Nick\_Hatfield](https://discuss.elastic.co/u/Nick_Hatfield)\
**Replies:** 0\
**Last updated:** [October 25, 2021, 1:52pm UTC](https://discuss.elastic.co/t/help-with-query-in-cli/287584 "2021-10-25T13:52:11Z")

</div>

Hi guys, please help me understand how to make a query work from the cli. I either match too much or nothing at all... So here's the payload sample: { "took": 3, "timed\_out": false, "\_shards": { "total": 5, …

---

## [Doc\_as\_upsert but don't deleted nested](https://discuss.elastic.co/t/doc-as-upsert-but-dont-deleted-nested/287564)

<div class="topic-metadata">

**Author:** [@Grant\_Donovan1](https://discuss.elastic.co/u/Grant_Donovan1)\
**Replies:** 0\
**Last updated:** [October 25, 2021, 10:51am UTC](https://discuss.elastic.co/t/doc-as-upsert-but-dont-deleted-nested/287564 "2021-10-25T10:51:16Z")

</div>

I am using the doc\_as\_upsert to update my document if it already exists, for example { "doc": { "apple": "new\_name", "test\_list": \[ { "value": "first value group 1", "value\_set": {…

---

## [Is my data stream not rolling over to a new index like it's supposed to?](https://discuss.elastic.co/t/is-my-data-stream-not-rolling-over-to-a-new-index-like-its-supposed-to/287515)

<div class="topic-metadata">

**Author:** [@nsouth](https://discuss.elastic.co/u/nsouth)\
**Replies:** 2\
**Last updated:** [October 25, 2021, 10:30am UTC](https://discuss.elastic.co/t/is-my-data-stream-not-rolling-over-to-a-new-index-like-its-supposed-to/287515 "2021-10-25T10:30:56Z")

</div>

We have a data stream created by Logstash and it's using the default index template and ILM policy. My understanding is that the data stream should roll over to a new index once the initial index has 50 GB of data or is …

---

## [SLM Policy Naming](https://discuss.elastic.co/t/slm-policy-naming/287557)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 9:52am UTC](https://discuss.elastic.co/t/slm-policy-naming/287557 "2021-10-25T09:52:14Z")

</div>

Hi, I'm trying to upload an SLM policy and am getting the following error: elasticsearch.exceptions.RequestError: RequestError(400, 'action\_request\_validation\_exception', 'Validation Failed: 1: invalid snapshot name \[s…

---

## [Query optimization](https://discuss.elastic.co/t/query-optimization/287559)

<div class="topic-metadata">

**Author:** [@hadrienrsq](https://discuss.elastic.co/u/hadrienrsq)\
**Replies:** 0\
**Last updated:** [October 25, 2021, 9:43am UTC](https://discuss.elastic.co/t/query-optimization/287559 "2021-10-25T09:43:44Z")

</div>

Dear community, I am pretty brand new to Elasticsearch and am looking to perform some sort of two steps query on one index. Indeed, the items in the index have what we call a cli\_ID attribute, which I would like to pre-…

---

## [Automatic deletion of old documents](https://discuss.elastic.co/t/automatic-deletion-of-old-documents/287297)

<div class="topic-metadata">

**Author:** [@x41lakazam](https://discuss.elastic.co/u/x41lakazam)\
**Replies:** 3\
**Last updated:** [October 25, 2021, 8:57am UTC](https://discuss.elastic.co/t/automatic-deletion-of-old-documents/287297 "2021-10-25T08:57:24Z")

</div>

Hi there, Is there a way to configure an index so that every document gets deleted once he is more than 90 days ? I saw a lot of topics that propose to use a delete query in a crontab job but that sounds very inefficie…

---

## [Elasticsearch WARN log : "message": "path: /.kibana\_task\_manager/\_search"](https://discuss.elastic.co/t/elasticsearch-warn-log-message-path-kibana-task-manager-search/287483)

<div class="topic-metadata">

**Author:** [@Farzad\_Ebrahimi](https://discuss.elastic.co/u/Farzad_Ebrahimi)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 8:54am UTC](https://discuss.elastic.co/t/elasticsearch-warn-log-message-path-kibana-task-manager-search/287483 "2021-10-25T08:54:37Z")

</div>

Hi everyone, today we faced to this log with level WARN: {"type": "server", "timestamp": "2021-10-23T05:13:43,815Z", "level": "WARN", "component": "r.suppressed", "cluster.name": "elasticsearch\_cluster", "node.name": "…

---

## [BigQuery to Elasticsearch Self-Managed configuration](https://discuss.elastic.co/t/bigquery-to-elasticsearch-self-managed-configuration/287228)

<div class="topic-metadata">

**Author:** [@Mandark1990](https://discuss.elastic.co/u/Mandark1990)\
**Replies:** 10\
**Last updated:** [October 25, 2021, 8:52am UTC](https://discuss.elastic.co/t/bigquery-to-elasticsearch-self-managed-configuration/287228 "2021-10-25T08:52:41Z")

</div>

Hi All, Am trying to test out the steps given here: https://www.elastic.co/blog/ingest-data-directly-from-google-bigquery-into-elastic-using-google-dataflow As per the documentation it says the implementation flow rem…

---

## [Suggest Elasticsearch Cluster Configuration](https://discuss.elastic.co/t/suggest-elasticsearch-cluster-configuration/287551)

<div class="topic-metadata">

**Author:** [@Farzad\_Ebrahimi](https://discuss.elastic.co/u/Farzad_Ebrahimi)\
**Replies:** 2\
**Last updated:** [October 25, 2021, 8:30am UTC](https://discuss.elastic.co/t/suggest-elasticsearch-cluster-configuration/287551 "2021-10-25T08:30:20Z")

</div>

Is it possible to use several Elasticsearch nodes with Docker on one machine in production? Suppose the indexes are daily and their size is about 150 GB and the number of documents in each index is more than 15 million. …

---

## [Delete by query](https://discuss.elastic.co/t/delete-by-query/287322)

<div class="topic-metadata">

**Author:** [@Giovanni\_Di\_Lembo](https://discuss.elastic.co/u/Giovanni_Di_Lembo)\
**Replies:** 6\
**Last updated:** [October 25, 2021, 7:39am UTC](https://discuss.elastic.co/t/delete-by-query/287322 "2021-10-25T07:39:54Z")

</div>

Hi all, and sorry for my poor english. I need to build a delete by query request. My porpose is to delete 'activity' elements in 'activities' array where 'creationDate' is less than some date. My index mapping is { …

---

## [Installable plugin (Elastic cloud - ES 7.15)](https://discuss.elastic.co/t/installable-plugin-elastic-cloud-es-7-15/287325)

<div class="topic-metadata">

**Author:** [@puyash](https://discuss.elastic.co/u/puyash)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 3:57am UTC](https://discuss.elastic.co/t/installable-plugin-elastic-cloud-es-7-15/287325 "2021-10-25T03:57:38Z")

</div>

Trying to add plugin (.zip) through the Extensions tool. But I can't choose "installable plugin". Says it is not supported by my subscription. No additional information and nothing in the documentation. Have tried all ti…

---

## [Elasticsearch P12 certs error](https://discuss.elastic.co/t/elasticsearch-p12-certs-error/287367)

<div class="topic-metadata">

**Author:** [@john\_99](https://discuss.elastic.co/u/john_99)\
**Replies:** 0\
**Last updated:** [October 21, 2021, 9:08pm UTC](https://discuss.elastic.co/t/elasticsearch-p12-certs-error/287367 "2021-10-21T21:08:40Z")

</div>

Hi Team, I am getting some errors while renewing the p12 certs. I followed the below steps: Ste: 1 cd /usr/share/Elasticsearch Step 2: ./bin/Elasticsearch-certutil ca Step 3: ./bin/Elasticsearch-certutil cert --ca e…

---

## [How to save One index field into another index?](https://discuss.elastic.co/t/how-to-save-one-index-field-into-another-index/287399)

<div class="topic-metadata">

**Author:** [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 3:54am UTC](https://discuss.elastic.co/t/how-to-save-one-index-field-into-another-index/287399 "2021-10-25T03:54:14Z")

</div>

I want to save SMS data in another field because I am getting the same SMS three times that's why to avoid duplication I used document\_id that is overriding the old with a new one but problem is that I am getting SMS dat…

---

## [Question with RestClientBuilder's default setting](https://discuss.elastic.co/t/question-with-restclientbuilders-default-setting/287528)

<div class="topic-metadata">

**Author:** [@finishne](https://discuss.elastic.co/u/finishne)\
**Replies:** 0\
**Last updated:** [October 25, 2021, 3:43am UTC](https://discuss.elastic.co/t/question-with-restclientbuilders-default-setting/287528 "2021-10-25T03:43:27Z")

</div>

Recently I ran into a problem. When accessing cluster at 2000qps, the service caused the local connection timeout due to the index warm-up. However, these connections created by the AsynHttpClient of RestHighLevelClient…

---

## [How To make my elasticsearch index smaller by field values?](https://discuss.elastic.co/t/how-to-make-my-elasticsearch-index-smaller-by-field-values/287471)

<div class="topic-metadata">

**Author:** [@dfang](https://discuss.elastic.co/u/dfang)\
**Replies:** 1\
**Last updated:** [October 25, 2021, 3:30am UTC](https://discuss.elastic.co/t/how-to-make-my-elasticsearch-index-smaller-by-field-values/287471 "2021-10-25T03:30:34Z")

</div>

I have setup ELK running fine. I have filebeat feeding log data via logstash then into Elasticsearch indice. This setup create one logstash index per-day . The challenge now is to find ways to break down the indices into…

---

## [Multi words synonyms with tokens between the synonym's parts](https://discuss.elastic.co/t/multi-words-synonyms-with-tokens-between-the-synonyms-parts/287518)

<div class="topic-metadata">

**Author:** [@Olaph](https://discuss.elastic.co/u/Olaph)\
**Replies:** 1\
**Last updated:** [October 24, 2021, 10:41pm UTC](https://discuss.elastic.co/t/multi-words-synonyms-with-tokens-between-the-synonyms-parts/287518 "2021-10-24T22:41:03Z")

</div>

Hi, given, that I have following synonyms configuration: "želvárium,aquaterrarium for turtles" (želvárium is czech short-term for aquarium for turtles) Is there a way that allowes me to match a document with followin…

---

## [The words in the document field are included in the query text with fuzzy logic](https://discuss.elastic.co/t/the-words-in-the-document-field-are-included-in-the-query-text-with-fuzzy-logic/287370)

<div class="topic-metadata">

**Author:** [@aleksander.zwd](https://discuss.elastic.co/u/aleksander.zwd)\
**Replies:** 0\
**Last updated:** [October 21, 2021, 9:18pm UTC](https://discuss.elastic.co/t/the-words-in-the-document-field-are-included-in-the-query-text-with-fuzzy-logic/287370 "2021-10-21T21:18:01Z")

</div>

In Elasticsearch I have an index with documents containing a text type field "name" containing first name(s) and surname, e.g .: Rebecca Donovan Julian Fred Drake Miley Angela Saunders ... and a query with a text fi…

---

## [Filebeat index not created](https://discuss.elastic.co/t/filebeat-index-not-created/287506)

<div class="topic-metadata">

**Author:** [@dev9](https://discuss.elastic.co/u/dev9)\
**Replies:** 13\
**Last updated:** [October 24, 2021, 5:59am UTC](https://discuss.elastic.co/t/filebeat-index-not-created/287506 "2021-10-24T05:59:44Z")

</div>

Hi Guys, I spent hours trying to get filebeat to index a custom log file but I am not having any luck in seeing any of the data ingest. I provided all of my setup details on stack overflow (formatting of yaml here is o…

---

## [Snaphsot repository Read Only URL via FTP](https://discuss.elastic.co/t/snaphsot-repository-read-only-url-via-ftp/287497)

<div class="topic-metadata">

**Author:** [@ylasri](https://discuss.elastic.co/u/ylasri)\
**Replies:** 4\
**Last updated:** [October 23, 2021, 6:04pm UTC](https://discuss.elastic.co/t/snaphsot-repository-read-only-url-via-ftp/287497 "2021-10-23T18:04:44Z")

</div>

I have an Elasticsearch cluster of 3 nodes with version 7.15.0. I want to add a read-only URL repository soi can fetch a snapshot for restore. PUT /\_snapshot/ftp\_snaphoot { "type": "url", "settings": { "url": "…

---

## [Finding unique dates](https://discuss.elastic.co/t/finding-unique-dates/287489)

<div class="topic-metadata">

**Author:** [@cassebas](https://discuss.elastic.co/u/cassebas)\
**Replies:** 0\
**Last updated:** [October 23, 2021, 12:54pm UTC](https://discuss.elastic.co/t/finding-unique-dates/287489 "2021-10-23T12:54:10Z")

</div>

I have a dataset about deliveries, with a datetime in the format yyyy-mm-dd hh:mm:ss (for example: "29-2-2020 13:31:00"). Now I wan't to count the number of unique days in the set. I tried using cardinality in combinati…

---

## [How good is to clear the field data cache on a regular basis](https://discuss.elastic.co/t/how-good-is-to-clear-the-field-data-cache-on-a-regular-basis/287400)

<div class="topic-metadata">

**Author:** [@curiousmind](https://discuss.elastic.co/u/curiousmind)\
**Replies:** 1\
**Last updated:** [October 23, 2021, 10:41am UTC](https://discuss.elastic.co/t/how-good-is-to-clear-the-field-data-cache-on-a-regular-basis/287400 "2021-10-23T10:41:11Z")

</div>

I have big daily indices and sometimes the indexing get stopped or delayed. When i clear the cache, everything goes back to normal. So I was thinking of clearing the cache , especially field cache in every 20-30 minutes …

---

## [Dealing with changes in field datatype](https://discuss.elastic.co/t/dealing-with-changes-in-field-datatype/286952)

<div class="topic-metadata">

**Author:** [@raonic](https://discuss.elastic.co/u/raonic)\
**Replies:** 2\
**Last updated:** [October 18, 2021, 6:41pm UTC](https://discuss.elastic.co/t/dealing-with-changes-in-field-datatype/286952 "2021-10-18T18:41:08Z")

</div>

Hello, I have an Elasticsearch index where fields are configured by clients (indirectly) i.e., the clients configure the datatype for these fields through an interface and then I have a workflow which creates the actual…

---

## [Get Current Top 5 Over Time with Date Histogram](https://discuss.elastic.co/t/get-current-top-5-over-time-with-date-histogram/287473)

<div class="topic-metadata">

**Author:** [@dmer](https://discuss.elastic.co/u/dmer)\
**Replies:** 0\
**Last updated:** [October 22, 2021, 10:47pm UTC](https://discuss.elastic.co/t/get-current-top-5-over-time-with-date-histogram/287473 "2021-10-22T22:47:57Z")

</div>

Suppose I have an index filled with Person records, and I want to get the doc counts for the top 5 names (based on today) over the past week. To clarify, I don't want the top 5 names each day, instead I want to show the …

---

## [Accessing search API using api key and acces token-based authentication](https://discuss.elastic.co/t/accessing-search-api-using-api-key-and-acces-token-based-authentication/287468)

<div class="topic-metadata">

**Author:** [@parkerjgit](https://discuss.elastic.co/u/parkerjgit)\
**Replies:** 0\
**Last updated:** [October 22, 2021, 9:04pm UTC](https://discuss.elastic.co/t/accessing-search-api-using-api-key-and-acces-token-based-authentication/287468 "2021-10-22T21:04:50Z")

</div>

Hi, I need some help accessing the Search API. I Have elastic cloud setup as azure managed service. I can access the cloud Service API using API key-based authentication: curl -X GET -H "Authorization: ApiKey \<api\_key\>"…

---

## [Jvm.options with 7.15.0](https://discuss.elastic.co/t/jvm-options-with-7-15-0/287254)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 9\
**Last updated:** [October 22, 2021, 7:29pm UTC](https://discuss.elastic.co/t/jvm-options-with-7-15-0/287254 "2021-10-22T19:29:33Z")

</div>

I know the newer version handles ram automatically and that's great. But I'm seeing the java option sets Xms and Xmx both to 1024m even though I have 96GB of ram on my machine. Should I just ignore this? 51108 ? SLsl …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=552)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=554)
