# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=479

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 480

---

## [Make several fields from one nested field](https://discuss.elastic.co/t/make-several-fields-from-one-nested-field/299177)

<div class="topic-metadata">

**Author:** [@voverm](https://discuss.elastic.co/u/voverm)\
**Replies:** 5\
**Last updated:** [March 9, 2022, 10:40am UTC](https://discuss.elastic.co/t/make-several-fields-from-one-nested-field/299177 "2022-03-09T10:40:26Z")

</div>

Hello! I've an index which has a field called properties (besides the one that is defined in the top-level) in mappings with this structure: "properties": { "type": "nested", "properties": { "code": { "typ…

---

## [Elasticsearch with React.js: match\_phrase](https://discuss.elastic.co/t/elasticsearch-with-react-js-match-phrase/298958)

<div class="topic-metadata">

**Author:** [@Karina\_Ivanova](https://discuss.elastic.co/u/Karina_Ivanova)\
**Replies:** 1\
**Last updated:** [March 9, 2022, 10:23am UTC](https://discuss.elastic.co/t/elasticsearch-with-react-js-match-phrase/298958 "2022-03-09T10:23:34Z")

</div>

Hello, I'm quite new to Elasticsearch and React and I'm trying to build an app that fetches .json data through API. Everything works fine but I can't get my head around two things: how to use Match phrase query and how …

---

## [High memory taken by segments.terms\_memory\_in\_bytes](https://discuss.elastic.co/t/high-memory-taken-by-segments-terms-memory-in-bytes/299134)

<div class="topic-metadata">

**Author:** [@Vikrant\_Aggarwal](https://discuss.elastic.co/u/Vikrant_Aggarwal)\
**Replies:** 11\
**Last updated:** [March 9, 2022, 10:18am UTC](https://discuss.elastic.co/t/high-memory-taken-by-segments-terms-memory-in-bytes/299134 "2022-03-09T10:18:11Z")

</div>

Hello Experts, ES : 6.4 We have 21 data nodes cluster. Seeing high memory consumed by segments.terms\_memory\_in\_bytes which causing circuit breaker issues for us. Wanted to understand why segments are taking so much mem…

---

## [Elastic search upgrade from 7.14.2 to 8.0 or near to that](https://discuss.elastic.co/t/elastic-search-upgrade-from-7-14-2-to-8-0-or-near-to-that/298961)

<div class="topic-metadata">

**Author:** [@Vinay\_Menon1](https://discuss.elastic.co/u/Vinay_Menon1)\
**Replies:** 7\
**Last updated:** [March 9, 2022, 10:17am UTC](https://discuss.elastic.co/t/elastic-search-upgrade-from-7-14-2-to-8-0-or-near-to-that/298961 "2022-03-09T10:17:38Z")

</div>

Hi Team, I need to upgrade Elasticsearch from 7.14.2 which I see in stack management to 8.0 or near to that version I am also using heartbeat, metricbeat & logstash as well on the on few of the servers to collect data/…

---

## [Monitoring Azure using Elastic Cloud](https://discuss.elastic.co/t/monitoring-azure-using-elastic-cloud/298948)

<div class="topic-metadata">

**Author:** [@mgfeal](https://discuss.elastic.co/u/mgfeal)\
**Replies:** 3\
**Last updated:** [March 9, 2022, 9:45am UTC](https://discuss.elastic.co/t/monitoring-azure-using-elastic-cloud/298948 "2022-03-09T09:45:46Z")

</div>

Hello, We have infrastructure in Azure, we are starting with deployments and need to monitor everything. There are applications, kubernetes, microservices, containers, logs.... I've been watching some video of how to c…

---

## [Elasticsearch and Docker Generating http\_ca.crt](https://discuss.elastic.co/t/elasticsearch-and-docker-generating-http-ca-crt/299011)

<div class="topic-metadata">

**Author:** [@SwampyFox](https://discuss.elastic.co/u/SwampyFox)\
**Replies:** 2\
**Last updated:** [March 9, 2022, 8:40am UTC](https://discuss.elastic.co/t/elasticsearch-and-docker-generating-http-ca-crt/299011 "2022-03-09T08:40:26Z")

</div>

I have followed the instructions on installing Elasticsearch on Docker for version 8.0.1. I am able to run the curl command against "https://localhost:9200" with the http\_ca.crt and the password generated for the elasti…

---

## [AWS IoT data to Elastc Cloud](https://discuss.elastic.co/t/aws-iot-data-to-elastc-cloud/298755)

<div class="topic-metadata">

**Author:** [@Keo](https://discuss.elastic.co/u/Keo)\
**Replies:** 2\
**Last updated:** [March 9, 2022, 7:50am UTC](https://discuss.elastic.co/t/aws-iot-data-to-elastc-cloud/298755 "2022-03-09T07:50:52Z")

</div>

Hi, Do you have recommendation on how to send data from an AWS IoT Core MQTT Broker to an Elasticsearch instance that is managed using ElasticCloud ? The only lead I have so far is to use a combination of AWS Cloudwatc…

---

## [Snapshot and restore for a Cluster](https://discuss.elastic.co/t/snapshot-and-restore-for-a-cluster/299082)

<div class="topic-metadata">

**Author:** [@Arpita11](https://discuss.elastic.co/u/Arpita11)\
**Replies:** 2\
**Last updated:** [March 9, 2022, 7:08am UTC](https://discuss.elastic.co/t/snapshot-and-restore-for-a-cluster/299082 "2022-03-09T07:08:40Z")

</div>

I have a cluster with three nodes (1 master, 2 data and master eligible) in my primary region. I need to take a snapshot of this cluster. If primary region goes down, I will spin up one node in secondary region and rest…

---

## [Elasticsearch Cluster Ingest Node Sizing](https://discuss.elastic.co/t/elasticsearch-cluster-ingest-node-sizing/298971)

<div class="topic-metadata">

**Author:** [@chateesh](https://discuss.elastic.co/u/chateesh)\
**Replies:** 3\
**Last updated:** [March 9, 2022, 6:55am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-ingest-node-sizing/298971 "2022-03-09T06:55:23Z")

</div>

Hi Team, We're planning to add a new Ingest node to running ES cluster, this node is dedicated only for data ingestion. How to do capacity planning for ingest node, does this memory optimized or CPU optimized, to ingest…

---

## [Alternative for SQL transaction in Elastic-search](https://discuss.elastic.co/t/alternative-for-sql-transaction-in-elastic-search/299166)

<div class="topic-metadata">

**Author:** [@Muhammad\_Hamza](https://discuss.elastic.co/u/Muhammad_Hamza)\
**Replies:** 1\
**Last updated:** [March 9, 2022, 5:36am UTC](https://discuss.elastic.co/t/alternative-for-sql-transaction-in-elastic-search/299166 "2022-03-09T05:36:39Z")

</div>

Is there any alternative to SQL Transactions in Elastic-search? I want to perform multiple bulk indexing operations in batches and if any batch fails at some point, I would like to revert the whole indexing process.

---

## [Newbie to Linux/elastic. I'm having trouble setting up elasticsearch](https://discuss.elastic.co/t/newbie-to-linux-elastic-im-having-trouble-setting-up-elasticsearch/298687)

<div class="topic-metadata">

**Author:** [@elasticScrub](https://discuss.elastic.co/u/elasticScrub)\
**Replies:** 19\
**Last updated:** [March 8, 2022, 11:19pm UTC](https://discuss.elastic.co/t/newbie-to-linux-elastic-im-having-trouble-setting-up-elasticsearch/298687 "2022-03-08T23:19:49Z")

</div>

As the title says I'm new to Elasticsearch and Linux in general. I have setup an Ubuntu server in VirtualBox for installing Elasticsearch. I followed the guide listed on installing it and am currently stuck on this step. …

---

## [How to increase disk capacity of elasticsearch nodes?](https://discuss.elastic.co/t/how-to-increase-disk-capacity-of-elasticsearch-nodes/298951)

<div class="topic-metadata">

**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\
**Replies:** 1\
**Last updated:** [March 8, 2022, 10:44pm UTC](https://discuss.elastic.co/t/how-to-increase-disk-capacity-of-elasticsearch-nodes/298951 "2022-03-08T22:44:03Z")

</div>

Hello everyone, I want to increase the disk capacity of Elasticsearch data nodes. For this, I expect it to forward the shards on the node to other nodes using "cluster.routing.allocation.exclude.\_ip":"192.168.x.x" first.…

---

## [Update doc only if doc changes? noop?](https://discuss.elastic.co/t/update-doc-only-if-doc-changes-noop/299040)

<div class="topic-metadata">

**Author:** [@andy4324](https://discuss.elastic.co/u/andy4324)\
**Replies:** 4\
**Last updated:** [March 8, 2022, 7:02pm UTC](https://discuss.elastic.co/t/update-doc-only-if-doc-changes-noop/299040 "2022-03-08T19:02:54Z")

</div>

Hi ES team, newbie ES user. We have a use case where we want to store signals from various hosts inside ES (as documents of course) and query them later based on a specific field value. Each event might have different fi…

---

## [Upgrade to 8.0.0 failed](https://discuss.elastic.co/t/upgrade-to-8-0-0-failed/298998)

<div class="topic-metadata">

**Author:** [@rp346](https://discuss.elastic.co/u/rp346)\
**Replies:** 2\
**Last updated:** [March 8, 2022, 6:57pm UTC](https://discuss.elastic.co/t/upgrade-to-8-0-0-failed/298998 "2022-03-08T18:57:36Z")

</div>

I am running Elasticsearch 7.17.0 in EKS. Under /app/management/stack/upgrade\_assistant/es\_deprecations I see following I updated config to kind: StatefulSet apiVersion: apps/v1 metadata: name: es-master namespa…

---

## [Composite Aggregation](https://discuss.elastic.co/t/composite-aggregation/299112)

<div class="topic-metadata">

**Author:** [@Alessio\_Creo](https://discuss.elastic.co/u/Alessio_Creo)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 3:45pm UTC](https://discuss.elastic.co/t/composite-aggregation/299112 "2022-03-08T15:45:21Z")

</div>

Hi there, I would like to know how the composite aggregations works exactly. Do they open a context with a TTL taking a "snapshot" of the index just like scroll? If so, for the same number of buckets are the performan…

---

## [Indexing problems with GDAL/ogr2ogr for GEO\_POINT of geojson files](https://discuss.elastic.co/t/indexing-problems-with-gdal-ogr2ogr-for-geo-point-of-geojson-files/298856)

<div class="topic-metadata">

**Author:** [@Jordi\_Piqueras\_Bauti](https://discuss.elastic.co/u/Jordi_Piqueras_Bauti)\
**Replies:** 3\
**Last updated:** [March 8, 2022, 3:44pm UTC](https://discuss.elastic.co/t/indexing-problems-with-gdal-ogr2ogr-for-geo-point-of-geojson-files/298856 "2022-03-08T15:44:09Z")

</div>

I am having problem indexing Geojson files that have Point geometries using GDAL/ogr2ogr library. Points are not being indexed in the same way as if I am doing uploading geojson file with Kibana. With ogr2ogr I am havi…

---

## [Blocking call in new async Java API Client?](https://discuss.elastic.co/t/blocking-call-in-new-async-java-api-client/299021)

<div class="topic-metadata">

**Author:** [@CletusTSJY](https://discuss.elastic.co/u/CletusTSJY)\
**Replies:** 2\
**Last updated:** [March 8, 2022, 3:24pm UTC](https://discuss.elastic.co/t/blocking-call-in-new-async-java-api-client/299021 "2022-03-08T15:24:39Z")

</div>

I'm trying to migrate from the old RestHighLevelClient to the new Java API Client (v7.16.0) in a Spring Webflux project. With the old client I was able to convert the response to a Mono\<\> using the client's listener mech…

---

## [Issue with index name](https://discuss.elastic.co/t/issue-with-index-name/299100)

<div class="topic-metadata">

**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\
**Replies:** 1\
**Last updated:** [March 8, 2022, 3:18pm UTC](https://discuss.elastic.co/t/issue-with-index-name/299100 "2022-03-08T15:18:20Z")

</div>

Hi, I can't change my index name im using filebeat 7.14.1 and filebeat won't change my index name to the one that I have in my config The docs are idexed to filebeat-7.14.1, pleas what am I doing wrong in here output.…

---

## [Querying Elasticsearch Arrays with NEST and gRPC protos](https://discuss.elastic.co/t/querying-elasticsearch-arrays-with-nest-and-grpc-protos/299102)

<div class="topic-metadata">

**Author:** [@simobrusch](https://discuss.elastic.co/u/simobrusch)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 2:13pm UTC](https://discuss.elastic.co/t/querying-elasticsearch-arrays-with-nest-and-grpc-protos/299102 "2022-03-08T14:13:20Z")

</div>

My goal is to return a result of a search query to the user. This is done by querying a list of objects in Elasticsearch with a custom search parameter in a dotnet 6 webapi project using gRPC proto files and NEST. My pr…

---

## [Query on responded output](https://discuss.elastic.co/t/query-on-responded-output/298907)

<div class="topic-metadata">

**Author:** [@Tanvir\_Ahmmed](https://discuss.elastic.co/u/Tanvir_Ahmmed)\
**Replies:** 0\
**Last updated:** [March 6, 2022, 9:27am UTC](https://discuss.elastic.co/t/query-on-responded-output/298907 "2022-03-06T09:27:23Z")

</div>

How to write a conditional query on multiple fields? Explain: I have an index let say "case" and the fields are "title", "secondTitle(contain nested obj)", "source(contain nested obj)". Now I want to search on title and…

---

## [Config directory location for token filter helper files](https://discuss.elastic.co/t/config-directory-location-for-token-filter-helper-files/299078)

<div class="topic-metadata">

**Author:** [@Gabor\_Gergely](https://discuss.elastic.co/u/Gabor_Gergely)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 10:48am UTC](https://discuss.elastic.co/t/config-directory-location-for-token-filter-helper-files/299078 "2022-03-08T10:48:01Z")

</div>

I want to use token filters which require some helper files in the config directory (e.g. the hyphenation decompounder token filter, which requires an xml file in the hyphenation\_patterns\_path parameter). The docs says:…

---

## [How can I use standard SQL on text fields of elastic without using the specials SQL elasticSearch operators?](https://discuss.elastic.co/t/how-can-i-use-standard-sql-on-text-fields-of-elastic-without-using-the-specials-sql-elasticsearch-operators/299057)

<div class="topic-metadata">

**Author:** [@shiranOren](https://discuss.elastic.co/u/shiranOren)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 8:47am UTC](https://discuss.elastic.co/t/how-can-i-use-standard-sql-on-text-fields-of-elastic-without-using-the-specials-sql-elasticsearch-operators/299057 "2022-03-08T08:47:36Z")

</div>

I would like to create SQL query on some text field (not keyword) for example "name" field and send that query to elastic server. my problem is that I need to use the standard SQL language (not the MATCH and QUERY opera…

---

## [ELK servers required for training](https://discuss.elastic.co/t/elk-servers-required-for-training/299047)

<div class="topic-metadata">

**Author:** [@Nasser](https://discuss.elastic.co/u/Nasser)\
**Replies:** 1\
**Last updated:** [March 8, 2022, 9:47am UTC](https://discuss.elastic.co/t/elk-servers-required-for-training/299047 "2022-03-08T09:47:53Z")

</div>

Hi i'm preparing for the elastic exam and i want to setup an env for training. what is the minimum space to run ELK stack without any issue ? and how many node required ? thanks

---

## [Use terms in events yesterday to for filter when documents appears the last week](https://discuss.elastic.co/t/use-terms-in-events-yesterday-to-for-filter-when-documents-appears-the-last-week/299063)

<div class="topic-metadata">

**Author:** [@Silver137](https://discuss.elastic.co/u/Silver137)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 9:45am UTC](https://discuss.elastic.co/t/use-terms-in-events-yesterday-to-for-filter-when-documents-appears-the-last-week/299063 "2022-03-08T09:45:24Z")

</div>

My use case requires search when some documents appears in the last 7 days based on the terms present in the documents exactly yesterday. I want to avoid make two querys one for query the terms yesterday and another to …

---

## [Java way to analyze a field with two analyzers](https://discuss.elastic.co/t/java-way-to-analyze-a-field-with-two-analyzers/299050)

<div class="topic-metadata">

**Author:** [@dishant.sharma](https://discuss.elastic.co/u/dishant.sharma)\
**Replies:** 1\
**Last updated:** [March 8, 2022, 9:44am UTC](https://discuss.elastic.co/t/java-way-to-analyze-a-field-with-two-analyzers/299050 "2022-03-08T09:44:44Z")

</div>

I want to analyze an email with two different custom analyzers at the same time. One analyzer will extract the words from it and another one will extract the special characters from it. And, I want to return the result r…

---

## [Elasticsearch index](https://discuss.elastic.co/t/elasticsearch-index/298257)

<div class="topic-metadata">

**Author:** [@umangpatel](https://discuss.elastic.co/u/umangpatel)\
**Replies:** 29\
**Last updated:** [March 8, 2022, 5:42am UTC](https://discuss.elastic.co/t/elasticsearch-index/298257 "2022-03-08T05:42:10Z")

</div>

I have to remove old data of apiman-indices in Elasticsearch which contain .pos, .cf or any other extension. So how can we remove the old indices?

---

## [Elasticsearch bulk error - must be terminated by a newline](https://discuss.elastic.co/t/elasticsearch-bulk-error-must-be-terminated-by-a-newline/299037)

<div class="topic-metadata">

**Author:** [@kobalt](https://discuss.elastic.co/u/kobalt)\
**Replies:** 1\
**Last updated:** [March 8, 2022, 5:20am UTC](https://discuss.elastic.co/t/elasticsearch-bulk-error-must-be-terminated-by-a-newline/299037 "2022-03-08T05:20:41Z")

</div>

trying to use a elasticsearch bulk api. e.g. the following bulk request succeeds $ curl -X POST "localhost:9200/test/\_bulk?pretty" -H 'Content-Type: application/json' -d ' {"index":{"\_id":1}} {"foo":"foo"} {"index":{"\_i…

---

## [Elasticsearch Log deletion not happening as per defined days in log4j.pproperties file](https://discuss.elastic.co/t/elasticsearch-log-deletion-not-happening-as-per-defined-days-in-log4j-pproperties-file/299038)

<div class="topic-metadata">

**Author:** [@pratikshatiwari](https://discuss.elastic.co/u/pratikshatiwari)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 5:07am UTC](https://discuss.elastic.co/t/elasticsearch-log-deletion-not-happening-as-per-defined-days-in-log4j-pproperties-file/299038 "2022-03-08T05:07:12Z")

</div>

Dear Team, We are facing an issue where Elasticsearch logging with log4j2.properties not performing the log rotation on the basis of lfLastmodified age condition, we want to rotate the logs every after 7days but it is n…

---

## [How to Properly Use The Roles in values.yaml?](https://discuss.elastic.co/t/how-to-properly-use-the-roles-in-values-yaml/298962)

<div class="topic-metadata">

**Author:** [@lloyd01sanchez12](https://discuss.elastic.co/u/lloyd01sanchez12)\
**Replies:** 3\
**Last updated:** [March 8, 2022, 4:43am UTC](https://discuss.elastic.co/t/how-to-properly-use-the-roles-in-values-yaml/298962 "2022-03-08T04:43:58Z")

</div>

Hi Team, I've been having a problem correcting the deprecation warnings related to node.roles: "message": "legacy role settings \[node.data, node.remote\_cluster\_client, node.ingest, node.master, node.ml\] are deprecated,…

---

## [Strange data type error after upgraded ELK to 8.0 - "failed to parse date field \[...\]"](https://discuss.elastic.co/t/strange-data-type-error-after-upgraded-elk-to-8-0-failed-to-parse-date-field/299031)

<div class="topic-metadata">

**Author:** [@pinehk](https://discuss.elastic.co/u/pinehk)\
**Replies:** 0\
**Last updated:** [March 8, 2022, 3:07am UTC](https://discuss.elastic.co/t/strange-data-type-error-after-upgraded-elk-to-8-0-failed-to-parse-date-field/299031 "2022-03-08T03:07:12Z")

</div>

Upgraded ELK from 7.15 to 8.0, basic configurations are unchanged. But in 8.0, a CSV filter suddenly broke at unit test, failing to process a line that worked perfectly fine in 7. The error is "caused\_by"=\>{"type"=\>"i…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=478)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=480)
