# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=932

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 933

---

## [Suggestion Size](https://discuss.elastic.co/t/suggestion-size/231121)

<div class="topic-metadata">

**Author:** [@111329](https://discuss.elastic.co/u/111329)\
**Replies:** 1\
**Last updated:** [May 6, 2020, 4:54am UTC](https://discuss.elastic.co/t/suggestion-size/231121 "2020-05-06T04:54:35Z")

</div>

hello, I have some Issue with the number of suggestions to return field (size) the first query is size equal to 1 POST ja-search-data-prod/\_search { "suggest": { "promotion-suggest": { …

---

## [Hardware Requirement for setting up Elastic Stack 7.6](https://discuss.elastic.co/t/hardware-requirement-for-setting-up-elastic-stack-7-6/231257)

<div class="topic-metadata">

**Author:** [@charu.mittal](https://discuss.elastic.co/u/charu.mittal)\
**Replies:** 0\
**Last updated:** [May 6, 2020, 4:44am UTC](https://discuss.elastic.co/t/hardware-requirement-for-setting-up-elastic-stack-7-6/231257 "2020-05-06T04:44:25Z")

</div>

Hello All, I am new to Elastic stack and want to setup Elastic Stack 7.6 for Prod and Dev environments. What will be the minimum Hardware Requirement for setting up Elastic Stack 7.6 on VM machine with Debian10. Prod…

---

## [Date histogram ignores timezone](https://discuss.elastic.co/t/date-histogram-ignores-timezone/231247)

<div class="topic-metadata">

**Author:** [@Quang\_D\_Tr\_n](https://discuss.elastic.co/u/Quang_D_Tr_n)\
**Replies:** 0\
**Last updated:** [May 6, 2020, 4:15am UTC](https://discuss.elastic.co/t/date-histogram-ignores-timezone/231247 "2020-05-06T04:15:16Z")

</div>

I have date field "local\_time": "2020-04-10T23:00:52.000-0600" which stores the local time (various timezones). Now I want to use date\_histogram to group data by day but it auto converts the above time to UTC and it wil…

---

## [Aggregation : take only one instance of document based on field](https://discuss.elastic.co/t/aggregation-take-only-one-instance-of-document-based-on-field/231225)

<div class="topic-metadata">

**Author:** [@pkrawat1](https://discuss.elastic.co/u/pkrawat1)\
**Replies:** 1\
**Last updated:** [May 6, 2020, 1:57am UTC](https://discuss.elastic.co/t/aggregation-take-only-one-instance-of-document-based-on-field/231225 "2020-05-06T01:57:19Z")

</div>

I have a data that looks like this \[ { "created\_at": "2020-05-05", "candidate\_id" : 43, "state": "a" }, { "created\_at": "2020-05-06", "candidate\_id" : 43, "state": "b…

---

## [Index creation slows down over time](https://discuss.elastic.co/t/index-creation-slows-down-over-time/230775)

<div class="topic-metadata">

**Author:** [@astevenson](https://discuss.elastic.co/u/astevenson)\
**Replies:** 15\
**Last updated:** [May 5, 2020, 10:42pm UTC](https://discuss.elastic.co/t/index-creation-slows-down-over-time/230775 "2020-05-05T22:42:02Z")

</div>

We have a ruby test suite that creates and deletes our indices between tests. Under elasticsearch 5.6 this runs consistently very fast. Under 6.8 it degrades over time. And under 7.6 it is slow off the bat. I made a gene…

---

## [Cant send mail alert through watcher](https://discuss.elastic.co/t/cant-send-mail-alert-through-watcher/229011)

<div class="topic-metadata">

**Author:** [@rakeshraagu2](https://discuss.elastic.co/u/rakeshraagu2)\
**Replies:** 6\
**Last updated:** [May 5, 2020, 8:59pm UTC](https://discuss.elastic.co/t/cant-send-mail-alert-through-watcher/229011 "2020-05-05T20:59:35Z")

</div>

Hi, When I testing my mail alert using watcher it is showing an error that mail send failed. In my cluster log file I saw below given line. Can anyoone help. \]\[ERROR\]\[o.e.x.w.a.e.ExecutableEmailAction\] \[elk-master\] fa…

---

## [Upgrade from 6 to 7: This index has more than one mapping type, which is not supported in 7.0](https://discuss.elastic.co/t/upgrade-from-6-to-7-this-index-has-more-than-one-mapping-type-which-is-not-supported-in-7-0/231220)

<div class="topic-metadata">

**Author:** [@gdreyv](https://discuss.elastic.co/u/gdreyv)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 8:58pm UTC](https://discuss.elastic.co/t/upgrade-from-6-to-7-this-index-has-more-than-one-mapping-type-which-is-not-supported-in-7-0/231220 "2020-05-05T20:58:10Z")

</div>

I faced the error "This index has more than one mapping type, which is not supported in 7.0. This index must be reindexed into one or more single-type indices." How can I do this? I'm ok to convert \_type into the propert…

---

## [Archive logs from elasticsearch to s3 in a readable format](https://discuss.elastic.co/t/archive-logs-from-elasticsearch-to-s3-in-a-readable-format/231219)

<div class="topic-metadata">

**Author:** [@Ilan\_Peretz](https://discuss.elastic.co/u/Ilan_Peretz)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 8:44pm UTC](https://discuss.elastic.co/t/archive-logs-from-elasticsearch-to-s3-in-a-readable-format/231219 "2020-05-05T20:44:53Z")

</div>

hello, i need to archive data from elasticsearch to s3, like there is in logz.io. the thing is, in logz.io the data get to S3 in a readable format (json), and then i can manipulate it however i need. when i do a snaps…

---

## [When applying ingest pipeline it fails with "Parse execption, request body is required"](https://discuss.elastic.co/t/when-applying-ingest-pipeline-it-fails-with-parse-execption-request-body-is-required/230788)

<div class="topic-metadata">

**Author:** [@syost](https://discuss.elastic.co/u/syost)\
**Replies:** 3\
**Last updated:** [May 5, 2020, 8:34pm UTC](https://discuss.elastic.co/t/when-applying-ingest-pipeline-it-fails-with-parse-execption-request-body-is-required/230788 "2020-05-05T20:34:27Z")

</div>

I have filebeats going and I'm trying to play around with ingest pipelines. I have accessed the console and defined the following pipeline... PUT \_ingest/pipeline/upper { "description": "Testing lower to uppercase on …

---

## [Snapshot to S3 from elasticsearch cloud](https://discuss.elastic.co/t/snapshot-to-s3-from-elasticsearch-cloud/231118)

<div class="topic-metadata">

**Author:** [@Ilan\_Peretz](https://discuss.elastic.co/u/Ilan_Peretz)\
**Replies:** 3\
**Last updated:** [May 5, 2020, 8:06pm UTC](https://discuss.elastic.co/t/snapshot-to-s3-from-elasticsearch-cloud/231118 "2020-05-05T20:06:34Z")

</div>

hello, we're using elastic.co cloud service, platinum license. we want to snapshot logs to S3 bucket. repository-s3 is installed on the server. when using the devtools with this command: PUT /\_snapshot/s3\_snapshot1…

---

## [Snapshot failed with "file\_system\_exception... Structure needs cleaning"](https://discuss.elastic.co/t/snapshot-failed-with-file-system-exception-structure-needs-cleaning/231200)

<div class="topic-metadata">

**Author:** [@Davoot](https://discuss.elastic.co/u/Davoot)\
**Replies:** 2\
**Last updated:** [May 5, 2020, 8:04pm UTC](https://discuss.elastic.co/t/snapshot-failed-with-file-system-exception-structure-needs-cleaning/231200 "2020-05-05T20:04:59Z")

</div>

Hi all, I'm trying to snapshot an index to an fs repository (nfs share). I have two nodes in 7.6.1. First node share nfs, second mount it There is around 80 indices (30 GB/day), I decide to snapshot monthly manually b…

---

## [Cant start elasticsearch after update from 6.6.2 to 7.6.2](https://discuss.elastic.co/t/cant-start-elasticsearch-after-update-from-6-6-2-to-7-6-2/231195)

<div class="topic-metadata">

**Author:** [@Deny7](https://discuss.elastic.co/u/Deny7)\
**Replies:** 5\
**Last updated:** [May 5, 2020, 7:26pm UTC](https://discuss.elastic.co/t/cant-start-elasticsearch-after-update-from-6-6-2-to-7-6-2/231195 "2020-05-05T19:26:29Z")

</div>

Hi, I want to do full elk stack upgrade from 6.6.2 to 7.6.2. Started with elasticsearch. I did snapshot backup. Followed this guide https://www.elastic.co/guide/en/elasticsearch/reference/7.6/restart-upgrade.html Downl…

---

## [Number of seed nodes required to setup cross cluster search](https://discuss.elastic.co/t/number-of-seed-nodes-required-to-setup-cross-cluster-search/231204)

<div class="topic-metadata">

**Author:** [@funlearning321](https://discuss.elastic.co/u/funlearning321)\
**Replies:** 2\
**Last updated:** [May 5, 2020, 6:51pm UTC](https://discuss.elastic.co/t/number-of-seed-nodes-required-to-setup-cross-cluster-search/231204 "2020-05-05T18:51:16Z")

</div>

Hello, I was trying to setup the cross cluster search but not sure if only one seed should be configured or all seeds should be configured from remote cluster. Any help is appreciated. Below example is the cross clust…

---

## [Snapshot based on the age of the index](https://discuss.elastic.co/t/snapshot-based-on-the-age-of-the-index/231144)

<div class="topic-metadata">

**Author:** [@harish\_gopi](https://discuss.elastic.co/u/harish_gopi)\
**Replies:** 1\
**Last updated:** [May 5, 2020, 6:33pm UTC](https://discuss.elastic.co/t/snapshot-based-on-the-age-of-the-index/231144 "2020-05-05T18:33:30Z")

</div>

We have daily log indexed in elastic search with logs-%m-%d-%y format, so we need to create the snapshot for indices greater than 30 days and archive it in amazon s3. I came across way to create snapshot using cron sched…

---

## [In a cluster, changes in elasticsearch.yml must be replicated in all nodes?](https://discuss.elastic.co/t/in-a-cluster-changes-in-elasticsearch-yml-must-be-replicated-in-all-nodes/231181)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 3\
**Last updated:** [May 5, 2020, 5:33pm UTC](https://discuss.elastic.co/t/in-a-cluster-changes-in-elasticsearch-yml-must-be-replicated-in-all-nodes/231181 "2020-05-05T17:33:04Z")

</div>

Hi, previously I have made changes to elasticsearch.yml and replicated those changes in all nodes, no Im about to configure xpack.notification.email and I was wandering if it necessary to add this lines in all nodes in m…

---

## [Changing default similarity of an index](https://discuss.elastic.co/t/changing-default-similarity-of-an-index/231193)

<div class="topic-metadata">

**Author:** [@mich123prem](https://discuss.elastic.co/u/mich123prem)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 4:27pm UTC](https://discuss.elastic.co/t/changing-default-similarity-of-an-index/231193 "2020-05-05T16:27:43Z")

</div>

Hello! I am using elasticsearch in a university course on IR, and it is therefore interesting to change the default similarity of an index to show differences in performance related to the different similarities. In vers…

---

## [Elasticsearch 7 has 4x higher AZ transfer costs in AWS compared to 2.4](https://discuss.elastic.co/t/elasticsearch-7-has-4x-higher-az-transfer-costs-in-aws-compared-to-2-4/225745)

<div class="topic-metadata">

**Author:** [@Doc\_Kaos](https://discuss.elastic.co/u/Doc_Kaos)\
**Replies:** 13\
**Last updated:** [May 5, 2020, 4:21pm UTC](https://discuss.elastic.co/t/elasticsearch-7-has-4x-higher-az-transfer-costs-in-aws-compared-to-2-4/225745 "2020-05-05T16:21:16Z")

</div>

Since upgrading to Elasticsearch 7.4.1 from 2.4. (I know :stuck\_out\_tongue: ) we are seeing our AWS availability zone transfer charges skyrocket. Both the old and new clusters used the cluster.cloud.allocation.awareness.…

---

## [Elasticsearch query with different fields](https://discuss.elastic.co/t/elasticsearch-query-with-different-fields/231166)

<div class="topic-metadata">

**Author:** [@Guillaume\_RENARD](https://discuss.elastic.co/u/Guillaume_RENARD)\
**Replies:** 7\
**Last updated:** [May 5, 2020, 3:53pm UTC](https://discuss.elastic.co/t/elasticsearch-query-with-different-fields/231166 "2020-05-05T15:53:07Z")

</div>

Hi here an exemple of my documents { "@timestamp": "2020-04-24T19:36:52.484Z", "token": "123", "application": "sso\_api\_v3", "ssoapiv3\_method": "GET", "ssoapiv3\_error\_description": "Your access token …

---

## [ELK for log access](https://discuss.elastic.co/t/elk-for-log-access/230181)

<div class="topic-metadata">

**Author:** [@walid\_kharrat](https://discuss.elastic.co/u/walid_kharrat)\
**Replies:** 2\
**Last updated:** [May 5, 2020, 3:43pm UTC](https://discuss.elastic.co/t/elk-for-log-access/230181 "2020-05-05T15:43:38Z")

</div>

Hi, i have to install an ELK server for a barracuda log access only. Can i choose a simple VM with 4vcpu,10G Ram and 300G SATA. i will install one node instance. With a configuration like this can the index "grow as he …

---

## [Data Masking in Elasticsearch Index](https://discuss.elastic.co/t/data-masking-in-elasticsearch-index/230554)

<div class="topic-metadata">

**Author:** [@aviman](https://discuss.elastic.co/u/aviman)\
**Replies:** 3\
**Last updated:** [May 5, 2020, 3:28pm UTC](https://discuss.elastic.co/t/data-masking-in-elasticsearch-index/230554 "2020-05-05T15:28:15Z")

</div>

How can I mask Data in Elastisearch Index field. Ex: Have a Description field which contains email id inside it I just want to replace the email id with some string 'xxx' and leave other part of description as it. Is …

---

## [While using enviroment variable in Curator -crontab.Unable to get required output](https://discuss.elastic.co/t/while-using-enviroment-variable-in-curator-crontab-unable-to-get-required-output/229302)

<div class="topic-metadata">

**Author:** [@Dragon9](https://discuss.elastic.co/u/Dragon9)\
**Replies:** 7\
**Last updated:** [May 5, 2020, 2:23pm UTC](https://discuss.elastic.co/t/while-using-enviroment-variable-in-curator-crontab-unable-to-get-required-output/229302 "2020-05-05T14:23:11Z")

</div>

i set enviroment variable for elasticsearch-service in curator's config yml. and some env var in action\_file.yml i export variable in bash\_profile file and other solution found in web but it does not work there are two…

---

## [Not able to start elasticsearch 6.5.4 cleanly after adding xpack configuration to the yaml](https://discuss.elastic.co/t/not-able-to-start-elasticsearch-6-5-4-cleanly-after-adding-xpack-configuration-to-the-yaml/231172)

<div class="topic-metadata">

**Author:** [@Shikha\_Priyedarshi](https://discuss.elastic.co/u/Shikha_Priyedarshi)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 2:22pm UTC](https://discuss.elastic.co/t/not-able-to-start-elasticsearch-6-5-4-cleanly-after-adding-xpack-configuration-to-the-yaml/231172 "2020-05-05T14:22:42Z")

</div>

Hi All, Greetings !! I am not able to start elasticsearch 6.5.4 cluster after adding these xpack configurations to the yaml: xpack.security.transport.ssl.enabled: true xpack.security.transport.ssl.verification\_mode: …

---

## [Exception during establishing a SSL connection: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record:](https://discuss.elastic.co/t/exception-during-establishing-a-ssl-connection-io-netty-handler-ssl-notsslrecordexception-not-an-ssl-tls-record/231165)

<div class="topic-metadata">

**Author:** [@Nirosh\_Kumar](https://discuss.elastic.co/u/Nirosh_Kumar)\
**Replies:** 1\
**Last updated:** [May 5, 2020, 2:07pm UTC](https://discuss.elastic.co/t/exception-during-establishing-a-ssl-connection-io-netty-handler-ssl-notsslrecordexception-not-an-ssl-tls-record/231165 "2020-05-05T14:07:16Z")

</div>

Hello, I have installed elastic search 7.6.2 with HTTP support which is working fine. But, when I installed the same version with https enabled, I am getting below error when I start the elasticsearch. search guard 7.6…

---

## [Memory usage of dedicated master-nodes are too high](https://discuss.elastic.co/t/memory-usage-of-dedicated-master-nodes-are-too-high/228987)

<div class="topic-metadata">

**Author:** [@Ayush\_Verma](https://discuss.elastic.co/u/Ayush_Verma)\
**Replies:** 10\
**Last updated:** [May 5, 2020, 1:04pm UTC](https://discuss.elastic.co/t/memory-usage-of-dedicated-master-nodes-are-too-high/228987 "2020-05-05T13:04:08Z")

</div>

We have 3 dedicated master-nodes, 3 data-nodes and 2 ingest-nodes. version: 7.3 shards: 3 replica: 1 master nodes- 2vCPUs, 2 GM RAM (For all 3 nodes), data nodes- 4vCPUs, 16 GB RAM (For all 3 nodes), ingest node…

---

## [Unable to index Html content in Ealsticsearch](https://discuss.elastic.co/t/unable-to-index-html-content-in-ealsticsearch/231154)

<div class="topic-metadata">

**Author:** [@Sreenath\_Reddy](https://discuss.elastic.co/u/Sreenath_Reddy)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 12:59pm UTC](https://discuss.elastic.co/t/unable-to-index-html-content-in-ealsticsearch/231154 "2020-05-05T12:59:28Z")

</div>

Hello all, I am trying to index data which is having some html content. I tried to use 'html\_strip' but its throwing error.Can you please help me in indexing as I am trying to google things but nothing is helping me. P…

---

## [Kibana search discover error](https://discuss.elastic.co/t/kibana-search-discover-error/230572)

<div class="topic-metadata">

**Author:** [@janmichae.reyes4](https://discuss.elastic.co/u/janmichae.reyes4)\
**Replies:** 4\
**Last updated:** [May 5, 2020, 12:48pm UTC](https://discuss.elastic.co/t/kibana-search-discover-error/230572 "2020-05-05T12:48:50Z")

</div>

Hi, Need your help on why i experienced this issue below? SyntaxError: Unexpected token u in JSON at position 0 at JSON.parse () at http://localhost:5601/bundles/commons.bundle.js:3:3378900 at http://localhost:5601/…

---

## [Cluster size (help to define it)](https://discuss.elastic.co/t/cluster-size-help-to-define-it/231135)

<div class="topic-metadata">

**Author:** [@lgutierrez](https://discuss.elastic.co/u/lgutierrez)\
**Replies:** 1\
**Last updated:** [May 5, 2020, 12:39pm UTC](https://discuss.elastic.co/t/cluster-size-help-to-define-it/231135 "2020-05-05T12:39:44Z")

</div>

Hello everybody, We have different applications running on aws machines, which end up with a visualization reading of an elasticsearch cluster. Currently we have a cluster of 3 nodes with 3 EC2 r5.4xlarge instances, but…

---

## [Geo Context with Completion Suggester](https://discuss.elastic.co/t/geo-context-with-completion-suggester/231149)

<div class="topic-metadata">

**Author:** [@Douglas\_Leister](https://discuss.elastic.co/u/Douglas_Leister)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 12:39pm UTC](https://discuss.elastic.co/t/geo-context-with-completion-suggester/231149 "2020-05-05T12:39:07Z")

</div>

New to Es. So apologies if I am missing something simple. I am working on a suggester which should return business names. I'd like to use a geocontext to return names that fall within a given distance ("30mi") from a …

---

## [Cannot write xcontent for unknown value of type class java.time.OffsetDateTime error](https://discuss.elastic.co/t/cannot-write-xcontent-for-unknown-value-of-type-class-java-time-offsetdatetime-error/231148)

<div class="topic-metadata">

**Author:** [@Siddharth1010](https://discuss.elastic.co/u/Siddharth1010)\
**Replies:** 0\
**Last updated:** [May 5, 2020, 12:36pm UTC](https://discuss.elastic.co/t/cannot-write-xcontent-for-unknown-value-of-type-class-java-time-offsetdatetime-error/231148 "2020-05-05T12:36:38Z")

</div>

I am able to search from elasticsearch database where the date is between two specified dates Here is the part of my code SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder(); searchSourceB…

---

## [Error: Indexing Nested Complex Object (Java High Level Rest Client)](https://discuss.elastic.co/t/error-indexing-nested-complex-object-java-high-level-rest-client/231130)

<div class="topic-metadata">

**Author:** [@jjc](https://discuss.elastic.co/u/jjc)\
**Replies:** 1\
**Last updated:** [May 5, 2020, 11:51am UTC](https://discuss.elastic.co/t/error-indexing-nested-complex-object-java-high-level-rest-client/231130 "2020-05-05T11:51:53Z")

</div>

Hi everyone. I've got the following mapping with nested types: { "mapping": { "properties": { "caption": { "type": "text" }, "category": { "type": "text" }, "descript…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=931)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=933)
