# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1247

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1248

---

## [Number of Transport Client for same Elasticsearch Process](https://discuss.elastic.co/t/number-of-transport-client-for-same-elasticsearch-process/187987)

<div class="topic-metadata">

**Author:** [@Prashant\_Rana](https://discuss.elastic.co/u/Prashant_Rana)\
**Replies:** 3\
**Last updated:** [June 28, 2019, 8:36am UTC](https://discuss.elastic.co/t/number-of-transport-client-for-same-elasticsearch-process/187987 "2019-06-28T08:36:45Z")

</div>

Hi, I saw this answer but it is still not clear if it is okay to have more than one transport client to the same ES server? I am getting general node connection failure exception on both the applications which has the …

---

## [Memory allocation against the index size](https://discuss.elastic.co/t/memory-allocation-against-the-index-size/187975)

<div class="topic-metadata">

**Author:** [@udara](https://discuss.elastic.co/u/udara)\
**Replies:** 2\
**Last updated:** [June 28, 2019, 8:14am UTC](https://discuss.elastic.co/t/memory-allocation-against-the-index-size/187975 "2019-06-28T08:14:01Z")

</div>

Hi all we are predicting our index size will be around 175 GB. We came up with a cluster topology of having 2 data nodes and 1 master only node. So each node data node will have 250GB of storage and 64 GB of ram alloc…

---

## [\[Error\] instance of CompositeIndicesRequest that could not be handled: report this as a bug immediately!](https://discuss.elastic.co/t/error-instance-of-compositeindicesrequest-that-could-not-be-handled-report-this-as-a-bug-immediately/187240)

<div class="topic-metadata">

**Author:** [@astrodi](https://discuss.elastic.co/u/astrodi)\
**Replies:** 3\
**Last updated:** [June 28, 2019, 8:13am UTC](https://discuss.elastic.co/t/error-instance-of-compositeindicesrequest-that-could-not-be-handled-report-this-as-a-bug-immediately/187240 "2019-06-28T08:13:43Z")

</div>

Hi there I'm facing issue in ES 6.5 on client nodes: 2019.06.17 21:10:30.584 \[2019-06-17T23:10:24,075\]\[ERROR\]\[t.b.r.e.RequestInfo \] \[elasticservice-client-04\] REFLECTION: Failed to set indices for type SearchTemplateR…

---

## [Remove Fields - all or if contained specific string](https://discuss.elastic.co/t/remove-fields-all-or-if-contained-specific-string/187285)

<div class="topic-metadata">

**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\
**Replies:** 2\
**Last updated:** [June 28, 2019, 8:07am UTC](https://discuss.elastic.co/t/remove-fields-all-or-if-contained-specific-string/187285 "2019-06-28T08:07:06Z")

</div>

Hi all, I have a question regarding removing an existing field if contained a specific string. What I did: I update documents by this Post: POST /myindex/\_update\_by\_query { "script": { "source": "ctx.\_source.ta…

---

## [Need help to remove unwanted fields from index permanently](https://discuss.elastic.co/t/need-help-to-remove-unwanted-fields-from-index-permanently/187981)

<div class="topic-metadata">

**Author:** [@Nishant\_Hurnekar](https://discuss.elastic.co/u/Nishant_Hurnekar)\
**Replies:** 0\
**Last updated:** [June 28, 2019, 7:20am UTC](https://discuss.elastic.co/t/need-help-to-remove-unwanted-fields-from-index-permanently/187981 "2019-06-28T07:20:29Z")

</div>

I am running with ELK cluster 5.6.16. In my one of the index, there were around 2.3k fields detected. I have checked through kibana interface. Is there any method to restrict the fields to detect garbage fields & allo…

---

## [Geo Polygon/Geo Shape query and points on borders (corners)](https://discuss.elastic.co/t/geo-polygon-geo-shape-query-and-points-on-borders-corners/187980)

<div class="topic-metadata">

**Author:** [@howtwizer](https://discuss.elastic.co/u/howtwizer)\
**Replies:** 0\
**Last updated:** [June 28, 2019, 7:06am UTC](https://discuss.elastic.co/t/geo-polygon-geo-shape-query-and-points-on-borders-corners/187980 "2019-06-28T07:06:18Z")

</div>

Yesterday I discovered unexpected ( for me ) behaviour, that seems not documented. I had try with both types Geo Polygon queries with Geo point data type, and Geo Shape query with Geo Shape type "point", but results are…

---

## [Elasticsearch 7.x closed indices retain shards](https://discuss.elastic.co/t/elasticsearch-7-x-closed-indices-retain-shards/187969)

<div class="topic-metadata">

**Author:** [@trenta](https://discuss.elastic.co/u/trenta)\
**Replies:** 5\
**Last updated:** [June 28, 2019, 6:16am UTC](https://discuss.elastic.co/t/elasticsearch-7-x-closed-indices-retain-shards/187969 "2019-06-28T06:16:58Z")

</div>

Prior to version 7, when I closed an index it would release any shards that were used and turn the status of that index to black. Since version 7 when I close an index it is labeled as closed but still has a green statu…

---

## [Using Template Snippet with Pipeline Processor](https://discuss.elastic.co/t/using-template-snippet-with-pipeline-processor/187842)

<div class="topic-metadata">

**Author:** [@PeterPain](https://discuss.elastic.co/u/PeterPain)\
**Replies:** 1\
**Last updated:** [June 28, 2019, 6:15am UTC](https://discuss.elastic.co/t/using-template-snippet-with-pipeline-processor/187842 "2019-06-28T06:15:18Z")

</div>

Hey there ! I have a question about the pipeline processor. Does the processor provides the functionality of templating? I want to use different pipelines based on a field name. i tried using the following pipeline, …

---

## [Node js with elasticsearch bulk index](https://discuss.elastic.co/t/node-js-with-elasticsearch-bulk-index/187931)

<div class="topic-metadata">

**Author:** [@mr\_searchng](https://discuss.elastic.co/u/mr_searchng)\
**Replies:** 1\
**Last updated:** [June 28, 2019, 6:14am UTC](https://discuss.elastic.co/t/node-js-with-elasticsearch-bulk-index/187931 "2019-06-28T06:14:08Z")

</div>

How I write elasticsearch bulk index at node js?

---

## [Elastic6.7 \<search\> 'Unknown key for a START\_OBJECT in \[filter\].'](https://discuss.elastic.co/t/elastic6-7-search-unknown-key-for-a-start-object-in-filter/187964)

<div class="topic-metadata">

**Author:** [@9527q](https://discuss.elastic.co/u/9527q)\
**Replies:** 1\
**Last updated:** [June 28, 2019, 5:51am UTC](https://discuss.elastic.co/t/elastic6-7-search-unknown-key-for-a-start-object-in-filter/187964 "2019-06-28T05:51:09Z")

</div>

I'm from Py3 and es6.7 in my macOS. When I try to search and it raise an error. body = { "query": {"match": {"doc.name": s\_key}}, "filter": {"term": {"doc.is\_vaild": True}} } print(es.search(index='crm\_brand', …

---

## [IP filtering on Elasticsearch security](https://discuss.elastic.co/t/ip-filtering-on-elasticsearch-security/187967)

<div class="topic-metadata">

**Author:** [@Bo\_Pham\_Nguyen](https://discuss.elastic.co/u/Bo_Pham_Nguyen)\
**Replies:** 1\
**Last updated:** [June 28, 2019, 5:25am UTC](https://discuss.elastic.co/t/ip-filtering-on-elasticsearch-security/187967 "2019-06-28T05:25:38Z")

</div>

Is IP filtering feature on X-pack Elasticsearch free (basic license) ? Thanks

---

## [Lifecycle for new ES & Kibana](https://discuss.elastic.co/t/lifecycle-for-new-es-kibana/187962)

<div class="topic-metadata">

**Author:** [@skyluke.1987](https://discuss.elastic.co/u/skyluke.1987)\
**Replies:** 0\
**Last updated:** [June 28, 2019, 3:17am UTC](https://discuss.elastic.co/t/lifecycle-for-new-es-kibana/187962 "2019-06-28T03:17:42Z")

</div>

Hi all, recently I have enabled this lifecycle module in my ES and kibana, but I am getting the error below, does anyone encounter this before?

---

## [Load data from one environment to another?](https://discuss.elastic.co/t/load-data-from-one-environment-to-another/187916)

<div class="topic-metadata">

**Author:** [@jkimrey](https://discuss.elastic.co/u/jkimrey)\
**Replies:** 3\
**Last updated:** [June 28, 2019, 1:17am UTC](https://discuss.elastic.co/t/load-data-from-one-environment-to-another/187916 "2019-06-28T01:17:29Z")

</div>

I have a requirement to take specific ES data from one instance (permanently available) and, via an automated process, move that data to another ES instance running in a local docker container. At the time the data is d…

---

## [Filters Aggregation Bucket Selector](https://discuss.elastic.co/t/filters-aggregation-bucket-selector/187957)

<div class="topic-metadata">

**Author:** [@paulharbulak](https://discuss.elastic.co/u/paulharbulak)\
**Replies:** 0\
**Last updated:** [June 28, 2019, 1:01am UTC](https://discuss.elastic.co/t/filters-aggregation-bucket-selector/187957 "2019-06-28T01:01:05Z")

</div>

I am trying to find term values that exist in two separate geo\_bounding\_box queries. So far I have a term aggregate to which I apply a filters aggregate that contains the two geo\_bounding\_box queries. However, some of …

---

## [Content type errors when reindexing](https://discuss.elastic.co/t/content-type-errors-when-reindexing/187835)

<div class="topic-metadata">

**Author:** [@jamesp220291](https://discuss.elastic.co/u/jamesp220291)\
**Replies:** 6\
**Last updated:** [June 27, 2019, 9:57pm UTC](https://discuss.elastic.co/t/content-type-errors-when-reindexing/187835 "2019-06-27T21:57:20Z")

</div>

Hi I am trying to reindex from a remote host I am running this command - curl -X POST "http://localhost:9200/\_reindex" -H 'Content-Type: application/json' -d' { "source": { "remote": { "host": "http://remoteip:9…

---

## [Fuzzy Hash plugins (Java API for custom types, mappings?)](https://discuss.elastic.co/t/fuzzy-hash-plugins-java-api-for-custom-types-mappings/187866)

<div class="topic-metadata">

**Author:** [@rjzak](https://discuss.elastic.co/u/rjzak)\
**Replies:** 2\
**Last updated:** [June 27, 2019, 9:33pm UTC](https://discuss.elastic.co/t/fuzzy-hash-plugins-java-api-for-custom-types-mappings/187866 "2019-06-27T21:33:43Z")

</div>

I'm interested in developing plugins for fuzzy hashes, including ssdeep, sdhash, and LZJD. I did find something similar, an existing ssdeep plugin for Elasticsearch in Python, but I'd prefer to write the code in Java, si…

---

## [All Shards Failing](https://discuss.elastic.co/t/all-shards-failing/187626)

<div class="topic-metadata">

**Author:** [@Analyst](https://discuss.elastic.co/u/Analyst)\
**Replies:** 4\
**Last updated:** [June 27, 2019, 9:27pm UTC](https://discuss.elastic.co/t/all-shards-failing/187626 "2019-06-27T21:27:35Z")

</div>

Hi Team, I was trying to delete the old indices and ran into an issue. Now i am getting the below message in elastic search logs? Could you please help me out here?

---

## [Elasticsearch.service: Main process exited, code=exited, status=1/FAILURE when setting TLS](https://discuss.elastic.co/t/elasticsearch-service-main-process-exited-code-exited-status-1-failure-when-setting-tls/187870)

<div class="topic-metadata">

**Author:** [@derekmizak](https://discuss.elastic.co/u/derekmizak)\
**Replies:** 4\
**Last updated:** [June 27, 2019, 6:59pm UTC](https://discuss.elastic.co/t/elasticsearch-service-main-process-exited-code-exited-status-1-failure-when-setting-tls/187870 "2019-06-27T18:59:02Z")

</div>

ES 7.2 When following article about setting up cluster security https://www.elastic.co/blog/getting-started-with-elasticsearch-security I am unable to start elasticsearch instance, after adding the following to elastic…

---

## [Upgrade from 6.8 to 7.1 - master not discovered yet: have discovered \[...lists all master nodes...\]](https://discuss.elastic.co/t/upgrade-from-6-8-to-7-1-master-not-discovered-yet-have-discovered-lists-all-master-nodes/187604)

<div class="topic-metadata">

**Author:** [@vangogh94](https://discuss.elastic.co/u/vangogh94)\
**Replies:** 2\
**Last updated:** [June 27, 2019, 6:27pm UTC](https://discuss.elastic.co/t/upgrade-from-6-8-to-7-1-master-not-discovered-yet-have-discovered-lists-all-master-nodes/187604 "2019-06-27T18:27:47Z")

</div>

Hi, we upgraded to Elasticseach 7.1.1 from 6.8 last week, the cluster has 3 master nodes and 60 data nodes. First few days everything worked as expected. On the third day random nodes started disconnecting and connecting…

---

## [How to configure isolated elasticsearch servers](https://discuss.elastic.co/t/how-to-configure-isolated-elasticsearch-servers/187855)

<div class="topic-metadata">

**Author:** [@Cordobel](https://discuss.elastic.co/u/Cordobel)\
**Replies:** 2\
**Last updated:** [June 27, 2019, 6:23pm UTC](https://discuss.elastic.co/t/how-to-configure-isolated-elasticsearch-servers/187855 "2019-06-27T18:23:59Z")

</div>

My customer has three servers and want to separately install elasticsearch in each server. As far as I could understand, the default configuration of elasticsearch would gather these three servers in a single cluster, bu…

---

## [Multi-node docker elasticsearch node](https://discuss.elastic.co/t/multi-node-docker-elasticsearch-node/187891)

<div class="topic-metadata">

**Author:** [@brunor](https://discuss.elastic.co/u/brunor)\
**Replies:** 0\
**Last updated:** [June 27, 2019, 4:43pm UTC](https://discuss.elastic.co/t/multi-node-docker-elasticsearch-node/187891 "2019-06-27T16:43:16Z")

</div>

Hello everyone! I'm just new here, I would already thank everyone reading this. I already have a small and simple 3 node cluster running elastic with the puppet module but... I'm getting some new hardware (with some SSD…

---

## [How to format date in ESSQL?](https://discuss.elastic.co/t/how-to-format-date-in-essql/187890)

<div class="topic-metadata">

**Author:** [@Facundo\_Chambo](https://discuss.elastic.co/u/Facundo_Chambo)\
**Replies:** 0\
**Last updated:** [June 27, 2019, 4:38pm UTC](https://discuss.elastic.co/t/how-to-format-date-in-essql/187890 "2019-06-27T16:38:51Z")

</div>

I'm using ESSQL in Kibana Canvas to plot a line chart. I have a field date and want to group my data by "YEAR-MONTH". My query is something like this: SELECT date, duration FROM my\_index GROUP BY date but I need somet…

---

## [Elasticsearch node deletion](https://discuss.elastic.co/t/elasticsearch-node-deletion/187876)

<div class="topic-metadata">

**Author:** [@Callonski](https://discuss.elastic.co/u/Callonski)\
**Replies:** 1\
**Last updated:** [June 27, 2019, 4:13pm UTC](https://discuss.elastic.co/t/elasticsearch-node-deletion/187876 "2019-06-27T16:13:50Z")

</div>

I have a cluster with 6 nodes, and I want to remove 1 node. My replica setting is 1. If I delete the node, no data will be lost right? The remaining nodes will distribute the data between them? Will they create new pr…

---

## [How to monitor health of AWS all components using elk cloud?](https://discuss.elastic.co/t/how-to-monitor-health-of-aws-all-components-using-elk-cloud/187718)

<div class="topic-metadata">

**Author:** [@shankarananth](https://discuss.elastic.co/u/shankarananth)\
**Replies:** 1\
**Last updated:** [June 27, 2019, 4:02pm UTC](https://discuss.elastic.co/t/how-to-monitor-health-of-aws-all-components-using-elk-cloud/187718 "2019-06-27T16:02:42Z")

</div>

Please guide me to achieve below requirement. I need to monitor all the components available in AWS (EG: Amazon S3, AWS RDs, AWS DynamoDB, AWS – Elastic Block Store(EBS), AWS – IoT, AWS – Machine Learning, Amazon EKS - …

---

## [Bulk indexing stalls (7.2.0)](https://discuss.elastic.co/t/bulk-indexing-stalls-7-2-0/187388)

<div class="topic-metadata">

**Author:** [@crispygoth](https://discuss.elastic.co/u/crispygoth)\
**Replies:** 10\
**Last updated:** [June 27, 2019, 3:38pm UTC](https://discuss.elastic.co/t/bulk-indexing-stalls-7-2-0/187388 "2019-06-27T15:38:27Z")

</div>

Hi all, I'm in the process of updating an ES 5.3.0 cluster to the latest 7.2 version, and while re-indexing the data I'm noticing some odd behaviour in Elasticsearch. In short, it appears that the bulk indexing API is r…

---

## [Count API with Group By field](https://discuss.elastic.co/t/count-api-with-group-by-field/187295)

<div class="topic-metadata">

**Author:** [@Gokul\_Raj](https://discuss.elastic.co/u/Gokul_Raj)\
**Replies:** 3\
**Last updated:** [June 27, 2019, 3:32pm UTC](https://discuss.elastic.co/t/count-api-with-group-by-field/187295 "2019-06-27T15:32:03Z")

</div>

For my application I'm using count API provided by elasticsearch for getting the aggregate value for my search queries in Java using RestHighLevel Client. However I'm facing a situation where I need to get the aggregate …

---

## [Problem with analyzer](https://discuss.elastic.co/t/problem-with-analyzer/187794)

<div class="topic-metadata">

**Author:** [@soufiane1](https://discuss.elastic.co/u/soufiane1)\
**Replies:** 3\
**Last updated:** [June 27, 2019, 3:26pm UTC](https://discuss.elastic.co/t/problem-with-analyzer/187794 "2019-06-27T15:26:17Z")

</div>

Hi everyone, I am trying to parse out two fields in my data "Relation\_consomme" and "Relation\_utilise" but when defining the mapping, Dev\_Tools returns me the following error : { "error": { "root\_cause": \[ …

---

## [Retention of backup repositories](https://discuss.elastic.co/t/retention-of-backup-repositories/187697)

<div class="topic-metadata">

**Author:** [@Yury\_Kozlov](https://discuss.elastic.co/u/Yury_Kozlov)\
**Replies:** 3\
**Last updated:** [June 27, 2019, 2:04pm UTC](https://discuss.elastic.co/t/retention-of-backup-repositories/187697 "2019-06-27T14:04:36Z")

</div>

We are setting up an AWS S3 repository to make hourly snapshots with 3 days retention. Does Elastic provide an out of the box retention feature ? So that, for example, outdated snapshots will be deleted automatically. …

---

## [Query DSL feature request: a true OR query (with boost per constraint)](https://discuss.elastic.co/t/query-dsl-feature-request-a-true-or-query-with-boost-per-constraint/187839)

<div class="topic-metadata">

**Author:** [@Ayco\_Holleman](https://discuss.elastic.co/u/Ayco_Holleman)\
**Replies:** 0\
**Last updated:** [June 27, 2019, 1:23pm UTC](https://discuss.elastic.co/t/query-dsl-feature-request-a-true-or-query-with-boost-per-constraint/187839 "2019-06-27T13:23:02Z")

</div>

I have a use case where I need to match documents against a couple of constraints, but neither the bool query nor the dis max query nor the multi match fits the use case. Contrary to the bool query processing can and mu…

---

## [String comparison in if condition of pipeline doesn't match](https://discuss.elastic.co/t/string-comparison-in-if-condition-of-pipeline-doesnt-match/187849)

<div class="topic-metadata">

**Author:** [@lobotomeh](https://discuss.elastic.co/u/lobotomeh)\
**Replies:** 0\
**Last updated:** [June 27, 2019, 1:38pm UTC](https://discuss.elastic.co/t/string-comparison-in-if-condition-of-pipeline-doesnt-match/187849 "2019-06-27T13:38:19Z")

</div>

I'm trying to create a pipeline in Elasticsearch. I have to make a check before to know what pipeline to use, so I've made a pipeline that do the routing, like this : { "description": "A pipeline of pipelines for log …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1246)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1248)
