# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1367 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1368 --- ## [Add new dynamic\_template](https://discuss.elastic.co/t/add-new-dynamic-template/172061)
**Author:** [@begemot](https://discuss.elastic.co/u/begemot)\ **Replies:** 0\ **Last updated:** [March 13, 2019, 5:34am UTC](https://discuss.elastic.co/t/add-new-dynamic-template/172061 "2019-03-13T05:34:23Z")
How to add new dynamic\_template to already existing mapping? --- ## [Not able to understand the logs of shrink index API?](https://discuss.elastic.co/t/not-able-to-understand-the-logs-of-shrink-index-api/172058)
**Author:** [@nikhil.k](https://discuss.elastic.co/u/nikhil.k)\ **Replies:** 0\ **Last updated:** [March 13, 2019, 5:06am UTC](https://discuss.elastic.co/t/not-able-to-understand-the-logs-of-shrink-index-api/172058 "2019-03-13T05:06:47Z")
Hi Everyone, Elasticsearch version - 6.4.1 Can anyone explain me the given below debug logs in detail: \[node1\] \[index2\]\[0\] bootstrap a new history\_uuid \[{local\_checkpoint=-1, history\_uuid=Dz\_7d05nTE2SlToGdT7 5Eg… --- ## [Is it possible to eliminate duplication of search response when using nested query?](https://discuss.elastic.co/t/is-it-possible-to-eliminate-duplication-of-search-response-when-using-nested-query/169750)
**Author:** [@Masanori\_Ohnishi](https://discuss.elastic.co/u/Masanori_Ohnishi)\ **Replies:** 2\ **Last updated:** [March 13, 2019, 4:49am UTC](https://discuss.elastic.co/t/is-it-possible-to-eliminate-duplication-of-search-response-when-using-nested-query/169750 "2019-03-13T04:49:27Z")
Here's the sample of mapping, register, and search query. mapping curl -X PUT "es:9200/english" -H 'Content-Type: application/json' -d' { "mappings": { "\_doc": { "properties": { "title" : { … --- ## [Encrypting Elasticsearch Data in Transit and at Rest](https://discuss.elastic.co/t/encrypting-elasticsearch-data-in-transit-and-at-rest/172039)
**Author:** [@shatabdi](https://discuss.elastic.co/u/shatabdi)\ **Replies:** 2\ **Last updated:** [March 13, 2019, 3:54am UTC](https://discuss.elastic.co/t/encrypting-elasticsearch-data-in-transit-and-at-rest/172039 "2019-03-13T03:54:05Z")
Is there a node to node and client to ES in-transit data encryption available for elasticsearch . We are using AWS ec2 IaaS for our elasticsearch instance . The version that we are using is 5.6 but we plan to upgrade it … --- ## [Question about Elasticsearch and asp.net](https://discuss.elastic.co/t/question-about-elasticsearch-and-asp-net/171687)
**Author:** [@Ka\_Ho\_LEE](https://discuss.elastic.co/u/Ka_Ho_LEE)\ **Replies:** 5\ **Last updated:** [March 13, 2019, 1:48am UTC](https://discuss.elastic.co/t/question-about-elasticsearch-and-asp-net/171687 "2019-03-13T01:48:37Z")
Hello everyone, I am the beginner of the Elasticsearch. I am sorry for not good at English. I have the question about how to interact Elasticsearch and asp.net. I already use asp.net to create a website and index the d… --- ## [Painless - how to convert float number to 'pt,BR' locale with one decimal digit?](https://discuss.elastic.co/t/painless-how-to-convert-float-number-to-pt-br-locale-with-one-decimal-digit/171221)
**Author:** [@guilherme\_maranhao](https://discuss.elastic.co/u/guilherme_maranhao)\ **Replies:** 2\ **Last updated:** [March 13, 2019, 1:24am UTC](https://discuss.elastic.co/t/painless-how-to-convert-float-number-to-pt-br-locale-with-one-decimal-digit/171221 "2019-03-13T01:24:26Z")
Hi everyone, I have a script\_field for converting a float field value into an one digit value in 'pt,BR' locale. I'm doing the following: script: { inline: "if (params\['\_source'\]\['my\_field'\] != null) { \[ (M… --- ## [Size difference for snapshot repository when executing Disk Free (DF) vs Disk Usage (DU) commands on Linux](https://discuss.elastic.co/t/size-difference-for-snapshot-repository-when-executing-disk-free-df-vs-disk-usage-du-commands-on-linux/172035)
**Author:** [@JayNair](https://discuss.elastic.co/u/JayNair)\ **Replies:** 0\ **Last updated:** [March 12, 2019, 10:28pm UTC](https://discuss.elastic.co/t/size-difference-for-snapshot-repository-when-executing-disk-free-df-vs-disk-usage-du-commands-on-linux/172035 "2019-03-12T22:28:34Z")
We are facing an issue with the disk usage on the NFS mounted on the Elasticsearch VMs for storing snapshots. We create daily indices and snapshots are created for indices older than 30 days and retain the snapshots for… --- ## [\[FORBIDDEN/12/index read-only](https://discuss.elastic.co/t/forbidden-12-index-read-only/171578)
**Author:** [@paulo.leao](https://discuss.elastic.co/u/paulo.leao)\ **Replies:** 7\ **Last updated:** [March 12, 2019, 9:42pm UTC](https://discuss.elastic.co/t/forbidden-12-index-read-only/171578 "2019-03-12T21:42:25Z")
I am getting the following message from Logstash: \[INFO \]\[logstash.outputs.elasticsearch\] retrying failed action with response code: 403 ({"type"=\>"cluster\_block\_exception", "reason"=\>"blocked by: \[FORBIDDEN/12/index re… --- ## [MSI Install Question](https://discuss.elastic.co/t/msi-install-question/172022)
**Author:** [@dylan](https://discuss.elastic.co/u/dylan)\ **Replies:** 0\ **Last updated:** [March 12, 2019, 6:36pm UTC](https://discuss.elastic.co/t/msi-install-question/172022 "2019-03-12T18:36:17Z")
It appears that if you install ES via MSI, you don't get the elasticsearch-service.bat or elasticsearch-service-mgr.exe that you would if you installed via .zip file. Is there any other management GUI that can be used t… --- ## [Elastic Serach query not matching encoded string(45" - 45")](https://discuss.elastic.co/t/elastic-serach-query-not-matching-encoded-string-45-45-quot/171941)
**Author:** [@prashu039](https://discuss.elastic.co/u/prashu039)\ **Replies:** 1\ **Last updated:** [March 12, 2019, 5:17pm UTC](https://discuss.elastic.co/t/elastic-serach-query-not-matching-encoded-string-45-45-quot/171941 "2019-03-12T17:17:56Z")
We have product details which contain length parameter which has value as 45"(45 inch) So on indexing this product details I am converting 45" to encoded string ie 45" ; So on search i will send the search parameter… --- ## [Incompatible types found in multi-mapping](https://discuss.elastic.co/t/incompatible-types-found-in-multi-mapping/170066)
**Author:** [@bob28](https://discuss.elastic.co/u/bob28)\ **Replies:** 11\ **Last updated:** [March 12, 2019, 4:54pm UTC](https://discuss.elastic.co/t/incompatible-types-found-in-multi-mapping/170066 "2019-03-12T16:54:24Z")
Hi All, I have elasticsearch index named as dataInfo-yyyy.mm.dd. I am querying elasticsearch thru spark scala to get the data by searching index as dataInfo\* and its throwing error as follows: catch exceptionorg.elast… --- ## [Migrate ES Cloud 1.7.3 to local machine](https://discuss.elastic.co/t/migrate-es-cloud-1-7-3-to-local-machine/171984)
**Author:** [@1tek4u](https://discuss.elastic.co/u/1tek4u)\ **Replies:** 4\ **Last updated:** [March 12, 2019, 4:27pm UTC](https://discuss.elastic.co/t/migrate-es-cloud-1-7-3-to-local-machine/171984 "2019-03-12T16:27:04Z")
Any recommendations? --- ## [How to use the high level rest API to build an Aggregation from JSON](https://discuss.elastic.co/t/how-to-use-the-high-level-rest-api-to-build-an-aggregation-from-json/171981)
**Author:** [@Bengagi\_Foued](https://discuss.elastic.co/u/Bengagi_Foued)\ **Replies:** 3\ **Last updated:** [March 12, 2019, 4:26pm UTC](https://discuss.elastic.co/t/how-to-use-the-high-level-rest-api-to-build-an-aggregation-from-json/171981 "2019-03-12T16:26:04Z")
need help ! How to make the "set aggregation" from JSON string ! I have an application where i build a json string with aggregations in frontend (angular) then i send this json to backend (Spring boot) to perform the re… --- ## [ES 6.4.2 - error when trying to snapshot cluster to S3 bucket](https://discuss.elastic.co/t/es-6-4-2-error-when-trying-to-snapshot-cluster-to-s3-bucket/171910)
**Author:** [@NadavKal](https://discuss.elastic.co/u/NadavKal)\ **Replies:** 2\ **Last updated:** [March 12, 2019, 4:19pm UTC](https://discuss.elastic.co/t/es-6-4-2-error-when-trying-to-snapshot-cluster-to-s3-bucket/171910 "2019-03-12T16:19:47Z")
i have open a new bucket on S3 and added full S3 permissions to the cluster instance Role. but when attempting to snapshot like this: /\_snapshot/s3\_repository { "type": "s3", "settings": { "bucket": "my-bucket", "… --- ## [What is the most efficient way to compare two indices?](https://discuss.elastic.co/t/what-is-the-most-efficient-way-to-compare-two-indices/171997)
**Author:** [@chenmx](https://discuss.elastic.co/u/chenmx)\ **Replies:** 0\ **Last updated:** [March 12, 2019, 4:02pm UTC](https://discuss.elastic.co/t/what-is-the-most-efficient-way-to-compare-two-indices/171997 "2019-03-12T16:02:06Z")
In some of the old forums, comparing two indices is discussed, but it did not give a clear answer. Given index A and Index B, both index have millions of document, and I am using Logstash to index documents. I want to c… --- ## [How to add surround query parser](https://discuss.elastic.co/t/how-to-add-surround-query-parser/171994)
**Author:** [@Ryu\_Jea-tek](https://discuss.elastic.co/u/Ryu_Jea-tek)\ **Replies:** 0\ **Last updated:** [March 12, 2019, 3:52pm UTC](https://discuss.elastic.co/t/how-to-add-surround-query-parser/171994 "2019-03-12T15:52:43Z")
In my application, I want to apply surround query parser to my elasticsearch. I think there was something about this before However, I don't know how to add surround query parser in my elasticsearch. is it possible… --- ## [Count text fields from aggregation](https://discuss.elastic.co/t/count-text-fields-from-aggregation/171993)
**Author:** [@gguman](https://discuss.elastic.co/u/gguman)\ **Replies:** 0\ **Last updated:** [March 12, 2019, 3:52pm UTC](https://discuss.elastic.co/t/count-text-fields-from-aggregation/171993 "2019-03-12T15:52:13Z")
Hi to all! I have a query and some aggregation on it. And I want to count text fields inside the aggregation result. How I can do it without changing structure and mapping of the fields? query: aggs(field:keyword): cou… --- ## [Is there a way to update index-pattern \_id?](https://discuss.elastic.co/t/is-there-a-way-to-update-index-pattern-id/171985)
**Author:** [@Andrew\_Griffiths](https://discuss.elastic.co/u/Andrew_Griffiths)\ **Replies:** 1\ **Last updated:** [March 12, 2019, 3:39pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-update-index-pattern-id/171985 "2019-03-12T15:39:04Z")
I have had to recreate some index-patterns but they have created with random id's example: index-pattern:29adfc30-09cb-11e9-9616-6fa1143e677c","\_score":3.0726933,"\_source":{"index-pattern":{"title":"elastalert\*","timeF… --- ## [Need help to reindex with date format changed](https://discuss.elastic.co/t/need-help-to-reindex-with-date-format-changed/171980)
**Author:** [@piet](https://discuss.elastic.co/u/piet)\ **Replies:** 1\ **Last updated:** [March 12, 2019, 3:19pm UTC](https://discuss.elastic.co/t/need-help-to-reindex-with-date-format-changed/171980 "2019-03-12T15:19:23Z")
I try to re-index a index to a new one. Reason is i wan't to change the date format. But it throws error: "cause": { "type": "mapper\_parsing\_exception", "reason": "failed to parse \[start\_date\]", "caused\_by… --- ## [How to feed Logs from 11 different instances to Elasticsearch?](https://discuss.elastic.co/t/how-to-feed-logs-from-11-different-instances-to-elasticsearch/171680)
**Author:** [@groverjatin17](https://discuss.elastic.co/u/groverjatin17)\ **Replies:** 3\ **Last updated:** [March 12, 2019, 2:54pm UTC](https://discuss.elastic.co/t/how-to-feed-logs-from-11-different-instances-to-elasticsearch/171680 "2019-03-12T14:54:47Z")
Hi All, We have 11 instances running for an inhouse app. All of those produce logs in XML format. We want to collect data from all 11 instances and feed to in Elasticsearch and Create Kibana Dashboard for the same. I … --- ## [Shipping logs from Elasticsearch nodes to Elasticsearch cluster](https://discuss.elastic.co/t/shipping-logs-from-elasticsearch-nodes-to-elasticsearch-cluster/171873)
**Author:** [@sterago](https://discuss.elastic.co/u/sterago)\ **Replies:** 5\ **Last updated:** [March 12, 2019, 2:33pm UTC](https://discuss.elastic.co/t/shipping-logs-from-elasticsearch-nodes-to-elasticsearch-cluster/171873 "2019-03-12T14:33:25Z")
Is there a recommended way to ship the logs produced by Elasticsearch nodes over to the Elasticsearch cluster itself for centralized logging purposes? Thanks in advance for any input --- ## [Reindex to version 6 and lost nested type](https://discuss.elastic.co/t/reindex-to-version-6-and-lost-nested-type/171740)
**Author:** [@magorbe](https://discuss.elastic.co/u/magorbe)\ **Replies:** 0\ **Last updated:** [March 11, 2019, 11:31am UTC](https://discuss.elastic.co/t/reindex-to-version-6-and-lost-nested-type/171740 "2019-03-11T11:31:49Z")
Hello !! last week I did reindex, from version 2 to version 6 and when I compare the new mapping with the old I find some diferences, the most important the no nested type. It's everything ok ? thanks !!! The old mappin… --- ## [Elasticsearch hangs during initialization](https://discuss.elastic.co/t/elasticsearch-hangs-during-initialization/171971)
**Author:** [@sss](https://discuss.elastic.co/u/sss)\ **Replies:** 0\ **Last updated:** [March 12, 2019, 2:13pm UTC](https://discuss.elastic.co/t/elasticsearch-hangs-during-initialization/171971 "2019-03-12T14:13:34Z")
Hi , Elasticsearch startup hangs and doesnt proceed further even if it was given 8 gb heap. Version of Elasticsearch used in 2.4.0 and Operating system is Linux Here is the log that got generated so far before it get… --- ## [Elasticsearch removing field inside field](https://discuss.elastic.co/t/elasticsearch-removing-field-inside-field/171729)
**Author:** [@prasad.ram1431](https://discuss.elastic.co/u/prasad.ram1431)\ **Replies:** 3\ **Last updated:** [March 12, 2019, 1:23pm UTC](https://discuss.elastic.co/t/elasticsearch-removing-field-inside-field/171729 "2019-03-12T13:23:07Z")
Hi, I would like to remove fields from my ES, which are below format, { "parent": { "address": { "city": "abc", "state": "def" } } } By using "script": "ctx.\_source.remove("parent.address")", it's not remo… --- ## [Filed Security For Gold Membership](https://discuss.elastic.co/t/filed-security-for-gold-membership/171951)
**Author:** [@priya08](https://discuss.elastic.co/u/priya08)\ **Replies:** 3\ **Last updated:** [March 12, 2019, 1:00pm UTC](https://discuss.elastic.co/t/filed-security-for-gold-membership/171951 "2019-03-12T13:00:46Z")
Hi Team, I want to provide the field level security , but when i am creating the role with below POST API call , POST /\_xpack/security/role/offshoreRole { "indices": \[ { "names" : \[ "logstash-",".kibana" \], "privi… --- ## [Document overriding using update api](https://discuss.elastic.co/t/document-overriding-using-update-api/171495)
**Author:** [@prasad.ram1431](https://discuss.elastic.co/u/prasad.ram1431)\ **Replies:** 6\ **Last updated:** [March 12, 2019, 12:57pm UTC](https://discuss.elastic.co/t/document-overriding-using-update-api/171495 "2019-03-12T12:57:09Z")
Hi All, I have a scenario as below, POST \_bulk { "index" : { "\_index" : "test", "\_type" : "\_doc", "\_id" : "1" } } {"field1": "ram", "doj" : "2019-12-01"} { "index" : { "\_index" : "test", "\_type" : "\_doc", "\_id" : "2" }… --- ## [Primary Shards and Replica Shards](https://discuss.elastic.co/t/primary-shards-and-replica-shards/171946)
**Author:** [@rahulkumar1](https://discuss.elastic.co/u/rahulkumar1)\ **Replies:** 1\ **Last updated:** [March 12, 2019, 12:47pm UTC](https://discuss.elastic.co/t/primary-shards-and-replica-shards/171946 "2019-03-12T12:47:46Z")
I have three Master Nodes in a cluster: If I plan to have 1 Primary shard and two Replica shards, at any point of time how many nodes can fail without any data loss ? What would be the recommended numb er of Primary shar… --- ## [Elastic Cluster with Hadoop](https://discuss.elastic.co/t/elastic-cluster-with-hadoop/171860)
**Author:** [@shikhasingh](https://discuss.elastic.co/u/shikhasingh)\ **Replies:** 3\ **Last updated:** [March 12, 2019, 12:24pm UTC](https://discuss.elastic.co/t/elastic-cluster-with-hadoop/171860 "2019-03-12T12:24:23Z")
Hi Team, I have created one node ES cluster and want to integrate with my hadoop cluster, we are using ES 6.6 and HDP 3 version. we want to integrate ES with hive and followed the given documents. But when try to creat… --- ## [Search guard configuration question](https://discuss.elastic.co/t/search-guard-configuration-question/171937)
**Author:** [@vaslion](https://discuss.elastic.co/u/vaslion)\ **Replies:** 2\ **Last updated:** [March 12, 2019, 12:13pm UTC](https://discuss.elastic.co/t/search-guard-configuration-question/171937 "2019-03-12T12:13:13Z")
hello everyone, i am attempting to run search guard with elastic search but no matter what I have tried from the suggestions I found while googling I could not solve it. So i decided to ask here. Here is the error i re… --- ## [Elasticsearch, Beats and Logstash - PDF User Guides](https://discuss.elastic.co/t/elasticsearch-beats-and-logstash-pdf-user-guides/171934)
**Author:** [@lar](https://discuss.elastic.co/u/lar)\ **Replies:** 1\ **Last updated:** [March 12, 2019, 11:57am UTC](https://discuss.elastic.co/t/elasticsearch-beats-and-logstash-pdf-user-guides/171934 "2019-03-12T11:57:30Z")
I could find the html version of the user guides here \[https://www.elastic.co/guide/index.html\]. Where can I find the latest UserGuides in PDF format ? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1366) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1368)