# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1479 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1480 --- ## [Overriding (removing) alias in higher-order index template](https://discuss.elastic.co/t/overriding-removing-alias-in-higher-order-index-template/157395)
**Author:** [@jmb](https://discuss.elastic.co/u/jmb)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 4:16pm UTC](https://discuss.elastic.co/t/overriding-removing-alias-in-higher-order-index-template/157395 "2018-11-19T16:16:50Z")
When creating index templates, we can use order to override elements of one template with another; it doesn't seem able to handle the case where a lower-order template has specified an alias, but in the higher-order temp… --- ## [Reindex data to a new mapping](https://discuss.elastic.co/t/reindex-data-to-a-new-mapping/157391)
**Author:** [@jlear](https://discuss.elastic.co/u/jlear)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 4:02pm UTC](https://discuss.elastic.co/t/reindex-data-to-a-new-mapping/157391 "2018-11-19T16:02:17Z")
We have strict templates for our data but we are evolving and have some new data model ideas that we are working on experimenting with and need to have a way to perform an ETL type of operation from one cluster to anothe… --- ## [Indexing a JSON file as an object field without parsing it](https://discuss.elastic.co/t/indexing-a-json-file-as-an-object-field-without-parsing-it/157390)
**Author:** [@Francisco\_Gomez](https://discuss.elastic.co/u/Francisco_Gomez)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 4:02pm UTC](https://discuss.elastic.co/t/indexing-a-json-file-as-an-object-field-without-parsing-it/157390 "2018-11-19T16:02:07Z")
Hello, this is my first time trying out ES and I have a question about indexing JSON objects. I need to index some very large JSON files which in truth I have not much control over the content of it. The idea is to map… --- ## [How to use existing indices?](https://discuss.elastic.co/t/how-to-use-existing-indices/157375)
**Author:** [@elastic\_mostafa](https://discuss.elastic.co/u/elastic_mostafa)\ **Replies:** 1\ **Last updated:** [November 19, 2018, 3:43pm UTC](https://discuss.elastic.co/t/how-to-use-existing-indices/157375 "2018-11-19T15:43:58Z")
Hi there , I have an existing indices and I would like to use it , Please how can I do that ? here the files-directories content : --- ## [How to add the elasticsearch index delete command in logstash config file](https://discuss.elastic.co/t/how-to-add-the-elasticsearch-index-delete-command-in-logstash-config-file/157372)
**Author:** [@Nethaji](https://discuss.elastic.co/u/Nethaji)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 1:56pm UTC](https://discuss.elastic.co/t/how-to-add-the-elasticsearch-index-delete-command-in-logstash-config-file/157372 "2018-11-19T13:56:48Z")
Hi I couldn't able to perform incremental load in logstash config file because of i'm having multiple join query in my statement. the only possible thing is i want to delete the elasticsearch index first and run the st… --- ## [What's the "qa" plugin?](https://discuss.elastic.co/t/whats-the-qa-plugin/156993)
**Author:** [@val](https://discuss.elastic.co/u/val)\ **Replies:** 3\ **Last updated:** [November 19, 2018, 3:21pm UTC](https://discuss.elastic.co/t/whats-the-qa-plugin/156993 "2018-11-19T15:21:32Z")
When running the following command, we can see the list of all plugins that can be installed by name: bin/elasticsearch-plugin install --help In the list, we can see a plugin named qa. Trying to install it, yields the … --- ## [Find the cause of document deletes](https://discuss.elastic.co/t/find-the-cause-of-document-deletes/156743)
**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\ **Replies:** 10\ **Last updated:** [November 19, 2018, 3:02pm UTC](https://discuss.elastic.co/t/find-the-cause-of-document-deletes/156743 "2018-11-19T15:02:53Z")
In an elasticsearch 5.x cluster, the team is using day-wise indices and deleting indices that are older than 150 days. However, GET \_cat/indices shows that document deletions are happening for each of the day-wise indice… --- ## [Elasticsearch Curator delete old-index after rollover?](https://discuss.elastic.co/t/elasticsearch-curator-delete-old-index-after-rollover/156836)
**Author:** [@ddregalo](https://discuss.elastic.co/u/ddregalo)\ **Replies:** 3\ **Last updated:** [November 19, 2018, 2:54pm UTC](https://discuss.elastic.co/t/elasticsearch-curator-delete-old-index-after-rollover/156836 "2018-11-19T14:54:27Z")
I have the following curator set-up in curator-actions.yml which is configured to delete indices based on age filter but I would like to set-up a config that deletes the old-index immediately after a rollover is successf… --- ## [Elasticsearch scroll](https://discuss.elastic.co/t/elasticsearch-scroll/157366)
**Author:** [@lonzodc](https://discuss.elastic.co/u/lonzodc)\ **Replies:** 5\ **Last updated:** [November 19, 2018, 1:50pm UTC](https://discuss.elastic.co/t/elasticsearch-scroll/157366 "2018-11-19T13:50:16Z")
Hi All, I would like to ask the best approach to extract thousands of records in Elasticsearch? Also is it possible to perform 1000 concurrent request using scroll api to extract the data from the elasticsearch index? T… --- ## [CopyOnWrite with Elasticsearch](https://discuss.elastic.co/t/copyonwrite-with-elasticsearch/157176)
**Author:** [@bhalajin](https://discuss.elastic.co/u/bhalajin)\ **Replies:** 6\ **Last updated:** [November 18, 2018, 10:20am UTC](https://discuss.elastic.co/t/copyonwrite-with-elasticsearch/157176 "2018-11-18T10:20:13Z")
Does Elasticsearch support CopyOnWrite when updating a document ? i.e., During update, instead of performing the update in-place, is it possible to make a copy of the original document and update the copy ? --- ## [Incremental load not execute properly](https://discuss.elastic.co/t/incremental-load-not-execute-properly/157364)
**Author:** [@Nethaji](https://discuss.elastic.co/u/Nethaji)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 1:23pm UTC](https://discuss.elastic.co/t/incremental-load-not-execute-properly/157364 "2018-11-19T13:23:46Z")
Hi I have logstash config file like below, but i couldn't able to get the correct count whenever i inserted new record the duplication is occur is there any possible to delete the elasticsearch index first and then exe… --- ## [Logstash Additional fields added by ES output](https://discuss.elastic.co/t/logstash-additional-fields-added-by-es-output/157232)
**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\ **Replies:** 4\ **Last updated:** [November 19, 2018, 12:41pm UTC](https://discuss.elastic.co/t/logstash-additional-fields-added-by-es-output/157232 "2018-11-19T12:41:18Z")
I am using logstash. input is jdbc and output is es. Just wanted to know the fields which I see when using just stout in output are the same fields which will be index to es or es output plug in might add some other ext… --- ## [Pipeline Performance & jdbc\_static filter](https://discuss.elastic.co/t/pipeline-performance-jdbc-static-filter/157169)
**Author:** [@hermann102](https://discuss.elastic.co/u/hermann102)\ **Replies:** 6\ **Last updated:** [November 19, 2018, 12:37pm UTC](https://discuss.elastic.co/t/pipeline-performance-jdbc-static-filter/157169 "2018-11-19T12:37:21Z")
Hello everyone, I am new to ELK and have a number of issues that I would like to share with you. My difficulties concern the following points: Pipeline Performance (FileBeat & Jbdc --\> Logstash--\> Elk--\>Kibana) Setti… --- ## [Limit number of fields without actually having to delete anything or hampering visualisations](https://discuss.elastic.co/t/limit-number-of-fields-without-actually-having-to-delete-anything-or-hampering-visualisations/156927)
**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\ **Replies:** 12\ **Last updated:** [November 19, 2018, 12:31pm UTC](https://discuss.elastic.co/t/limit-number-of-fields-without-actually-having-to-delete-anything-or-hampering-visualisations/156927 "2018-11-19T12:31:57Z")
Hi, Number of fields in my index is shooting above the limit (1000). I don't want to increase the limit any further (to avoid mapping explosion) . But rather planning on to cut down on the number of fields. There are fi… --- ## [Elastic Search heap alert](https://discuss.elastic.co/t/elastic-search-heap-alert/155479)
**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\ **Replies:** 12\ **Last updated:** [November 19, 2018, 12:19pm UTC](https://discuss.elastic.co/t/elastic-search-heap-alert/155479 "2018-11-19T12:19:11Z")
Hi there, I don't have much knowledge of elastic search memory management but currently, I am having 445 total indexes and my data size is 6.8GB.and having a 4.6GB heap size. I am using an elastic cloud to store my data… --- ## [Query APM services metrics](https://discuss.elastic.co/t/query-apm-services-metrics/157318)
**Author:** [@pabloborh](https://discuss.elastic.co/u/pabloborh)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 9:27am UTC](https://discuss.elastic.co/t/query-apm-services-metrics/157318 "2018-11-19T09:27:21Z")
Hi All, I want to do a query for retrieve average response time of services. That information is the same showed in APM UI. Where are these data stored? Thanks! PD: I have realized that I can check all transactions … --- ## [Total-hits-in-elastic-search-preparesearch-behaves-in-an-inconsistent-manner/](https://discuss.elastic.co/t/total-hits-in-elastic-search-preparesearch-behaves-in-an-inconsistent-manner/156617)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 2\ **Last updated:** [November 19, 2018, 10:11am UTC](https://discuss.elastic.co/t/total-hits-in-elastic-search-preparesearch-behaves-in-an-inconsistent-manner/156617 "2018-11-19T10:11:26Z")
Please refer this thread last reply. Nothing really helps. This inconsistent behaviour cause lot of trouble can you please provide a solution?? I have tried with scroll response.But same inconsistent behaviour is the… --- ## [Running Elasticsearch docker container with another user](https://discuss.elastic.co/t/running-elasticsearch-docker-container-with-another-user/157326)
**Author:** [@Rosmi](https://discuss.elastic.co/u/Rosmi)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 10:04am UTC](https://discuss.elastic.co/t/running-elasticsearch-docker-container-with-another-user/157326 "2018-11-19T10:04:58Z")
We are installing Elasticsearch from elasticsearch docker images to customers. Elasticsearch containers are running as default elasticsearch user. We have a requirement to take an arbitrary user at install time and run … --- ## [Sort by aggregations on nested?](https://discuss.elastic.co/t/sort-by-aggregations-on-nested/157322)
**Author:** [@tomm](https://discuss.elastic.co/u/tomm)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 9:54am UTC](https://discuss.elastic.co/t/sort-by-aggregations-on-nested/157322 "2018-11-19T09:54:43Z")
Hi, I have following query: sorry, I couldn't find how to insert formatted json, tried 4 spaces, but failed, so I put my mapping, sample data and query here: https://www.paste.org/96051 I hope that's ok how can I intr… --- ## [Upgrading the \_all field](https://discuss.elastic.co/t/upgrading-the-all-field/157323)
**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 10:01am UTC](https://discuss.elastic.co/t/upgrading-the-all-field/157323 "2018-11-19T10:01:05Z")
We're currently operating a v2.4 cluster, and want to upgrade to v6.x As I understand it, v6.x wont read v2.4-created indices, but will read v5.6.9-created indices. So the plan is go to to v5.6.9, reindex all the data … --- ## [Elasticsearch - segment replication](https://discuss.elastic.co/t/elasticsearch-segment-replication/157302)
**Author:** [@djjsindy](https://discuss.elastic.co/u/djjsindy)\ **Replies:** 1\ **Last updated:** [November 19, 2018, 9:39am UTC](https://discuss.elastic.co/t/elasticsearch-segment-replication/157302 "2018-11-19T09:39:30Z")
I read this blog a few months ago ：http://blog.mikemccandless.com/2017/09/lucenes-near-real-time-segment-index.html ,There is indeed a very core case in my work that can be used for this function.I developed the fun… --- ## [Copy\_to an dynamic or customised field](https://discuss.elastic.co/t/copy-to-an-dynamic-or-customised-field/157310)
**Author:** [@snak](https://discuss.elastic.co/u/snak)\ **Replies:** 2\ **Last updated:** [November 19, 2018, 9:23am UTC](https://discuss.elastic.co/t/copy-to-an-dynamic-or-customised-field/157310 "2018-11-19T09:23:21Z")
How to configure copy\_to from one dynamic template to another dynamic template. Here is a sample Config: - "dynamic\_templates": \[{ "template\_entity\_name\_": { "match": "entity\_name\_\*", "match\_mapping\_type": "string", "… --- ## [Using wildcards on large string values doesn't returns any document](https://discuss.elastic.co/t/using-wildcards-on-large-string-values-doesnt-returns-any-document/157313)
**Author:** [@solarwinds](https://discuss.elastic.co/u/solarwinds)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 9:18am UTC](https://discuss.elastic.co/t/using-wildcards-on-large-string-values-doesnt-returns-any-document/157313 "2018-11-19T09:18:30Z")
I believe that my issue is related to Elasticsearch itself, so I will post my question here. If this is more appropriate for another topic, I will move it. I have a Kafka process that I am monitoring and I am not able t… --- ## [Questions on ELK architecture](https://discuss.elastic.co/t/questions-on-elk-architecture/156600)
**Author:** [@Eva](https://discuss.elastic.co/u/Eva)\ **Replies:** 10\ **Last updated:** [November 19, 2018, 8:54am UTC](https://discuss.elastic.co/t/questions-on-elk-architecture/156600 "2018-11-19T08:54:02Z")
Hello there I have a cluster with two node, the second node added recently and only has Elasticsearch installed. Both are running on two different aws instances. Instance 1 has ELK installed and instance 2 has only Elas… --- ## [Elasticsearch 6 node sizing and configuration](https://discuss.elastic.co/t/elasticsearch-6-node-sizing-and-configuration/153901)
**Author:** [@Nitish\_Goyal](https://discuss.elastic.co/u/Nitish_Goyal)\ **Replies:** 3\ **Last updated:** [November 19, 2018, 6:59am UTC](https://discuss.elastic.co/t/elasticsearch-6-node-sizing-and-configuration/153901 "2018-11-19T06:59:26Z")
I am setting up a new elasticsearch 6 cluster. Our cluster is going to be write heavy cluster. We ingest roughly 1 TB of data each day Config of the machines is as follows : Disk : 1.5TB \* 2 Memory : 256 GB Cores : … --- ## [Invalid index name \[\_xpack\], must not start with '\_', '-', or '+'"](https://discuss.elastic.co/t/invalid-index-name-xpack-must-not-start-with-or/157270)
**Author:** [@pidugusundeep](https://discuss.elastic.co/u/pidugusundeep)\ **Replies:** 4\ **Last updated:** [November 19, 2018, 6:46am UTC](https://discuss.elastic.co/t/invalid-index-name-xpack-must-not-start-with-or/157270 "2018-11-19T06:46:26Z")
Hey i was just trying to use Elasticsearch sql and just installed xpack on my Elasticsearch and using kibana dev tools to query my documents i am unable to use \` GET /\_xpack/sql?format=txt \` it always throws { "… --- ## [Unable to install Custom Realm](https://discuss.elastic.co/t/unable-to-install-custom-realm/156477)
**Author:** [@Dibyakanta](https://discuss.elastic.co/u/Dibyakanta)\ **Replies:** 3\ **Last updated:** [November 19, 2018, 6:38am UTC](https://discuss.elastic.co/t/unable-to-install-custom-realm/156477 "2018-11-19T06:38:54Z")
Hi, I am trying to install the example custom realm in one of the nodes through command bin/x-pack/extension install file:///\/my-realm-1.0.zip... but keeps getting this NoSuchFileException. Can someone pls thro… --- ## [ES failed to recover from translog corruption](https://discuss.elastic.co/t/es-failed-to-recover-from-translog-corruption/157230)
**Author:** [@nebulae](https://discuss.elastic.co/u/nebulae)\ **Replies:** 5\ **Last updated:** [November 19, 2018, 6:19am UTC](https://discuss.elastic.co/t/es-failed-to-recover-from-translog-corruption/157230 "2018-11-19T06:19:50Z")
Hi, My ES single node server was forcibly shutdown, and it hasn't recovered from that. Now, ES is stuck in this error mode. How do I recover from this, and start ES? Thanks. I am running Version: 6.3.1, Build: default/… --- ## [Cluster.max\_shards\_per\_node](https://discuss.elastic.co/t/cluster-max-shards-per-node/157263)
**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\ **Replies:** 4\ **Last updated:** [November 19, 2018, 6:12am UTC](https://discuss.elastic.co/t/cluster-max-shards-per-node/157263 "2018-11-19T06:12:11Z")
I see following message through Dev Tools in Kibana: #! Deprecation: In a future major version, this request will fail because this action would add \[10\] total shards, but this cluster currently has \[9556\]/\[5000\] maxim… --- ## [サジェスト結果に対してAggregationをかけたい](https://discuss.elastic.co/t/aggregation/157269)
**Author:** [@aya2453](https://discuss.elastic.co/u/aya2453)\ **Replies:** 0\ **Last updated:** [November 19, 2018, 5:50am UTC](https://discuss.elastic.co/t/aggregation/157269 "2018-11-19T05:50:30Z")
お世話になっております。Elasticsearch初心者のためよくわかっていない部分も多いのですが、以下の内容を実現する方法に関して相談させてください :black\_medium\_small\_square:やりたいこと user情報を管理するindexに定義したtagsフィールドに対してサジェスト検索を行い、そのタグ名と設定しているユーザーのカウントをとる 以下試した結果になります :black\_medium\_small\_squ… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1478) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1480)