# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1096 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1097 --- ## [Difference between manage\_pipeline and manage\_ingest\_pipelines privileges?](https://discuss.elastic.co/t/difference-between-manage-pipeline-and-manage-ingest-pipelines-privileges/207683)
**Author:** [@bruce289](https://discuss.elastic.co/u/bruce289)\ **Replies:** 0\ **Last updated:** [November 13, 2019, 10:56am UTC](https://discuss.elastic.co/t/difference-between-manage-pipeline-and-manage-ingest-pipelines-privileges/207683 "2019-11-13T10:56:41Z")
Hi, According to the docs, there are 2 privileges related to the management of ingest pipelines (manage\_pipeline and manage\_ingest\_pipelines), however, it's not clear to me what the difference is between them. Thanks. --- ## [What are the best (preferred) methods to recover data from a corrupted shard?](https://discuss.elastic.co/t/what-are-the-best-preferred-methods-to-recover-data-from-a-corrupted-shard/207583)
**Author:** [@pushshift](https://discuss.elastic.co/u/pushshift)\ **Replies:** 2\ **Last updated:** [November 13, 2019, 10:25am UTC](https://discuss.elastic.co/t/what-are-the-best-preferred-methods-to-recover-data-from-a-corrupted-shard/207583 "2019-11-13T10:25:30Z")
I recently ran into an out of space issue (I know, bad planning) and I would like to recover as much data from the shard as possible. I can see the data files under the node directory for that particular index and was wo… --- ## [Get extra fields at \`xpack\` vertices](https://discuss.elastic.co/t/get-extra-fields-at-xpack-vertices/207457)
**Author:** [@dbenatia](https://discuss.elastic.co/u/dbenatia)\ **Replies:** 4\ **Last updated:** [November 13, 2019, 10:19am UTC](https://discuss.elastic.co/t/get-extra-fields-at-xpack-vertices/207457 "2019-11-13T10:19:26Z")
Hello all , i am using elasticsearch v5.6 with an "xpack" license, i am doing a request to //\_xpack/\_graph/\_explore as shown in the docs. the response is vertices and connections as expected. is there any way to a… --- ## [Mapping Array of Arrays that have mapped fields?](https://discuss.elastic.co/t/mapping-array-of-arrays-that-have-mapped-fields/207417)
**Author:** [@mikeRead](https://discuss.elastic.co/u/mikeRead)\ **Replies:** 1\ **Last updated:** [November 13, 2019, 10:09am UTC](https://discuss.elastic.co/t/mapping-array-of-arrays-that-have-mapped-fields/207417 "2019-11-13T10:09:21Z")
I want to map a field to store data like so field1:\[ \[ {val:1}, {val:2} \], \[ {val:3} \], \[ {val:4} \] \] For the life of me I can't find how to map all the way down to "val:number" Thank you for any help even… --- ## [How to block not Non-TLS connections on elasticsearch](https://discuss.elastic.co/t/how-to-block-not-non-tls-connections-on-elasticsearch/207621)
**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\ **Replies:** 1\ **Last updated:** [November 13, 2019, 10:00am UTC](https://discuss.elastic.co/t/how-to-block-not-non-tls-connections-on-elasticsearch/207621 "2019-11-13T10:00:51Z")
Hi, we have some logs at elasticsearch which shows, some remote IP:port is connecting to our elasticsearch which is non-TLS. We are not able to find any services on those hosts. Is there any way I can block all non-T… --- ## [How to get the last nested object of all documents then perform sub-aggregations](https://discuss.elastic.co/t/how-to-get-the-last-nested-object-of-all-documents-then-perform-sub-aggregations/207306)
**Author:** [@Noctis17](https://discuss.elastic.co/u/Noctis17)\ **Replies:** 2\ **Last updated:** [November 13, 2019, 9:32am UTC](https://discuss.elastic.co/t/how-to-get-the-last-nested-object-of-all-documents-then-perform-sub-aggregations/207306 "2019-11-13T09:32:04Z")
I have an index called socialmedia and trying to create queries with this field called eng (omitted some unnecessary fields) "id" : "1", "eng": \[ { "soc\_mm\_score" : "3", "date\_updated" : "1520969306", }, { "s… --- ## [Error:Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release](https://discuss.elastic.co/t/error-java-hotspot-tm-64-bit-server-vm-warning-option-useconcmarksweepgc-was-deprecated-in-version-9-0-and-will-likely-be-removed-in-a-future-release/207661)
**Author:** [@pyerunka](https://discuss.elastic.co/u/pyerunka)\ **Replies:** 0\ **Last updated:** [November 13, 2019, 9:04am UTC](https://discuss.elastic.co/t/error-java-hotspot-tm-64-bit-server-vm-warning-option-useconcmarksweepgc-was-deprecated-in-version-9-0-and-will-likely-be-removed-in-a-future-release/207661 "2019-11-13T09:04:17Z")
Hello, Can anyone help me in this? I am getting below error when trying to run logstash config file: Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely b… --- ## [ELK upgrade from 6.6 to 7.4.2](https://discuss.elastic.co/t/elk-upgrade-from-6-6-to-7-4-2/207513)
**Author:** [@rshetty](https://discuss.elastic.co/u/rshetty)\ **Replies:** 3\ **Last updated:** [November 13, 2019, 4:45am UTC](https://discuss.elastic.co/t/elk-upgrade-from-6-6-to-7-4-2/207513 "2019-11-13T04:45:39Z")
HI, I am currently planning an upgrade from ELK 6.6 to 7.4.2 but I would like to do this as rolling upgrade because having the entire cluster restart or down is not an option. According to the documentation, full cluste… --- ## [How to manage bookings with es nested structure](https://discuss.elastic.co/t/how-to-manage-bookings-with-es-nested-structure/207426)
**Author:** [@\_avinashks](https://discuss.elastic.co/u/_avinashks)\ **Replies:** 8\ **Last updated:** [November 13, 2019, 4:34am UTC](https://discuss.elastic.co/t/how-to-manage-bookings-with-es-nested-structure/207426 "2019-11-13T04:34:17Z")
Hello, I am working on a booking management system for vehicles, I have a nested structure for bookings inside the vehicle document as shown below. Each booking will include 2 timestamps: fromTime and tillTime which ind… --- ## [Unpacking archive failed error: Elasticsearch 7.1.0 -rpm](https://discuss.elastic.co/t/unpacking-archive-failed-error-elasticsearch-7-1-0-rpm/207619)
**Author:** [@katara](https://discuss.elastic.co/u/katara)\ **Replies:** 0\ **Last updated:** [November 13, 2019, 4:33am UTC](https://discuss.elastic.co/t/unpacking-archive-failed-error-elasticsearch-7-1-0-rpm/207619 "2019-11-13T04:33:51Z")
Hi i am trying to install elasticsearch 7.1.0 using an rpm file in a Linux RHEL 7.x machine and when i hit sudo rpm --install elasticsearch-7.1.0-x86\_64.rpm or sudo rpm -ivh elasticsearch-7.1.0-x86\_64.rpm i am receiv… --- ## [How to setup watcher email alerts in cluster level kibana](https://discuss.elastic.co/t/how-to-setup-watcher-email-alerts-in-cluster-level-kibana/207617)
**Author:** [@vishnuvardhan](https://discuss.elastic.co/u/vishnuvardhan)\ **Replies:** 0\ **Last updated:** [November 13, 2019, 3:35am UTC](https://discuss.elastic.co/t/how-to-setup-watcher-email-alerts-in-cluster-level-kibana/207617 "2019-11-13T03:35:53Z")
previous i created the watcher in my local server 1 elasticsearch and kibana server. now my requirement is my cluster having 3 es nodes ,2 logstash nodes ,3 ml nodes,1 kibana .. how to setup watcher and email conf in el… --- ## [Question about index rollover](https://discuss.elastic.co/t/question-about-index-rollover/207452)
**Author:** [@iridescent233](https://discuss.elastic.co/u/iridescent233)\ **Replies:** 2\ **Last updated:** [November 13, 2019, 2:02am UTC](https://discuss.elastic.co/t/question-about-index-rollover/207452 "2019-11-13T02:02:05Z")
I set is reached 1000 documents perform index flip operation, continue to write the index data, set up the "indices. Lifecycle. Poll\_interval" : "1 s", but I find that even at 2000 documents is still not turn over, but w… --- ## ["A distribution version is required" when running benchmark-only](https://discuss.elastic.co/t/a-distribution-version-is-required-when-running-benchmark-only/207571)
**Author:** [@Maxwell\_Hostetter](https://discuss.elastic.co/u/Maxwell_Hostetter)\ **Replies:** 1\ **Last updated:** [November 12, 2019, 10:09pm UTC](https://discuss.elastic.co/t/a-distribution-version-is-required-when-running-benchmark-only/207571 "2019-11-12T22:09:45Z")
I'm trying to benchmark elastic cluster that is running in docker. The command I issue is esrally --track=pmc --target-hosts=host1,host2,host3 --pipeline=benchmark-only I'm under the impression that distribution-versio… --- ## [Running elasticsearch-net tests in a container](https://discuss.elastic.co/t/running-elasticsearch-net-tests-in-a-container/207592)
**Author:** [@bobu](https://discuss.elastic.co/u/bobu)\ **Replies:** 0\ **Last updated:** [November 12, 2019, 9:44pm UTC](https://discuss.elastic.co/t/running-elasticsearch-net-tests-in-a-container/207592 "2019-11-12T21:44:42Z")
I'm trying to run the full set of integration tests from the elasticsearch-net (GitHub - elastic/elasticsearch-net: This strongly-typed, client library enables working with Elasticsearch. It is the official client ma… --- ## [Option missing "fix" on startup](https://discuss.elastic.co/t/option-missing-fix-on-startup/207580)
**Author:** [@pushshift](https://discuss.elastic.co/u/pushshift)\ **Replies:** 6\ **Last updated:** [November 12, 2019, 9:21pm UTC](https://discuss.elastic.co/t/option-missing-fix-on-startup/207580 "2019-11-12T21:21:26Z")
There used to be an option "fix" for index.shard.check\_on\_startup but that doesn't work with ES 7.x Has this functionality been removed or moved to a different type of endpoint? root@es3:/var/tmp# curl -H 'content-type… --- ## [Automatically Purging Indexes and Backups](https://discuss.elastic.co/t/automatically-purging-indexes-and-backups/207163)
**Author:** [@palkema](https://discuss.elastic.co/u/palkema)\ **Replies:** 4\ **Last updated:** [November 12, 2019, 9:03pm UTC](https://discuss.elastic.co/t/automatically-purging-indexes-and-backups/207163 "2019-11-12T21:03:05Z")
Hi, I am new to elastic and am looking to use elastic at the moment for logging and APM. I love it. Having said that, since we are just getting things up and running, we are limited to one windows production server whi… --- ## [Elasticsearch + Django + openshift](https://discuss.elastic.co/t/elasticsearch-django-openshift/207579)
**Author:** [@enricodimaio87](https://discuss.elastic.co/u/enricodimaio87)\ **Replies:** 0\ **Last updated:** [November 12, 2019, 7:58pm UTC](https://discuss.elastic.co/t/elasticsearch-django-openshift/207579 "2019-11-12T19:58:00Z")
Hi all! I have a website written in django which records every single item of the django DB in an elasticsearch index inside my local machine, using django-elasticsearch-dsl. I have pushed my application to openshift, … --- ## [ConnectionTimeout caused by - ReadTimeoutError, master not discovered yet](https://discuss.elastic.co/t/connectiontimeout-caused-by-readtimeouterror-master-not-discovered-yet/207420)
**Author:** [@dstromberg](https://discuss.elastic.co/u/dstromberg)\ **Replies:** 2\ **Last updated:** [November 12, 2019, 7:38pm UTC](https://discuss.elastic.co/t/connectiontimeout-caused-by-readtimeouterror-master-not-discovered-yet/207420 "2019-11-12T19:38:37Z")
Hi folks. I'm getting this error in a python3 program trying to talk to elasticsearch: elasticsearch.exceptions.ConnectionTimeout: ConnectionTimeout caused by - ReadTimeoutError(HTTPConnectionPool(host='localhost', po… --- ## [ELK resource requirements](https://discuss.elastic.co/t/elk-resource-requirements/207215)
**Author:** [@zgergely](https://discuss.elastic.co/u/zgergely)\ **Replies:** 3\ **Last updated:** [November 12, 2019, 6:34pm UTC](https://discuss.elastic.co/t/elk-resource-requirements/207215 "2019-11-12T18:34:00Z")
Hi everyone, We are running and ELK 7.1 deployment on IKS (IBMCloud Kubernetes Service). Our setup is the following: Infrastructure: -IKS Cluster running Kubernetes 1.14.8\_1536 -2x worker nodes of type Virtual Share… --- ## [Application requires user and password for Elasticsearch](https://discuss.elastic.co/t/application-requires-user-and-password-for-elasticsearch/207021)
**Author:** [@danyfloresp](https://discuss.elastic.co/u/danyfloresp)\ **Replies:** 13\ **Last updated:** [November 12, 2019, 5:24pm UTC](https://discuss.elastic.co/t/application-requires-user-and-password-for-elasticsearch/207021 "2019-11-12T17:24:53Z")
Hi! I'm working with the open source version of Elasticsearch 7.4. I'm trying to conect to my index from Oracle Analytics Desktop and it requires me to enter username and password. xPack is not configured in my cluster. … --- ## [Aggregate query count having count](https://discuss.elastic.co/t/aggregate-query-count-having-count/206769)
**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\ **Replies:** 3\ **Last updated:** [November 12, 2019, 3:43pm UTC](https://discuss.elastic.co/t/aggregate-query-count-having-count/206769 "2019-11-12T15:43:32Z")
I need to create visualisation 4 lines (I want to identify how many customers in time are using how many devices) count (unique customer) having count(uniqued deviceid) = 2 count (unique customer) having count(uniqu… --- ## [Top 5 cpu consuming queries](https://discuss.elastic.co/t/top-5-cpu-consuming-queries/206272)
**Author:** [@hurryup](https://discuss.elastic.co/u/hurryup)\ **Replies:** 1\ **Last updated:** [November 12, 2019, 3:36pm UTC](https://discuss.elastic.co/t/top-5-cpu-consuming-queries/206272 "2019-11-12T15:36:35Z")
Hello. Is it possible to somehow collect such information - top cpu consuming queries ? I can see that my cluster is heavily loaded but I can't find by which queries. --- ## [Impact of multiple concurrent scroll API on ElasticSearch](https://discuss.elastic.co/t/impact-of-multiple-concurrent-scroll-api-on-elasticsearch/206805)
**Author:** [@avinash9999](https://discuss.elastic.co/u/avinash9999)\ **Replies:** 2\ **Last updated:** [November 12, 2019, 12:01pm UTC](https://discuss.elastic.co/t/impact-of-multiple-concurrent-scroll-api-on-elasticsearch/206805 "2019-11-12T12:01:01Z")
I am using a large number of search API(using scroll = '1m') to search documents from it Average no of requests per minute = 500 Average time of hit = 100 ms Sometimes when hits are at peak I started getting error … --- ## [Replica mapper error](https://discuss.elastic.co/t/replica-mapper-error/207542)
**Author:** [@Akaren](https://discuss.elastic.co/u/Akaren)\ **Replies:** 0\ **Last updated:** [November 12, 2019, 2:37pm UTC](https://discuss.elastic.co/t/replica-mapper-error/207542 "2019-11-12T14:37:27Z")
I am getting mapper \[countCalls\] of different type, current\_type \[long\], merged\_type \[text\] It is happening always only! around midnight and the error shows it's replica problem TransportReplicationAction$PrimaryShardRe… --- ## [NoClassDefFoundError exception with SpringBoot in Elasticsearch7.3](https://discuss.elastic.co/t/noclassdeffounderror-exception-with-springboot-in-elasticsearch7-3/207385)
**Author:** [@Ricardooooo](https://discuss.elastic.co/u/Ricardooooo)\ **Replies:** 4\ **Last updated:** [November 12, 2019, 2:28pm UTC](https://discuss.elastic.co/t/noclassdeffounderror-exception-with-springboot-in-elasticsearch7-3/207385 "2019-11-12T14:28:23Z")
Hi! I try to create document via high level rest client with: Map\ jsonMap = new HashMap\<\>(); jsonMap.put("name", "Bob"); jsonMap.put("id", "123456"); IndexRequest indexRequest = new IndexRequest("lead")… --- ## [Cat indices not working plz help](https://discuss.elastic.co/t/cat-indices-not-working-plz-help/207536)
**Author:** [@shota](https://discuss.elastic.co/u/shota)\ **Replies:** 0\ **Last updated:** [November 12, 2019, 1:52pm UTC](https://discuss.elastic.co/t/cat-indices-not-working-plz-help/207536 "2019-11-12T13:52:38Z")
Hi all I have elasticsearch 6.8.3 and trying to get all indices from dev tools like this: GET \_cat/indices?v but I only get blank page: health status index uuid pri rep docs.count docs.deleted store.size pri.store.si… --- ## [Inconsistent unacknowledged reads from the same ES node](https://discuss.elastic.co/t/inconsistent-unacknowledged-reads-from-the-same-es-node/207509)
**Author:** [@ailin](https://discuss.elastic.co/u/ailin)\ **Replies:** 0\ **Last updated:** [November 12, 2019, 12:50pm UTC](https://discuss.elastic.co/t/inconsistent-unacknowledged-reads-from-the-same-es-node/207509 "2019-11-12T12:50:57Z")
Hi, community. Here's the situation I'm struggling with. Hope you could help me with it. I have 2 node ES cluster with index that has 2 shards. The first node is primary for both shards. To say it simply I send upda… --- ## [Related to regexp query](https://discuss.elastic.co/t/related-to-regexp-query/207304)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 5\ **Last updated:** [November 12, 2019, 1:05pm UTC](https://discuss.elastic.co/t/related-to-regexp-query/207304 "2019-11-12T13:05:55Z")
Hi, I am framing a query on attribute named distinguished name(dn) Example: "dn" : "cn=abc,ou=def,o=ig". i am looking for query where dn ends with o=ig and has only one child for example "dn": "cn=abc,o=ig" "dn": "cn… --- ## [Create a new field using painless](https://discuss.elastic.co/t/create-a-new-field-using-painless/207295)
**Author:** [@maju3634](https://discuss.elastic.co/u/maju3634)\ **Replies:** 1\ **Last updated:** [November 12, 2019, 12:42pm UTC](https://discuss.elastic.co/t/create-a-new-field-using-painless/207295 "2019-11-12T12:42:52Z")
Hello i want to convert my Date of Birth ("DateBirth") data to be Age data using scripted field. So how it possible ? Can you tell me how to convert it ? so this is my query: --- ## [\[Solved\] - How to create a replica node only to existing cluster](https://discuss.elastic.co/t/solved-how-to-create-a-replica-node-only-to-existing-cluster/207473)
**Author:** [@JH82](https://discuss.elastic.co/u/JH82)\ **Replies:** 5\ **Last updated:** [November 12, 2019, 12:38pm UTC](https://discuss.elastic.co/t/solved-how-to-create-a-replica-node-only-to-existing-cluster/207473 "2019-11-12T12:38:40Z")
Hello, Today I've only 1 node. (health is marked Yellow, because is not HA) is it possible to add a replica node only to a cluster ? I wish to have 1 node active and 1 datanode only for search with replica data from fi… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1095) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1097)