# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=704 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 705 --- ## [Elasticsearch:primary shards lost, after server restart due to power failure on datacenter](https://discuss.elastic.co/t/elasticsearch-primary-shards-lost-after-server-restart-due-to-power-failure-on-datacenter/264112)
**Author:** [@Sanjay\_Chinthala](https://discuss.elastic.co/u/Sanjay_Chinthala)\ **Replies:** 2\ **Last updated:** [February 15, 2021, 5:10am UTC](https://discuss.elastic.co/t/elasticsearch-primary-shards-lost-after-server-restart-due-to-power-failure-on-datacenter/264112 "2021-02-15T05:10:59Z")
Hi, we have loss the primary shard after datacenter power failure and My ES version: 2.4.6 and we have 5 data nodes ,1 master node \[2021-02-08 14:01:37,916\]\[INFO \]\[cluster.service \] \[es1\] detected\_master {es3}{5oxdhS4U… --- ## [Database on ELK stack](https://discuss.elastic.co/t/database-on-elk-stack/264265)
**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\ **Replies:** 2\ **Last updated:** [February 15, 2021, 4:48am UTC](https://discuss.elastic.co/t/database-on-elk-stack/264265 "2021-02-15T04:48:22Z")
is elastic has a database? --- ## [IP arrays break network conditionals?](https://discuss.elastic.co/t/ip-arrays-break-network-conditionals/263514)
**Author:** [@DPattee](https://discuss.elastic.co/u/DPattee)\ **Replies:** 1\ **Last updated:** [February 15, 2021, 1:04am UTC](https://discuss.elastic.co/t/ip-arrays-break-network-conditionals/263514 "2021-02-15T01:04:33Z")
Trying to tackle geocoding again... The public geoip lookup plugin works with IP addresses arrays now, but trying to get the private IP's geocoded isn't working well. Tried using processors in (for example) a metricbeat… --- ## [Elasticsearch not showing indexes after VM update](https://discuss.elastic.co/t/elasticsearch-not-showing-indexes-after-vm-update/263925)
**Author:** [@Giovanni\_Ferrari](https://discuss.elastic.co/u/Giovanni_Ferrari)\ **Replies:** 1\ **Last updated:** [February 14, 2021, 11:42pm UTC](https://discuss.elastic.co/t/elasticsearch-not-showing-indexes-after-vm-update/263925 "2021-02-14T23:42:33Z")
Hello everyone! I installed a cluster composed by a single node in a VM, with a disk attached to it and used for data storage (path.data configuration). The problem I'm facing is that in case the VM is destroyed and rebu… --- ## [org.elasticsearch.hadoop.rest.EsHadoopParsingException: org.elasticsearch.hadoop.EsHadoopIllegalStateException: Position for 'targetTableCount.site\_xref: ' not found in row; typically this is caused by a mapping inconsistency](https://discuss.elastic.co/t/org-elasticsearch-hadoop-rest-eshadoopparsingexception-org-elasticsearch-hadoop-eshadoopillegalstateexception-position-for-targettablecount-site-xref-not-found-in-row-typically-this-is-caused-by-a-mapping-inconsistency/264007)
**Author:** [@andrejavorski](https://discuss.elastic.co/u/andrejavorski)\ **Replies:** 0\ **Last updated:** [February 11, 2021, 11:27am UTC](https://discuss.elastic.co/t/org-elasticsearch-hadoop-rest-eshadoopparsingexception-org-elasticsearch-hadoop-eshadoopillegalstateexception-position-for-targettablecount-site-xref-not-found-in-row-typically-this-is-caused-by-a-mapping-inconsistency/264007 "2021-02-11T11:27:51Z")
Hello everyone, I'm currently having issues with one of my jobs with below error: org.elasticsearch.hadoop.rest.EsHadoopParsingException: org.elasticsearch.hadoop.EsHadoopIllegalStateException: Position for 'targetTabl… --- ## [Want to copy specific data coming in and send to a new index](https://discuss.elastic.co/t/want-to-copy-specific-data-coming-in-and-send-to-a-new-index/264053)
**Author:** [@S3l3ct3d](https://discuss.elastic.co/u/S3l3ct3d)\ **Replies:** 1\ **Last updated:** [February 14, 2021, 11:32pm UTC](https://discuss.elastic.co/t/want-to-copy-specific-data-coming-in-and-send-to-a-new-index/264053 "2021-02-14T23:32:59Z")
I am going to try and explain this process we are wanting to accomplish. We have logs coming in from a specific vendor and going into its own index. We are wanting to capture specific data coming in from that index and… --- ## [Master Not Discovered Exception : FailedToCommitClusterStateException: node is no longer master for term 55 while handling publication](https://discuss.elastic.co/t/master-not-discovered-exception-failedtocommitclusterstateexception-node-is-no-longer-master-for-term-55-while-handling-publication/264049)
**Author:** [@RamyaGowda](https://discuss.elastic.co/u/RamyaGowda)\ **Replies:** 1\ **Last updated:** [February 14, 2021, 11:29pm UTC](https://discuss.elastic.co/t/master-not-discovered-exception-failedtocommitclusterstateexception-node-is-no-longer-master-for-term-55-while-handling-publication/264049 "2021-02-14T23:29:52Z")
Hello Team, Last time i checked the cluster health was on December, from that time no one monitored the servers and didn't check the cluster health. Last week when i tried to access kibana, encountered an error "Kiban… --- ## [Unable to send data to AWS MSK, getting debug message: Kafka publish failed with: circuit breaker is open](https://discuss.elastic.co/t/unable-to-send-data-to-aws-msk-getting-debug-message-kafka-publish-failed-with-circuit-breaker-is-open/264044)
**Author:** [@saroja](https://discuss.elastic.co/u/saroja)\ **Replies:** 1\ **Last updated:** [February 14, 2021, 11:28pm UTC](https://discuss.elastic.co/t/unable-to-send-data-to-aws-msk-getting-debug-message-kafka-publish-failed-with-circuit-breaker-is-open/264044 "2021-02-14T23:28:35Z")
Dear Team , I am facing issue during data transfer in between filebeat and AWS msk cluster. The only error its showing like "circuit breaker open". I am using filebeat agent version 7.10.0 and AWS msk version 2.2.1.… --- ## [Index.mapping.total\_fields.limit for multiple indices in an elasticsearch cluster](https://discuss.elastic.co/t/index-mapping-total-fields-limit-for-multiple-indices-in-an-elasticsearch-cluster/264101)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 1\ **Last updated:** [February 14, 2021, 11:14pm UTC](https://discuss.elastic.co/t/index-mapping-total-fields-limit-for-multiple-indices-in-an-elasticsearch-cluster/264101 "2021-02-14T23:14:25Z")
How does index.mapping.total\_field.limit works with multiple indices in an elasticsearch cluster? Let's say if I need to increase the index.mapping.total\_field.limit from the default 1000 to 2000 then will it be better … --- ## [How to reallocation shards in repurposed node](https://discuss.elastic.co/t/how-to-reallocation-shards-in-repurposed-node/264246)
**Author:** [@testsemd\_email](https://discuss.elastic.co/u/testsemd_email)\ **Replies:** 2\ **Last updated:** [February 14, 2021, 6:25pm UTC](https://discuss.elastic.co/t/how-to-reallocation-shards-in-repurposed-node/264246 "2021-02-14T18:25:21Z")
A data node was repurposed(to upgrade the node). Then it was unable to reallocate shards yet. It has configured as a warm node. I want to how to allocate shards to this node again? --- ## [Query about deleting snapshots](https://discuss.elastic.co/t/query-about-deleting-snapshots/264229)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 5\ **Last updated:** [February 14, 2021, 5:54pm UTC](https://discuss.elastic.co/t/query-about-deleting-snapshots/264229 "2021-02-14T17:54:12Z")
I know that snapshots are incremental, but what I don't understand is what happens when you delete a snapshot? I assume that deleting an earlier snapshot will remove all indexes that have not been modified since it wa… --- ## [Be Careful With 7.11.0 Update If You Use LDAP With Realms](https://discuss.elastic.co/t/be-careful-with-7-11-0-update-if-you-use-ldap-with-realms/264253)
**Author:** [@patrickmm](https://discuss.elastic.co/u/patrickmm)\ **Replies:** 1\ **Last updated:** [February 14, 2021, 5:07pm UTC](https://discuss.elastic.co/t/be-careful-with-7-11-0-update-if-you-use-ldap-with-realms/264253 "2021-02-14T17:07:13Z")
About an hour ago, I tried updating my on prem 7.10.2 dev cluster (RHEL 8, 15 nodes) to 7.11.0. On the first node I ran yum update on, when I restarted Elasticsearch, it failed. I looked at journalctl and saw errors rel… --- ## [Elasticsearch reindex parsing error](https://discuss.elastic.co/t/elasticsearch-reindex-parsing-error/264251)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 2\ **Last updated:** [February 14, 2021, 3:27pm UTC](https://discuss.elastic.co/t/elasticsearch-reindex-parsing-error/264251 "2021-02-14T15:27:33Z")
Hi all, i'm trying to copy data of specified fields from one index to another using reindex. curl -XPOST --header 'Content-Type: application/json' http://localhost:9200/\_reindex -d '{ "source": { "index1": "sunny\_1" … --- ## [I have about 500,000 children for each parent](https://discuss.elastic.co/t/i-have-about-500-000-children-for-each-parent/264215)
**Author:** [@mbawazir](https://discuss.elastic.co/u/mbawazir)\ **Replies:** 4\ **Last updated:** [February 13, 2021, 6:44pm UTC](https://discuss.elastic.co/t/i-have-about-500-000-children-for-each-parent/264215 "2021-02-13T18:44:13Z")
Can I use "Inner Objects" for Managing Relations Inside Elasticsearch when I have about 500,000 children for each parent? or what is the best way to deal with it --- ## [Elastic search won't start after upgrade to 7.11](https://discuss.elastic.co/t/elastic-search-wont-start-after-upgrade-to-7-11/264170)
**Author:** [@glifhits](https://discuss.elastic.co/u/glifhits)\ **Replies:** 2\ **Last updated:** [February 14, 2021, 3:27am UTC](https://discuss.elastic.co/t/elastic-search-wont-start-after-upgrade-to-7-11/264170 "2021-02-14T03:27:16Z")
I'm getting the following error. I've looked thru it but nothing stands out. \` Starting Elasticsearch Server … --- ## [Issue with document-level security expression and date range](https://discuss.elastic.co/t/issue-with-document-level-security-expression-and-date-range/264197)
**Author:** [@mattvl](https://discuss.elastic.co/u/mattvl)\ **Replies:** 3\ **Last updated:** [February 13, 2021, 10:37pm UTC](https://discuss.elastic.co/t/issue-with-document-level-security-expression-and-date-range/264197 "2021-02-13T22:37:48Z")
I am having the same issue as https://discuss.elastic.co/t/granted-documents-query-with-filter-by-timestamp/201834 and https://discuss.elastic.co/t/document-level-security-combining-queries-together/136143 { "bool… --- ## [Filter context without bool](https://discuss.elastic.co/t/filter-context-without-bool/264218)
**Author:** [@AndreKR](https://discuss.elastic.co/u/AndreKR)\ **Replies:** 2\ **Last updated:** [February 13, 2021, 7:03pm UTC](https://discuss.elastic.co/t/filter-context-without-bool/264218 "2021-02-13T19:03:53Z")
It seems that the minimum code I need for a filter context match is: { "query": { "bool": { "filter": { ... } } } } That looks quite verbose and involves a bool query, even though no act… --- ## [Restrict cold nodes queries](https://discuss.elastic.co/t/restrict-cold-nodes-queries/264217)
**Author:** [@Yenii\_Ceri](https://discuss.elastic.co/u/Yenii_Ceri)\ **Replies:** 2\ **Last updated:** [February 13, 2021, 4:15pm UTC](https://discuss.elastic.co/t/restrict-cold-nodes-queries/264217 "2021-02-13T16:15:39Z")
Hi, If for example, I configure an ILM to send an index to a cold Elasticsearch node. How to ensure that search queries on Elasticsearch only process hot nodes and not cold ones because researching cold nodes will be co… --- ## [Firebase cloud functions where to find the elasticsearch credentials (username, password, url)](https://discuss.elastic.co/t/firebase-cloud-functions-where-to-find-the-elasticsearch-credentials-username-password-url/264124)
**Author:** [@Jonatan](https://discuss.elastic.co/u/Jonatan)\ **Replies:** 1\ **Last updated:** [February 13, 2021, 2:31pm UTC](https://discuss.elastic.co/t/firebase-cloud-functions-where-to-find-the-elasticsearch-credentials-username-password-url/264124 "2021-02-13T14:31:06Z")
I'm trying to setup a firebase cloud function that will index to elastic search anytime an update to my firebase RTDB happen. Every tutorial I've seen is using "Elasticsearch Certified by Bitnami" for the integration (f… --- ## [Getting documents from an index with more than 10,000 records](https://discuss.elastic.co/t/getting-documents-from-an-index-with-more-than-10-000-records/264069)
**Author:** [@vastevenson](https://discuss.elastic.co/u/vastevenson)\ **Replies:** 4\ **Last updated:** [February 12, 2021, 8:59pm UTC](https://discuss.elastic.co/t/getting-documents-from-an-index-with-more-than-10-000-records/264069 "2021-02-12T20:59:39Z")
I am trying to get a list of the ids of all document in my index. The index has about 50k documents in it, however I cannot use the from parameter to see any ids once "from" + "size" \> 10,000. I know there's the scroll a… --- ## [Filebeat warn issue depend to the pipeline (Index not found in kibana)](https://discuss.elastic.co/t/filebeat-warn-issue-depend-to-the-pipeline-index-not-found-in-kibana/264172)
**Author:** [@marouane](https://discuss.elastic.co/u/marouane)\ **Replies:** 0\ **Last updated:** [February 12, 2021, 6:41pm UTC](https://discuss.elastic.co/t/filebeat-warn-issue-depend-to-the-pipeline-index-not-found-in-kibana/264172 "2021-02-12T18:41:24Z")
Hello, Trying to start filebeat service I'm getting this war that prevent to get the index showing in kibana. 2021-02-04T15:50:40.400+0100 WARN \[elasticsearch\] elasticsearch/client.go:407 Cannot index event publishe… --- ## [Search not returning the intended results](https://discuss.elastic.co/t/search-not-returning-the-intended-results/264169)
**Author:** [@RicPeres](https://discuss.elastic.co/u/RicPeres)\ **Replies:** 0\ **Last updated:** [February 12, 2021, 6:35pm UTC](https://discuss.elastic.co/t/search-not-returning-the-intended-results/264169 "2021-02-12T18:35:09Z")
Hello all, Wondering if anyone can help me, I'm having problems in a search performed on elastic, the search itself is very simple however for some specific words, although, they exist in the intended doc, the hit is no… --- ## [Query string cross\_fields synonyms](https://discuss.elastic.co/t/query-string-cross-fields-synonyms/264059)
**Author:** [@wboult](https://discuss.elastic.co/u/wboult)\ **Replies:** 0\ **Last updated:** [February 11, 2021, 10:24pm UTC](https://discuss.elastic.co/t/query-string-cross-fields-synonyms/264059 "2021-02-11T22:24:06Z")
I am using the query string cross\_fields query type to provide a simple search UI that queries many different fields as though they are one big field. I want to make it possible to have different analyzers for some of t… --- ## [Many Elasticsearch threads in WAITING parking state](https://discuss.elastic.co/t/many-elasticsearch-threads-in-waiting-parking-state/264154)
**Author:** [@shreedhan](https://discuss.elastic.co/u/shreedhan)\ **Replies:** 1\ **Last updated:** [February 12, 2021, 5:23pm UTC](https://discuss.elastic.co/t/many-elasticsearch-threads-in-waiting-parking-state/264154 "2021-02-12T17:23:48Z")
Hi, We are running a ES cluster on 6.8 and we are still using TCP client. I know it's deprecated and move to REST client but we have not got around to it yet. In addition, we have a service which uses Elastic4s library… --- ## [Azure Marketplace - Elasticsearch managed service failing](https://discuss.elastic.co/t/azure-marketplace-elasticsearch-managed-service-failing/264143)
**Author:** [@Campbell](https://discuss.elastic.co/u/Campbell)\ **Replies:** 1\ **Last updated:** [February 12, 2021, 5:03pm UTC](https://discuss.elastic.co/t/azure-marketplace-elasticsearch-managed-service-failing/264143 "2021-02-12T17:03:32Z")
All, I'm trying to subscribe to the Elasticsearch Managed Service from the Azure Marketplace and I'm hitting some errors. It seems that the options available during subscription are limited (plan, resource group etc.),… --- ## [ElasticsearchDeprecationWarning: Need some clarification to make corrections](https://discuss.elastic.co/t/elasticsearchdeprecationwarning-need-some-clarification-to-make-corrections/264136)
**Author:** [@varshap](https://discuss.elastic.co/u/varshap)\ **Replies:** 3\ **Last updated:** [February 12, 2021, 4:11pm UTC](https://discuss.elastic.co/t/elasticsearchdeprecationwarning-need-some-clarification-to-make-corrections/264136 "2021-02-12T16:11:33Z")
Hi Guys, I am new to ES, I recently integrated ES in my Django project by following. https://django-elasticsearch-dsl.readthedocs.io/en/latest/quickstart.html Versions used: django-elasticsearch-dsl==7.1.4 django-el… --- ## [Plugin configuration](https://discuss.elastic.co/t/plugin-configuration/264079)
**Author:** [@rwxr\_xr\_x](https://discuss.elastic.co/u/rwxr_xr_x)\ **Replies:** 2\ **Last updated:** [February 12, 2021, 3:14pm UTC](https://discuss.elastic.co/t/plugin-configuration/264079 "2021-02-12T15:14:05Z")
Hello, I'm converting a plugin built for ES 2.1.1 to ES 7.10. I'm running into a strange issue. I need to pass: plugin-name.enable: true If I add it to elasticsearch.yml file, the configuration is available in my plu… --- ## [Elasticsearch throwing some overhead warning in logs](https://discuss.elastic.co/t/elasticsearch-throwing-some-overhead-warning-in-logs/264137)
**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\ **Replies:** 3\ **Last updated:** [February 12, 2021, 3:01pm UTC](https://discuss.elastic.co/t/elasticsearch-throwing-some-overhead-warning-in-logs/264137 "2021-02-12T15:01:57Z")
HI Team, we are getting below response in elasticsearch log , anyone can help me on this why im getting this kind of error on it, \[2021-02-12T07:29:17,371\]\[WARN \]\[o.e.m.j.JvmGcMonitorService\] \[datanode1\] \[gc\]\[242917\] … --- ## [Searchable snapshots in ECK - Enterprise license only?](https://discuss.elastic.co/t/searchable-snapshots-in-eck-enterprise-license-only/264138)
**Author:** [@sc75651](https://discuss.elastic.co/u/sc75651)\ **Replies:** 1\ **Last updated:** [February 12, 2021, 2:12pm UTC](https://discuss.elastic.co/t/searchable-snapshots-in-eck-enterprise-license-only/264138 "2021-02-12T14:12:11Z")
Is Searchable snapshots in ECK - Enterprise license only? --- ## [How to use date\_histogram to aggregate documents that span multiple period based on two date fields](https://discuss.elastic.co/t/how-to-use-date-histogram-to-aggregate-documents-that-span-multiple-period-based-on-two-date-fields/264135)
**Author:** [@Lekishor](https://discuss.elastic.co/u/Lekishor)\ **Replies:** 0\ **Last updated:** [February 12, 2021, 1:42pm UTC](https://discuss.elastic.co/t/how-to-use-date-histogram-to-aggregate-documents-that-span-multiple-period-based-on-two-date-fields/264135 "2021-02-12T13:42:39Z")
Hi, So I have documents defined based on the following mapping: documents: "ID": { "type": "integer" }, "Start": { "type": "date", "format": "strict\_date\_optional\_t… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=703) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=705)