# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1040 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1041 --- ## [How to query for changes](https://discuss.elastic.co/t/how-to-query-for-changes/215812)
**Author:** [@uniquename](https://discuss.elastic.co/u/uniquename)\ **Replies:** 2\ **Last updated:** [January 21, 2020, 11:07am UTC](https://discuss.elastic.co/t/how-to-query-for-changes/215812 "2020-01-21T11:07:37Z")
Hi, I am looking for a way to query for changes in my elasticsearch documents. I have devices which periodically check in with their on/off status so my document will look something like this: @timestamp - January 21st… --- ## [How to compare two fields of same name on different doc\_type](https://discuss.elastic.co/t/how-to-compare-two-fields-of-same-name-on-different-doc-type/215860)
**Author:** [@vimal](https://discuss.elastic.co/u/vimal)\ **Replies:** 1\ **Last updated:** [January 21, 2020, 10:57am UTC](https://discuss.elastic.co/t/how-to-compare-two-fields-of-same-name-on-different-doc-type/215860 "2020-01-21T10:57:53Z")
Hi, I have two oracle tables containing millions of rows in each table. I have index all records into elasticsearch using logstash jdbc plugin. The Idea is to compare difference between two tables using Elasticsearch i… --- ## [Backup of Elasticsearch cluster running in Kubernetes (GKE)](https://discuss.elastic.co/t/backup-of-elasticsearch-cluster-running-in-kubernetes-gke/215858)
**Author:** [@jagan1333](https://discuss.elastic.co/u/jagan1333)\ **Replies:** 1\ **Last updated:** [January 21, 2020, 10:50am UTC](https://discuss.elastic.co/t/backup-of-elasticsearch-cluster-running-in-kubernetes-gke/215858 "2020-01-21T10:50:38Z")
Hi How can I take backup of Elasticsearch cluster running in Kubernetes as a statefulsets (Google Kubernetes Engine). Thanks in advance! --- ## [No parameter named configdir when using secrets on puppet module](https://discuss.elastic.co/t/no-parameter-named-configdir-when-using-secrets-on-puppet-module/215847)
**Author:** [@lofic](https://discuss.elastic.co/u/lofic)\ **Replies:** 1\ **Last updated:** [January 21, 2020, 10:42am UTC](https://discuss.elastic.co/t/no-parameter-named-configdir-when-using-secrets-on-puppet-module/215847 "2020-01-21T10:42:25Z")
Hello, this is working : elasticsearch::instance { 'es-01': config =\> { 'network.host' =\> '0.0.0.0' }, } But as soon as I add some secrets secrets =\> ... I get : no parameter named 'configdir' on Ela… --- ## [Elasticsearch ingest pipeline - on failure field removal problem](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-on-failure-field-removal-problem/215861)
**Author:** [@pastechecker](https://discuss.elastic.co/u/pastechecker)\ **Replies:** 0\ **Last updated:** [January 21, 2020, 10:39am UTC](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-on-failure-field-removal-problem/215861 "2020-01-21T10:39:29Z")
Hello. I am trying to test if the field is a valid IP address. If not, I want to remove it. I also stick to the ECS convention. My ingest pipeline: PUT \_ingest/pipeline/ingestion\_pipeline\_geo { "description": "geoe… --- ## [\] \[data\_node\_1\] not enough master nodes discovered during pinging (found \[\[\]\], but needed \[1\]), pinging again](https://discuss.elastic.co/t/data-node-1-not-enough-master-nodes-discovered-during-pinging-found-but-needed-1-pinging-again/215291)
**Author:** [@nidhi1](https://discuss.elastic.co/u/nidhi1)\ **Replies:** 18\ **Last updated:** [January 21, 2020, 10:09am UTC](https://discuss.elastic.co/t/data-node-1-not-enough-master-nodes-discovered-during-pinging-found-but-needed-1-pinging-again/215291 "2020-01-21T10:09:53Z")
Hi I have two two node cluster on red hat Enterprise Linux server . Both nodes are running on different different server. when i run elastic search for the server having data node ,getting such error --- ## [Document Index error:- index \[....\] blocked by: \[FORBIDDEN/12/index read-only / allow delete (api)\]](https://discuss.elastic.co/t/document-index-error-index-blocked-by-forbidden-12-index-read-only-allow-delete-api/215833)
**Author:** [@krushnakantB](https://discuss.elastic.co/u/krushnakantB)\ **Replies:** 4\ **Last updated:** [January 21, 2020, 9:58am UTC](https://discuss.elastic.co/t/document-index-error-index-blocked-by-forbidden-12-index-read-only-allow-delete-api/215833 "2020-01-21T09:58:17Z")
Hi All, As I mentioned in the subject we got an error like blocked by: \[FORBIDDEN/12/index read-only / allow delete (api)\]. For this I have checked that it might be low disk space. But in our case we have free space of … --- ## [Operating System Interoperability](https://discuss.elastic.co/t/operating-system-interoperability/215850)
**Author:** [@BenBell](https://discuss.elastic.co/u/BenBell)\ **Replies:** 0\ **Last updated:** [January 21, 2020, 9:39am UTC](https://discuss.elastic.co/t/operating-system-interoperability/215850 "2020-01-21T09:39:25Z")
Hi, Does Elastic Search support multiple operating systems? I am in a position where I want to spin up an ES cluster - preferably on Linux. We do not yet have a corporate image for Linux (although one is being develop… --- ## [Kibana Query - match and not eixsts on same field in a single query](https://discuss.elastic.co/t/kibana-query-match-and-not-eixsts-on-same-field-in-a-single-query/215765)
**Author:** [@suren-raymond](https://discuss.elastic.co/u/suren-raymond)\ **Replies:** 8\ **Last updated:** [January 21, 2020, 9:28am UTC](https://discuss.elastic.co/t/kibana-query-match-and-not-eixsts-on-same-field-in-a-single-query/215765 "2020-01-21T09:28:12Z")
i've a index document field called "historicalData". Usually it has a value set \[true,false\]. But few documents of an index are not having the above said field "historicalData" at all. Wanted to query the documents with … --- ## [Limiting Repetitive Log Messages](https://discuss.elastic.co/t/limiting-repetitive-log-messages/215844)
**Author:** [@natey](https://discuss.elastic.co/u/natey)\ **Replies:** 0\ **Last updated:** [January 21, 2020, 8:53am UTC](https://discuss.elastic.co/t/limiting-repetitive-log-messages/215844 "2020-01-21T08:53:08Z")
Hi, We have developed a private PaaS, using Elastic+Filebeat+Logstash+Kibana as centralized logs management. One micro-service that got into endless lop of exceptions filled Elastic disk with the same log massage so… --- ## [Update using Elasticsearch restlevel client 7.5.1 is failing on Elasticsearch 6.8 AWS cluster](https://discuss.elastic.co/t/update-using-elasticsearch-restlevel-client-7-5-1-is-failing-on-elasticsearch-6-8-aws-cluster/214231)
**Author:** [@Aishwarya\_Gopikrishn](https://discuss.elastic.co/u/Aishwarya_Gopikrishn)\ **Replies:** 6\ **Last updated:** [January 21, 2020, 8:19am UTC](https://discuss.elastic.co/t/update-using-elasticsearch-restlevel-client-7-5-1-is-failing-on-elasticsearch-6-8-aws-cluster/214231 "2020-01-21T08:19:54Z")
Hi Team, We do own 2 AWS Elasticsearch clusters, out of which one got upgraded to 7.1 version while the latter is still on 6.8 version. We did scala code changes to accommodate this upgradation(as our existing jobs wer… --- ## [Security is enabled by default when debug](https://discuss.elastic.co/t/security-is-enabled-by-default-when-debug/215811)
**Author:** [@Yanchun](https://discuss.elastic.co/u/Yanchun)\ **Replies:** 1\ **Last updated:** [January 21, 2020, 6:53am UTC](https://discuss.elastic.co/t/security-is-enabled-by-default-when-debug/215811 "2020-01-21T06:53:50Z")
Hi, I compiled es 6.8.5 from source code with the command ./gradlew run --debug-jvm , and I want to debug with IDEA, but the xpack.security.enabled is default true, it's so inconvenient for debug. I ever compiled 6.4, … --- ## [How to take indexes backup node wise in cluster](https://discuss.elastic.co/t/how-to-take-indexes-backup-node-wise-in-cluster/215742)
**Author:** [@vishnuvardhan](https://discuss.elastic.co/u/vishnuvardhan)\ **Replies:** 10\ **Last updated:** [January 21, 2020, 6:39am UTC](https://discuss.elastic.co/t/how-to-take-indexes-backup-node-wise-in-cluster/215742 "2020-01-21T06:39:36Z")
We need to take indexes backup node wise or there would be cluster . how to take the backup please help me . --- ## [Wildcard in the field name in suggest pharse query](https://discuss.elastic.co/t/wildcard-in-the-field-name-in-suggest-pharse-query/215824)
**Author:** [@avinash\_kumawat](https://discuss.elastic.co/u/avinash_kumawat)\ **Replies:** 0\ **Last updated:** [January 21, 2020, 6:31am UTC](https://discuss.elastic.co/t/wildcard-in-the-field-name-in-suggest-pharse-query/215824 "2020-01-21T06:31:41Z")
Hello All, I am trying to implement did you mean functionality using elasticsearch, I wanted to search the text in all the fields using wildcard without knowing the field name. Is there any way to do that I know query s… --- ## [Index only collecting upto 215Kb data, then stops](https://discuss.elastic.co/t/index-only-collecting-upto-215kb-data-then-stops/215547)
**Author:** [@Mehak\_Bhargava](https://discuss.elastic.co/u/Mehak_Bhargava)\ **Replies:** 3\ **Last updated:** [January 21, 2020, 5:26am UTC](https://discuss.elastic.co/t/index-only-collecting-upto-215kb-data-then-stops/215547 "2020-01-21T05:26:20Z")
I have multiple indexes creating which gathers logs from different files. After collecting 215 Kb and 149kb worth of data, the index stops collecting more logs. Why is that? will it stop collecting when I have real time … --- ## [Getting throttled by \_msearch](https://discuss.elastic.co/t/getting-throttled-by-msearch/215752)
**Author:** [@doron](https://discuss.elastic.co/u/doron)\ **Replies:** 2\ **Last updated:** [January 21, 2020, 5:17am UTC](https://discuss.elastic.co/t/getting-throttled-by-msearch/215752 "2020-01-21T05:17:17Z")
My scenario is as follows: I want to run a very large number of queries and I want to fully utilize my cluster (40 data nodes X 16 CPUs). I am batching my queries (400 per batch) and sending them via \_msearch, however i… --- ## [How to run multiple esrally instances from same server](https://discuss.elastic.co/t/how-to-run-multiple-esrally-instances-from-same-server/215818)
**Author:** [@suvarna](https://discuss.elastic.co/u/suvarna)\ **Replies:** 0\ **Last updated:** [January 21, 2020, 4:43am UTC](https://discuss.elastic.co/t/how-to-run-multiple-esrally-instances-from-same-server/215818 "2020-01-21T04:43:09Z")
Hi currently we are not able to run two esrally instances from same system .. can you please let me know there its feasible or not ? If its feasible please let know about the configuration . I am using eventdata track… --- ## [Elasticsearch 6.8 does not support searches against \_all field still present in ES 5.6 created index](https://discuss.elastic.co/t/elasticsearch-6-8-does-not-support-searches-against-all-field-still-present-in-es-5-6-created-index/215806)
**Author:** [@blindwitness](https://discuss.elastic.co/u/blindwitness)\ **Replies:** 0\ **Last updated:** [January 20, 2020, 11:31pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-does-not-support-searches-against-all-field-still-present-in-es-5-6-created-index/215806 "2020-01-20T23:31:46Z")
Hello, In production, we use Elasticsearch to index our data for search related purposes. To interact with our current ES 5.6 cluster, we use the Java transport client. We are in the process of preparing for an upgrade … --- ## [Suggesters Sort for Weight?](https://discuss.elastic.co/t/suggesters-sort-for-weight/215798)
**Author:** [@EliuFlorez](https://discuss.elastic.co/u/EliuFlorez)\ **Replies:** 0\ **Last updated:** [January 20, 2020, 9:31pm UTC](https://discuss.elastic.co/t/suggesters-sort-for-weight/215798 "2020-01-20T21:31:46Z")
Hi guys, can a query bring the result of my suggestion by weight? that is to say to weight I want to place the total of listings existing then suggesters would be ordered from the weight it contains? Ready PUT test { … --- ## [How to index Dropbox documents?](https://discuss.elastic.co/t/how-to-index-dropbox-documents/215791)
**Author:** [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\ **Replies:** 3\ **Last updated:** [January 20, 2020, 9:31pm UTC](https://discuss.elastic.co/t/how-to-index-dropbox-documents/215791 "2020-01-20T21:31:23Z")
Hi, I have been using FScrawler to index files from directories. But I have files (around 2GB) in Dropbox which I want to index and use them with elastic search. Is there anyway to use FScrawler for Dropbox? I saw the… --- ## [ELK application running on my VM. Can I send a link to someone outside my network to access the localhost:5601 webpage?](https://discuss.elastic.co/t/elk-application-running-on-my-vm-can-i-send-a-link-to-someone-outside-my-network-to-access-the-localhost-5601-webpage/214681)
**Author:** [@Mehak\_Bhargava](https://discuss.elastic.co/u/Mehak_Bhargava)\ **Replies:** 19\ **Last updated:** [January 20, 2020, 6:24pm UTC](https://discuss.elastic.co/t/elk-application-running-on-my-vm-can-i-send-a-link-to-someone-outside-my-network-to-access-the-localhost-5601-webpage/214681 "2020-01-20T18:24:53Z")
I have ES, Logstasha nd Kibana running on my Virtual machine. I want to send a link accessible by someone outside my network to see the discover tab in Kibana I have running on localhost:5601. is it possible and how? In… --- ## [Which nodes to install plugin](https://discuss.elastic.co/t/which-nodes-to-install-plugin/215783)
**Author:** [@jdcohen220](https://discuss.elastic.co/u/jdcohen220)\ **Replies:** 0\ **Last updated:** [January 20, 2020, 5:42pm UTC](https://discuss.elastic.co/t/which-nodes-to-install-plugin/215783 "2020-01-20T17:42:42Z")
Do plugins need to be installed on all nodes, or only data nodes? --- ## [Query\_shard\_exception failed to execute query on datetime field](https://discuss.elastic.co/t/query-shard-exception-failed-to-execute-query-on-datetime-field/215355)
**Author:** [@Giovanni\_Gasola](https://discuss.elastic.co/u/Giovanni_Gasola)\ **Replies:** 1\ **Last updated:** [January 20, 2020, 5:04pm UTC](https://discuss.elastic.co/t/query-shard-exception-failed-to-execute-query-on-datetime-field/215355 "2020-01-20T17:04:38Z")
Hi guys, I have this node: { "\_index" : "impasti", "\_type" : "impasti", "\_id" : "2019-01-02T15:25:20", "\_score" : 1.9806902, "\_source" : { "sensor" : "Temperature", "mac\_address" : "", "time" : "2019-01-02T14:25:… --- ## [Need optimization suggestions](https://discuss.elastic.co/t/need-optimization-suggestions/215681)
**Author:** [@Abhishek\_Tiwari](https://discuss.elastic.co/u/Abhishek_Tiwari)\ **Replies:** 1\ **Last updated:** [January 20, 2020, 4:57pm UTC](https://discuss.elastic.co/t/need-optimization-suggestions/215681 "2020-01-20T16:57:21Z")
Hi, My cluster shows us randome behaviour and load varies randomly with normal traffic Please suggest how should i debug it . Regards, Abhishek Tiwari --- ## [Update mappings takes 30 hours for 9M documents](https://discuss.elastic.co/t/update-mappings-takes-30-hours-for-9m-documents/215694)
**Author:** [@orenco](https://discuss.elastic.co/u/orenco)\ **Replies:** 1\ **Last updated:** [January 20, 2020, 4:50pm UTC](https://discuss.elastic.co/t/update-mappings-takes-30-hours-for-9m-documents/215694 "2020-01-20T16:50:31Z")
I'm using Elastic 2.4 . I'm trying to update mappings, but it takes 30 hours for Elastic with 9M documents. I'm running on a machine with 360 GB RAM, and Elastic is running with 30 GB. Is there a quick option to run … --- ## [Index per organization or one index for all organizations to scale](https://discuss.elastic.co/t/index-per-organization-or-one-index-for-all-organizations-to-scale/215302)
**Author:** [@agonzalez](https://discuss.elastic.co/u/agonzalez)\ **Replies:** 2\ **Last updated:** [January 20, 2020, 4:43pm UTC](https://discuss.elastic.co/t/index-per-organization-or-one-index-for-all-organizations-to-scale/215302 "2020-01-20T16:43:11Z")
I have one multitenant application that is storing lof of data like events in elasticsearch, each organization will search events only from their organization. My question is about query/search perfomance and speed to s… --- ## [statusCode:429 - High fielddata memory usage](https://discuss.elastic.co/t/statuscode-429-high-fielddata-memory-usage/215774)
**Author:** [@Djaswan](https://discuss.elastic.co/u/Djaswan)\ **Replies:** 2\ **Last updated:** [January 20, 2020, 4:35pm UTC](https://discuss.elastic.co/t/statuscode-429-high-fielddata-memory-usage/215774 "2020-01-20T16:35:59Z")
Hi, We experienced some strange behavior from Kibana, while opening Kibana we got the following error: Error: {"statusCode":429,"error":"Too Many Requests","message":"\[circuit\_breaking\_exception\] \[parent\] Data… --- ## [Analyzer in ingest node](https://discuss.elastic.co/t/analyzer-in-ingest-node/214619)
**Author:** [@rvanegmond](https://discuss.elastic.co/u/rvanegmond)\ **Replies:** 3\ **Last updated:** [January 20, 2020, 4:10pm UTC](https://discuss.elastic.co/t/analyzer-in-ingest-node/214619 "2020-01-20T16:10:46Z")
I'm looking for a way to use the (for example path\_hierarchy) tokenizer(s) in a ingest pipeline. Is there anyway of doing this? --- ## [\[ElasticSearch 7.5\] Cluster is failed to setup](https://discuss.elastic.co/t/elasticsearch-7-5-cluster-is-failed-to-setup/215243)
**Author:** [@longfei.li](https://discuss.elastic.co/u/longfei.li)\ **Replies:** 1\ **Last updated:** [January 20, 2020, 4:09pm UTC](https://discuss.elastic.co/t/elasticsearch-7-5-cluster-is-failed-to-setup/215243 "2020-01-20T16:09:43Z")
I am failed to create a cluster with two nodes. It seems the nodes can't see each other. But, when I debug and grep the transport port with 9300, it seems they can see each other. ~# netstat -anutp|grep 9300 tcp6 … --- ## [Date formatting for import](https://discuss.elastic.co/t/date-formatting-for-import/215063)
**Author:** [@dedicatedmanagers](https://discuss.elastic.co/u/dedicatedmanagers)\ **Replies:** 3\ **Last updated:** [January 20, 2020, 4:02pm UTC](https://discuss.elastic.co/t/date-formatting-for-import/215063 "2020-01-20T16:02:55Z")
I have a date field that is in the following format: 01-JAN-20 When I map the field to dd-MMM-yy it won't accept the date above but it will accept the following: 01-Jan-20 Is there a way to get Elasticsearch to accep… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1039) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1041)