# Latest **URL:** https://discuss.elastic.co/latest.md?page=1538 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1539 --- ## [Elastic rejected execution of coordinating operation](https://discuss.elastic.co/t/elastic-rejected-execution-of-coordinating-operation/280656)
**Author:** [@mug3n451](https://discuss.elastic.co/u/mug3n451)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 2:39pm UTC](https://discuss.elastic.co/t/elastic-rejected-execution-of-coordinating-operation/280656 "2021-08-06T14:39:29Z")
Hi, i have a problem with elasticsearch on kubernetes. here the problem: "current\_state" : "unassigned", "unassigned\_info" : { "reason" : "ALLOCATION\_FAILED", "at" : "2021-08-06T14:28:31.995Z", "failed\_al… --- ## [Questions Regarding Deleting Source Data After Transform](https://discuss.elastic.co/t/questions-regarding-deleting-source-data-after-transform/279353)
**Author:** [@Ashfur](https://discuss.elastic.co/u/Ashfur)\ **Replies:** 5\ **Last updated:** [August 6, 2021, 2:23pm UTC](https://discuss.elastic.co/t/questions-regarding-deleting-source-data-after-transform/279353 "2021-08-06T14:23:42Z")
From what I read from the other posts, if we are running a continuous transform, we should not delete any data from the source index as that will trigger the transform to re-compute and the deleted records will no longer… --- ## [Logstash cannot compile the .conf file](https://discuss.elastic.co/t/logstash-cannot-compile-the-conf-file/279735)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 7\ **Last updated:** [August 6, 2021, 2:21pm UTC](https://discuss.elastic.co/t/logstash-cannot-compile-the-conf-file/279735 "2021-08-06T14:21:52Z")
Hello, so I have this weird situation that all my logstash config files just stopped working. I have noticed it started probably like a few weeks ago after something happened. Only one thing I recognize I have done that… --- ## [Wazuh manager failed to start](https://discuss.elastic.co/t/wazuh-manager-failed-to-start/280626)
**Author:** [@Jedrick](https://discuss.elastic.co/u/Jedrick)\ **Replies:** 2\ **Last updated:** [August 6, 2021, 1:57pm UTC](https://discuss.elastic.co/t/wazuh-manager-failed-to-start/280626 "2021-08-06T13:57:26Z")
For your kind assistance regarding my kibana that is not working. I already tried to restart all services. kibana, filebeat, elasticsearch, wazuh-manager. There status are all ok and active running. But once a access … --- ## [Update by query for each field with value by sql query](https://discuss.elastic.co/t/update-by-query-for-each-field-with-value-by-sql-query/280192)
**Author:** [@Rammi22](https://discuss.elastic.co/u/Rammi22)\ **Replies:** 5\ **Last updated:** [August 6, 2021, 11:14am UTC](https://discuss.elastic.co/t/update-by-query-for-each-field-with-value-by-sql-query/280192 "2021-08-06T11:14:17Z")
Hello, following task: get each document one by one from elasticserach server add field to document with value stored in a database (MariaDB) The \_id of the document is the reference to its record in the database: I… --- ## [Index vs Update](https://discuss.elastic.co/t/index-vs-update/280637)
**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Replies:** 2\ **Last updated:** [August 6, 2021, 10:27am UTC](https://discuss.elastic.co/t/index-vs-update/280637 "2021-08-06T10:27:08Z")
Hello I'd like to ask the same question again raised here: What's the benefit of the Update API (POST /\_update) vs Index (PUT /\_doc). As far as I can see Update (with doc\_as\_upsert: true) is identical in effect to Inde… --- ## [Finding Duplicates from an index with nested field](https://discuss.elastic.co/t/finding-duplicates-from-an-index-with-nested-field/280634)
**Author:** [@fastkt](https://discuss.elastic.co/u/fastkt)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 9:37am UTC](https://discuss.elastic.co/t/finding-duplicates-from-an-index-with-nested-field/280634 "2021-08-06T09:37:33Z")
Hi I am fairly new to ES and need some help. I have an index { "shop\_index": { "properties": { "shop\_key": { "type": "nested", "properties": { "shop\_id": "keyword", "shop… --- ## [Unused visualizations](https://discuss.elastic.co/t/unused-visualizations/280624)
**Author:** [@artobstrel](https://discuss.elastic.co/u/artobstrel)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 8:37am UTC](https://discuss.elastic.co/t/unused-visualizations/280624 "2021-08-06T08:37:20Z")
I want to remove all visualizations that are not used on dashboards. How can I get a list of all such visualizations through api or in some other way? Example Used visualization has dashboard parent: Unused visual… --- ## [JDBC streaming plugin, variable statement](https://discuss.elastic.co/t/jdbc-streaming-plugin-variable-statement/280630)
**Author:** [@JFO\_90](https://discuss.elastic.co/u/JFO_90)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 9:06am UTC](https://discuss.elastic.co/t/jdbc-streaming-plugin-variable-statement/280630 "2021-08-06T09:06:18Z")
Hi, Im using elasticsearch input plugin to obtain info from elastic, with this extracted info i use the JDBC streaming plugin to get information from BD with some fields that i extracted from elastic. The problem that … --- ## [Kibana on Arch Linux: "NetworkError when attempting to fetch resource."](https://discuss.elastic.co/t/kibana-on-arch-linux-networkerror-when-attempting-to-fetch-resource/280413)
**Author:** [@brian.rene](https://discuss.elastic.co/u/brian.rene)\ **Replies:** 4\ **Last updated:** [August 6, 2021, 8:07am UTC](https://discuss.elastic.co/t/kibana-on-arch-linux-networkerror-when-attempting-to-fetch-resource/280413 "2021-08-06T08:07:26Z")
Hello everyone, I have been tasked with setting up a self-hosted instance of ELK in a KVM environment using Arch Linux. The root filesystem is write-protected (at runtime) and any directories or files that services need… --- ## [Kubernetes autodiscover with annotation not working](https://discuss.elastic.co/t/kubernetes-autodiscover-with-annotation-not-working/280621)
**Author:** [@edwardlol](https://discuss.elastic.co/u/edwardlol)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 8:00am UTC](https://discuss.elastic.co/t/kubernetes-autodiscover-with-annotation-not-working/280621 "2021-08-06T08:00:23Z")
I want to enable log collecting on specific pods (or namespace, but I'm trying to enable it on pods first). I disabled hints/default\_config filebeat.autodiscover: providers: - type: kubernetes node: ${NODE\_… --- ## [How to query for a documents based on the type of a field?](https://discuss.elastic.co/t/how-to-query-for-a-documents-based-on-the-type-of-a-field/280620)
**Author:** [@k1b](https://discuss.elastic.co/u/k1b)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 7:59am UTC](https://discuss.elastic.co/t/how-to-query-for-a-documents-based-on-the-type-of-a-field/280620 "2021-08-06T07:59:02Z")
I have a geoip.loc field, of type geo\_point. A few documents accidentally got added into the index with this field as (a pair of) float, which is now causing a mapping conflict. I'd like to query for these few document… --- ## [2 node elasticsearch cluster for production like environment](https://discuss.elastic.co/t/2-node-elasticsearch-cluster-for-production-like-environment/280595)
**Author:** [@cool999](https://discuss.elastic.co/u/cool999)\ **Replies:** 4\ **Last updated:** [August 6, 2021, 7:26am UTC](https://discuss.elastic.co/t/2-node-elasticsearch-cluster-for-production-like-environment/280595 "2021-08-06T07:26:18Z")
Hi Team, From below document, I am trying to find if I can use 2 node cluster for production like environment. I know 3 node cluster is always better choice. link above says, if you create 2 node es cluster, then mak… --- ## [Setting up 2-Node cluster on local network](https://discuss.elastic.co/t/setting-up-2-node-cluster-on-local-network/280608)
**Author:** [@nyinyithann](https://discuss.elastic.co/u/nyinyithann)\ **Replies:** 1\ **Last updated:** [August 6, 2021, 5:48am UTC](https://discuss.elastic.co/t/setting-up-2-node-cluster-on-local-network/280608 "2021-08-06T05:48:39Z")
Hi, I am trying to setup 2-node cluster on local network - one node on mac and the other on ubuntu. I am able to connect the node on mac from ubuntu and vice versa. But I see only one node in cluster at all time. I w… --- ## [Start a crawl for just 1 url (page) via API](https://discuss.elastic.co/t/start-a-crawl-for-just-1-url-page-via-api/280195)
**Author:** [@markn](https://discuss.elastic.co/u/markn)\ **Replies:** 2\ **Last updated:** [August 6, 2021, 5:40am UTC](https://discuss.elastic.co/t/start-a-crawl-for-just-1-url-page-via-api/280195 "2021-08-06T05:40:32Z")
Hi, the documentation describes you can start a webcrawler per search engine via the API. That is really cool because you can connect your CMS with the search engine. What our customer would really like is if they upda… --- ## [Kuromojiの区切り文字について](https://discuss.elastic.co/t/kuromoji/280179)
**Author:** [@ufuruya](https://discuss.elastic.co/u/ufuruya)\ **Replies:** 6\ **Last updated:** [August 6, 2021, 4:31am UTC](https://discuss.elastic.co/t/kuromoji/280179 "2021-08-06T04:31:59Z")
kuromoji\_tokenizer を利用して、形態素解析を行っています。 「山田 花子」で検索すると、「山田」・「花子」で検索してくれます。 「山田、花子」、「山田・花子」、「山田-花子」も同様です。 区切り文字は、スペースのみとし、他の記号はそのまま文字として扱いたいですが、可能でしょうか？ 「山田 花子」-\>「山田」・「花子」で検索 「山田、花子」-\>「山田、花子」で検索 「山田・花子」-\>「山田・花子」で検索 --- ## [Gap not refreshing on 7.14?](https://discuss.elastic.co/t/gap-not-refreshing-on-7-14/280610)
**Author:** [@hilt86](https://discuss.elastic.co/u/hilt86)\ **Replies:** 0\ **Last updated:** [August 6, 2021, 3:26am UTC](https://discuss.elastic.co/t/gap-not-refreshing-on-7-14/280610 "2021-08-06T03:26:35Z")
In the rule monitoring of detection rules the "Last Gap" field doesn't seem to update....I've duplicated a rule and the gap resets to zero : How is this value updating and is there a way I can reset it? Hilton --- ## [Logstash and mongodb using JDBC is not working](https://discuss.elastic.co/t/logstash-and-mongodb-using-jdbc-is-not-working/280487)
**Author:** [@TranQuangHa307](https://discuss.elastic.co/u/TranQuangHa307)\ **Replies:** 0\ **Last updated:** [August 5, 2021, 3:16am UTC](https://discuss.elastic.co/t/logstash-and-mongodb-using-jdbc-is-not-working/280487 "2021-08-05T03:16:27Z")
This is my configuration file gives output as \[2021-08-05T10:13:30,445\]\[ERROR\]\[logstash.inputs.jdbc \]\[main\]\[c5849bc82bc4f5a1e20e8bbd042d4783536556e6cc82bbb47534d1a4e0939319\] Unable to connect to database. Tried 1… --- ## [Elastic Agent Prometheus integration stopped working in 7.14](https://discuss.elastic.co/t/elastic-agent-prometheus-integration-stopped-working-in-7-14/280602)
**Author:** [@hilt86](https://discuss.elastic.co/u/hilt86)\ **Replies:** 1\ **Last updated:** [August 6, 2021, 12:33am UTC](https://discuss.elastic.co/t/elastic-agent-prometheus-integration-stopped-working-in-7-14/280602 "2021-08-06T00:33:24Z")
Since v 7.14 my prometheus integration seems to have stopped working. I'm using the api/v1/query endpoint of Prometheus and can poll it using curl but the integration seems to have stopped working... This is in the logs… --- ## [Сбор syslog с помощью ELK](https://discuss.elastic.co/t/syslog-elk/279993)
**Author:** [@Savai](https://discuss.elastic.co/u/Savai)\ **Replies:** 12\ **Last updated:** [August 5, 2021, 10:50pm UTC](https://discuss.elastic.co/t/syslog-elk/279993 "2021-08-05T22:50:27Z")
Здравствуйте. Не подскажете, в чем может быть проблема? Запускаю ELK стек через docker-compose и пытаюсь получить syslog через logstash, однако индекс в elastic не создается и при запуске logstash выдается предупреждени… --- ## [Adding fields to a filter context](https://discuss.elastic.co/t/adding-fields-to-a-filter-context/280356)
**Author:** [@jjammin92](https://discuss.elastic.co/u/jjammin92)\ **Replies:** 4\ **Last updated:** [August 5, 2021, 10:04pm UTC](https://discuss.elastic.co/t/adding-fields-to-a-filter-context/280356 "2021-08-05T22:04:29Z")
Hello, I'm working on a filter query to speed up some searches but I only want to return certain fields. I've been running into some issues adding the fields I want to display to my query. This is what I have working: … --- ## [What is the meaning of "hits.total" in an aggregate search query?](https://discuss.elastic.co/t/what-is-the-meaning-of-hits-total-in-an-aggregate-search-query/280600)
**Author:** [@chrisan](https://discuss.elastic.co/u/chrisan)\ **Replies:** 0\ **Last updated:** [August 5, 2021, 9:42pm UTC](https://discuss.elastic.co/t/what-is-the-meaning-of-hits-total-in-an-aggregate-search-query/280600 "2021-08-05T21:42:45Z")
I found this Is hits.total limited by max\_results\_window? - #3 which says hits shouldnt be limited However, I have the following query # POST /assets/\_search { "size": 0, "query": { "bool": { "must": \[ … --- ## [Daily index not created](https://discuss.elastic.co/t/daily-index-not-created/280315)
**Author:** [@cool999](https://discuss.elastic.co/u/cool999)\ **Replies:** 8\ **Last updated:** [August 5, 2021, 9:42pm UTC](https://discuss.elastic.co/t/daily-index-not-created/280315 "2021-08-05T21:42:31Z")
Hi Team, On my single test server with 8G of RAM (1955m to JVM) having es v 7.4, I have 12 application indices + few system indices like (.monitoring-es-7-2021.08.02, .monitoring-logstash-7-2021.08.02, .monitoring-kiba… --- ## [Installing a custom local plugin](https://discuss.elastic.co/t/installing-a-custom-local-plugin/280574)
**Author:** [@gusDuarte](https://discuss.elastic.co/u/gusDuarte)\ **Replies:** 2\ **Last updated:** [August 5, 2021, 8:43pm UTC](https://discuss.elastic.co/t/installing-a-custom-local-plugin/280574 "2021-08-05T20:43:27Z")
Hi all, I want to make a bit modification to http input plugin, so to start with this task, i following steps: Install logstash 7.14 downloading logstash-7.14.0-darwin-x86\_64.tar.gz, and test if installation is ok bi… --- ## [Module:kubernetes / metricset:event fails to gather FailedScheduling events](https://discuss.elastic.co/t/module-kubernetes-metricset-event-fails-to-gather-failedscheduling-events/280597)
**Author:** [@MnrGreg](https://discuss.elastic.co/u/MnrGreg)\ **Replies:** 0\ **Last updated:** [August 5, 2021, 8:37pm UTC](https://discuss.elastic.co/t/module-kubernetes-metricset-event-fails-to-gather-failedscheduling-events/280597 "2021-08-05T20:37:06Z")
When moving from kubernetes 1.19.1 to 1.20.5 metricset:event no longer gathers .reason:FailedScheduling events. Noticed the kubernetes event structure has changed. 1.19.1: { "apiVersion": "v1", … --- ## [Snapshot does not exist during migration](https://discuss.elastic.co/t/snapshot-does-not-exist-during-migration/280596)
**Author:** [@iceman](https://discuss.elastic.co/u/iceman)\ **Replies:** 0\ **Last updated:** [August 5, 2021, 8:19pm UTC](https://discuss.elastic.co/t/snapshot-does-not-exist-during-migration/280596 "2021-08-05T20:19:45Z")
hi all, I want to migrate all the data from one k8s cluster to another , ES ver 7.10.1. So first I created successful snapshot on the first cluster: \[elasticsearch@es backup\]$ curl -X PUT "localhost:9200/\_snapshot/bac… --- ## [Subtract @timestamp between two events in Visualize on kibana](https://discuss.elastic.co/t/subtract-timestamp-between-two-events-in-visualize-on-kibana/280479)
**Author:** [@Adixon\_Diaz](https://discuss.elastic.co/u/Adixon_Diaz)\ **Replies:** 3\ **Last updated:** [August 5, 2021, 7:44pm UTC](https://discuss.elastic.co/t/subtract-timestamp-between-two-events-in-visualize-on-kibana/280479 "2021-08-05T19:44:26Z")
Hi Elastic Team, I want to be able to subtract the field @timestamp for two events. For exmample, i recieve 1 event by second, so, i would like to subtract the last event to arrive against the penultimate event to arriv… --- ## [Elastic Stack 7.14.0 Security Update](https://discuss.elastic.co/t/elastic-stack-7-14-0-security-update/280344)
**Author:** [@douglasday](https://discuss.elastic.co/u/douglasday)\ **Replies:** 0\ **Last updated:** [August 3, 2021, 3:44pm UTC](https://discuss.elastic.co/t/elastic-stack-7-14-0-security-update/280344 "2021-08-03T15:44:59Z")
Elasticsearch Document/Field Level Security issue (ESA-2021-18) A flaw was discovered in Elasticsearch where document and field level security was not applied to searchable snapshots. This could lead to an authenticated… --- ## [Find Out empty field](https://discuss.elastic.co/t/find-out-empty-field/280576)
**Author:** [@YASH\_SHARMA7766](https://discuss.elastic.co/u/YASH_SHARMA7766)\ **Replies:** 2\ **Last updated:** [August 5, 2021, 7:09pm UTC](https://discuss.elastic.co/t/find-out-empty-field/280576 "2021-08-05T19:09:09Z")
I have a data set of 4-5 fields.I want to check if any data field is empty , Iogstash add a field name incomplete data and add value of field name in that.Sample data and code is attached below. As shown in image,ser… --- ## [Query latency increase when upgrading from 7.10.2](https://discuss.elastic.co/t/query-latency-increase-when-upgrading-from-7-10-2/280585)
**Author:** [@BS1](https://discuss.elastic.co/u/BS1)\ **Replies:** 0\ **Last updated:** [August 5, 2021, 7:02pm UTC](https://discuss.elastic.co/t/query-latency-increase-when-upgrading-from-7-10-2/280585 "2021-08-05T19:02:21Z")
We have been running Elasticsearch 7.10.2 for a while in a production setting now, serving thousands of requests per second across 10 separate clusters. Our clusters are all in AWS on ec2 hosts. A coupe of months back we… [Previous page](https://discuss.elastic.co/latest.md?page=1537) [Next page](https://discuss.elastic.co/latest.md?page=1539)