# \#none **URL:** https://discuss.elastic.co/tag/none.md?no_tags=true&page=1390 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1391 --- ## [How can I avoid indexing duplicate data into Elasticsearch, how define my keys?](https://discuss.elastic.co/t/how-can-i-avoid-indexing-duplicate-data-into-elasticsearch-how-define-my-keys/236976)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 1\ **Last updated:** [June 13, 2020, 11:12am UTC](https://discuss.elastic.co/t/how-can-i-avoid-indexing-duplicate-data-into-elasticsearch-how-define-my-keys/236976 "2020-06-13T11:12:37Z")
Hi, I am using only one index with one default document type and I have the same 4 keys for each record in my index. when I am indexing records that are already exists in my elastic db, duplicate data is created becau… --- ## [Logstash cannot get filebeat's data](https://discuss.elastic.co/t/logstash-cannot-get-filebeats-data/236955)
**Author:** [@azteker](https://discuss.elastic.co/u/azteker)\ **Replies:** 3\ **Last updated:** [June 13, 2020, 10:23am UTC](https://discuss.elastic.co/t/logstash-cannot-get-filebeats-data/236955 "2020-06-13T10:23:48Z")
This is my /etc/filebeat/filebeat.yml filebeat.inputs: - type: log enabled: true paths: - /var2/log/cloud/test.log filebeat.config.modules: # Glob pattern for configuration loading … --- ## [SearchSourceBuilder not functional on Android (Bug)](https://discuss.elastic.co/t/searchsourcebuilder-not-functional-on-android-bug/236946)
**Author:** [@jhud](https://discuss.elastic.co/u/jhud)\ **Replies:** 3\ **Last updated:** [June 13, 2020, 9:54am UTC](https://discuss.elastic.co/t/searchsourcebuilder-not-functional-on-android-bug/236946 "2020-06-13T09:54:05Z")
Our team is trying to use the Elasticsearch Java High Level REST Client 7.7.1 on an Android device. So far we've only been indexing data, not querying, and that code has been functional. But when trying to simply instant… --- ## [Sorting on numeric columns in Discover 7.7.0 not working as expected](https://discuss.elastic.co/t/sorting-on-numeric-columns-in-discover-7-7-0-not-working-as-expected/234693)
**Author:** [@jsteenkamp](https://discuss.elastic.co/u/jsteenkamp)\ **Replies:** 5\ **Last updated:** [June 13, 2020, 8:25am UTC](https://discuss.elastic.co/t/sorting-on-numeric-columns-in-discover-7-7-0-not-working-as-expected/234693 "2020-06-13T08:25:49Z")
msg.time field has the default format in the Kibana index on MacOS 10.15.5 on latest version of Firefox, Brave and Safari browsers unsorted time ascending time descending --- ## [Too many File Descriptors open](https://discuss.elastic.co/t/too-many-file-descriptors-open/236820)
**Author:** [@Goutham\_Pratapa](https://discuss.elastic.co/u/Goutham_Pratapa)\ **Replies:** 5\ **Last updated:** [June 13, 2020, 8:15am UTC](https://discuss.elastic.co/t/too-many-file-descriptors-open/236820 "2020-06-13T08:15:56Z")
Hi all, In our Dev-environment (ES single node setup) we have seen that the open file descriptors for elastic search are 27491596. (base) root@root:~$ lsof | awk '{print $2}'| uniq -c | sort -rn | head The output… --- ## [What is the best english stemmer for elasticsearch](https://discuss.elastic.co/t/what-is-the-best-english-stemmer-for-elasticsearch/236965)
**Author:** [@WAFA\_Mardiney](https://discuss.elastic.co/u/WAFA_Mardiney)\ **Replies:** 0\ **Last updated:** [June 13, 2020, 7:41am UTC](https://discuss.elastic.co/t/what-is-the-best-english-stemmer-for-elasticsearch/236965 "2020-06-13T07:41:39Z")
I've been looking through each stemmer is provided by elasticsearch but none of them is giving me the result I want, what I'm really interested is the word 'Recovery' I want it to be 'Recover' or 'Recov' ,the user will e… --- ## [Sending Alerts to different slack Webhook](https://discuss.elastic.co/t/sending-alerts-to-different-slack-webhook/236963)
**Author:** [@hadi\_farzipour](https://discuss.elastic.co/u/hadi_farzipour)\ **Replies:** 0\ **Last updated:** [June 13, 2020, 6:28am UTC](https://discuss.elastic.co/t/sending-alerts-to-different-slack-webhook/236963 "2020-06-13T06:28:35Z")
Hello everybody I have an ELK server that gets information from so many beats like Filebeat, Metricbeat, and ... , also I am using Slack webhook to send my alerts by Elastalert, However, I have a problem sending differ… --- ## [Logstash installation problems Ubuntu 20.04 VM](https://discuss.elastic.co/t/logstash-installation-problems-ubuntu-20-04-vm/235231)
**Author:** [@E\_Anon](https://discuss.elastic.co/u/E_Anon)\ **Replies:** 12\ **Last updated:** [June 13, 2020, 4:09am UTC](https://discuss.elastic.co/t/logstash-installation-problems-ubuntu-20-04-vm/235231 "2020-06-13T04:09:37Z")
Could someone please walk me through the correct Logstash installation procedure for Ubuntu 20.04? Starting with correct JDK installation as required by Logstash installation. Elasticsearch and Kibana install just fine… --- ## [Convert Number into Time (HH:MM:SS)](https://discuss.elastic.co/t/convert-number-into-time-hhss/235494)
**Author:** [@Thibaut\_M](https://discuss.elastic.co/u/Thibaut_M)\ **Replies:** 3\ **Last updated:** [June 13, 2020, 2:46am UTC](https://discuss.elastic.co/t/convert-number-into-time-hhss/235494 "2020-06-13T02:46:35Z")
Hello, I'm refering to my previous post : https://discuss.elastic.co/t/convert-number-elapsed-time-into-time-hhss/218551/3 I have some issue that i don't understand with the scripted field from angelo response. This ti… --- ## [From wich node the Watcher alerts are send? from elastic or kibana?](https://discuss.elastic.co/t/from-wich-node-the-watcher-alerts-are-send-from-elastic-or-kibana/236921)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 1\ **Last updated:** [June 13, 2020, 2:10am UTC](https://discuss.elastic.co/t/from-wich-node-the-watcher-alerts-are-send-from-elastic-or-kibana/236921 "2020-06-13T02:10:24Z")
HI, From wich node the Watcher alerts are send? I have to ask for internet access to send alerts to MS Teams , but Im not sure from where they are sended --- ## [How many client nodes should be in an es cluster?](https://discuss.elastic.co/t/how-many-client-nodes-should-be-in-an-es-cluster/236872)
**Author:** [@Bowen\_Liu](https://discuss.elastic.co/u/Bowen_Liu)\ **Replies:** 2\ **Last updated:** [June 13, 2020, 2:05am UTC](https://discuss.elastic.co/t/how-many-client-nodes-should-be-in-an-es-cluster/236872 "2020-06-13T02:05:31Z")
Hey, guys, we have some concerns about how many client nodes should be in a es cluster. Now we have a es cluster with total 36 nodes: 3 master nodes, 5 client nodes and 28 datanodes. We have approximate 10TB, which abou… --- ## [How to set geo\_point type from csv files using logstash?](https://discuss.elastic.co/t/how-to-set-geo-point-type-from-csv-files-using-logstash/236182)
**Author:** [@Jun.8](https://discuss.elastic.co/u/Jun.8)\ **Replies:** 7\ **Last updated:** [June 13, 2020, 1:59am UTC](https://discuss.elastic.co/t/how-to-set-geo-point-type-from-csv-files-using-logstash/236182 "2020-06-13T01:59:55Z")
Hi, I'm trying to set geo\_point type from csv files which have latitude and longitude using logstash. But I really don't know how to convert latitude and longitude to location(geo\_point type). I'm using logstash for this… --- ## [Conditional index in output](https://discuss.elastic.co/t/conditional-index-in-output/236951)
**Author:** [@JustDave](https://discuss.elastic.co/u/JustDave)\ **Replies:** 0\ **Last updated:** [June 13, 2020, 1:10am UTC](https://discuss.elastic.co/t/conditional-index-in-output/236951 "2020-06-13T01:10:19Z")
I was doing research and some testing in my environment. I am using Filebeat to read 2 kinds of logs, that go into 2 different index patterns. I looked up conditionals in output, and found some articles, but one had a so… --- ## [Enabling the sFlow Codec in Logstash Container?](https://discuss.elastic.co/t/enabling-the-sflow-codec-in-logstash-container/236948)
**Author:** [@redapplesonly](https://discuss.elastic.co/u/redapplesonly)\ **Replies:** 0\ **Last updated:** [June 12, 2020, 9:46pm UTC](https://discuss.elastic.co/t/enabling-the-sflow-codec-in-logstash-container/236948 "2020-06-12T21:46:24Z")
Hi Logstash Jedi Masters, I recently saw an instance of Logstash 7.7.1 that was accepting sFlow traffic as input. My colleague said he was able to set it up with no problem at all. I would like to do this, but in a Lo… --- ## [Need own unqiue ID with Bulk insert](https://discuss.elastic.co/t/need-own-unqiue-id-with-bulk-insert/235599)
**Author:** [@elasticitm](https://discuss.elastic.co/u/elasticitm)\ **Replies:** 11\ **Last updated:** [June 12, 2020, 9:35pm UTC](https://discuss.elastic.co/t/need-own-unqiue-id-with-bulk-insert/235599 "2020-06-12T21:35:52Z")
Hallo @all, I've switched from a older elasticsearch version to the current 7.7 and now getting troubles using unique id's. In the newer elasticsearch version the "\_id" is set automatically to a short one and this brea… --- ## [Visualize in one graph all cluster's indices](https://discuss.elastic.co/t/visualize-in-one-graph-all-clusters-indices/236939)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 2\ **Last updated:** [June 12, 2020, 9:04pm UTC](https://discuss.elastic.co/t/visualize-in-one-graph-all-clusters-indices/236939 "2020-06-12T21:04:33Z")
for better search performance I decided to divide my information between multiple indices because that it is a naturally easy way to filter down data when I am searching. my indexes are based on dates. all indices ha… --- ## [Alerts in ELK](https://discuss.elastic.co/t/alerts-in-elk/236763)
**Author:** [@ManuelF](https://discuss.elastic.co/u/ManuelF)\ **Replies:** 6\ **Last updated:** [June 12, 2020, 7:57pm UTC](https://discuss.elastic.co/t/alerts-in-elk/236763 "2020-06-12T19:57:02Z")
Hi, I would like to know if after the X-Pack release and some of its basic features are now included in the basic license: It is possible to enable/use alerts in Kibana or I still need a paid license? Is there any oth… --- ## [Testing different circuitbreakers](https://discuss.elastic.co/t/testing-different-circuitbreakers/236934)
**Author:** [@dinesh\_gnanasamy](https://discuss.elastic.co/u/dinesh_gnanasamy)\ **Replies:** 0\ **Last updated:** [June 12, 2020, 6:57pm UTC](https://discuss.elastic.co/t/testing-different-circuitbreakers/236934 "2020-06-12T18:57:02Z")
I am trying to test various circuitbreakers to gain better understanding for tuning various breaker limits .. for example, for tuning indices.breaker.request.limit on a cluster with 50% indexing and 50% querying load cha… --- ## [After upgrading to 7.7.0, dashboard loads with "esaggs" errors and "Running beyond timeout" warning](https://discuss.elastic.co/t/after-upgrading-to-7-7-0-dashboard-loads-with-esaggs-errors-and-running-beyond-timeout-warning/236922)
**Author:** [@qualispec](https://discuss.elastic.co/u/qualispec)\ **Replies:** 1\ **Last updated:** [June 12, 2020, 5:01pm UTC](https://discuss.elastic.co/t/after-upgrading-to-7-7-0-dashboard-loads-with-esaggs-errors-and-running-beyond-timeout-warning/236922 "2020-06-12T17:01:15Z")
How can I configure the timeout setting? I'd like to increase it. --- ## [Mask sensitive PII data inside Kibana UI](https://discuss.elastic.co/t/mask-sensitive-pii-data-inside-kibana-ui/236920)
**Author:** [@uraf78](https://discuss.elastic.co/u/uraf78)\ **Replies:** 1\ **Last updated:** [June 12, 2020, 4:54pm UTC](https://discuss.elastic.co/t/mask-sensitive-pii-data-inside-kibana-ui/236920 "2020-06-12T16:54:07Z")
I need to mask sensitive PII fields (email, user name, ip ...) inside Kibana This sensitive PII data should be stored without any manipulation in Elasticsearch but should be masked on Kibana UI I already uses similar f… --- ## [Kibana - Log - kibana-monitoring](https://discuss.elastic.co/t/kibana-log-kibana-monitoring/235818)
**Author:** [@jgonzalez](https://discuss.elastic.co/u/jgonzalez)\ **Replies:** 1\ **Last updated:** [June 12, 2020, 4:13pm UTC](https://discuss.elastic.co/t/kibana-log-kibana-monitoring/235818 "2020-06-12T16:13:17Z")
Hello all, i just started up my cluster for the first time, it is composed of 2 data nodes and 1 master node, then i started up kibana, but i am having these warnings: log \[16:40:30.928\] \[warning\]\[kibana-monitorin… --- ## [How to parse XML using XPATH from SOAP](https://discuss.elastic.co/t/how-to-parse-xml-using-xpath-from-soap/236597)
**Author:** [@vince.mar04](https://discuss.elastic.co/u/vince.mar04)\ **Replies:** 4\ **Last updated:** [June 12, 2020, 4:02pm UTC](https://discuss.elastic.co/t/how-to-parse-xml-using-xpath-from-soap/236597 "2020-06-12T16:02:30Z")
Continuing the discussion from How to parse XML using XPATH from SOAP API in Logstash: in this part we mentioned this question, it was solved with /soapenv:Envelope/soapenv:Body/multiRef/metricValue/text() but in my ca… --- ## [Adding Host fields to configuration](https://discuss.elastic.co/t/adding-host-fields-to-configuration/235510)
**Author:** [@nick1](https://discuss.elastic.co/u/nick1)\ **Replies:** 5\ **Last updated:** [June 12, 2020, 3:17pm UTC](https://discuss.elastic.co/t/adding-host-fields-to-configuration/235510 "2020-06-12T15:17:41Z")
Hi, I'm trying to configure filebeat, winlogbeat and metricbeat to send details on their host type (OS type mainly) so I can use this field in Graylog to filter. Host doesn't seem to be a module and the fields document… --- ## [Import dashboard in kibana from 7.5.0 version to 7.4.0](https://discuss.elastic.co/t/import-dashboard-in-kibana-from-7-5-0-version-to-7-4-0/236914)
**Author:** [@haythem](https://discuss.elastic.co/u/haythem)\ **Replies:** 2\ **Last updated:** [June 12, 2020, 3:10pm UTC](https://discuss.elastic.co/t/import-dashboard-in-kibana-from-7-5-0-version-to-7-4-0/236914 "2020-06-12T15:10:58Z")
Hi guys , i'm trying to import a dashboard from kibana 7.5.0 version to 7.4.0 ? is it impossible ? because the loading logo in kibana keeps on loading in kibana when i click import !! Kibana version 7.4.0 thanks in adv… --- ## [How to grok different format record lines in one single log file](https://discuss.elastic.co/t/how-to-grok-different-format-record-lines-in-one-single-log-file/236797)
**Author:** [@Eaven](https://discuss.elastic.co/u/Eaven)\ **Replies:** 4\ **Last updated:** [June 12, 2020, 3:02pm UTC](https://discuss.elastic.co/t/how-to-grok-different-format-record-lines-in-one-single-log-file/236797 "2020-06-12T15:02:29Z")
Dear Friend, I'm encountering an issue when configuring logstash, here is an example from my case that I need to grok filter to match - some lines are with IP fields and sesseionID fields but some are not (so they are n… --- ## [Restore rabbit message when elastic reject them](https://discuss.elastic.co/t/restore-rabbit-message-when-elastic-reject-them/236831)
**Author:** [@jamorales](https://discuss.elastic.co/u/jamorales)\ **Replies:** 1\ **Last updated:** [June 12, 2020, 2:53pm UTC](https://discuss.elastic.co/t/restore-rabbit-message-when-elastic-reject-them/236831 "2020-06-12T14:53:26Z")
Hello every one, i have the next scenario: In my logstash pipeline, in input I have configured the rabbitmq , so we take messages from Rabbitmq and then we send them to elasticsearch. But sometimes the message is reje… --- ## [Multiple logstash output configurations](https://discuss.elastic.co/t/multiple-logstash-output-configurations/236840)
**Author:** [@OatmealOgre](https://discuss.elastic.co/u/OatmealOgre)\ **Replies:** 1\ **Last updated:** [June 12, 2020, 2:46pm UTC](https://discuss.elastic.co/t/multiple-logstash-output-configurations/236840 "2020-06-12T14:46:33Z")
I've been trying to find information on this and started to wonder if it's even possible. Situation is as follows. We have several logstash pipeline configuration files. All of them have their output largely the same, … --- ## [Plugin cipher (Deterministic encryption + iv\_random\_length)](https://discuss.elastic.co/t/plugin-cipher-deterministic-encryption-iv-random-length/236856)
**Author:** [@Florent\_Fauvin](https://discuss.elastic.co/u/Florent_Fauvin)\ **Replies:** 2\ **Last updated:** [June 12, 2020, 2:33pm UTC](https://discuss.elastic.co/t/plugin-cipher-deterministic-encryption-iv-random-length/236856 "2020-06-12T14:33:58Z")
Hello, I would like to do "deterministic encryption" with the cipher plugin, which requires not to have a "random iv". Unfortunately, even if the official documentation says that the "iv\_random\_length" parameter is not… --- ## [Is there a node limit on the Basic licence? of 7.7](https://discuss.elastic.co/t/is-there-a-node-limit-on-the-basic-licence-of-7-7/236885)
**Author:** [@Anthony\_Whitehead](https://discuss.elastic.co/u/Anthony_Whitehead)\ **Replies:** 4\ **Last updated:** [June 12, 2020, 2:31pm UTC](https://discuss.elastic.co/t/is-there-a-node-limit-on-the-basic-licence-of-7-7/236885 "2020-06-12T14:31:28Z")
A colleague told me that when moving from Elastic 5.6 to 6.8 that the basic licence didn't work as we had more than 100 nodes (on premise). I don't have access to the actual message. Is this correct as I'm investigating… --- ## [Is it available logstash "environment" filter plugin in Windows?](https://discuss.elastic.co/t/is-it-available-logstash-environment-filter-plugin-in-windows/236897)
**Author:** [@eizquierdo](https://discuss.elastic.co/u/eizquierdo)\ **Replies:** 2\ **Last updated:** [June 12, 2020, 2:27pm UTC](https://discuss.elastic.co/t/is-it-available-logstash-environment-filter-plugin-in-windows/236897 "2020-06-12T14:27:10Z")
I have this simple configuration: input { stdin { } } filter { environment { add\_metadata\_from\_env =\> {"test" =\> "TEST\_ENV"} add\_field =\> \["my\_test", "%{\[@metadata\]\[test\]}"\] } } output { stdout { codec =\> ru… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1389) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1391)