# \#none **URL:** https://discuss.elastic.co/tag/none.md?page=1949 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1950 --- ## [Duplicate records in indexes](https://discuss.elastic.co/t/duplicate-records-in-indexes/194443)
**Author:** [@SirJune](https://discuss.elastic.co/u/SirJune)\ **Replies:** 4\ **Last updated:** [August 20, 2019, 9:00pm UTC](https://discuss.elastic.co/t/duplicate-records-in-indexes/194443 "2019-08-20T21:00:06Z")
HI, I have logstash running connecting/reading records from MySQL DB. I have 7 records in a timeframe (say: 01:00:00 - 01:01:00) I have this config file: tracking\_column =\> "datetime" use\_column\_value =\>true stateme… --- ## [Visualization for top 90% average](https://discuss.elastic.co/t/visualization-for-top-90-average/195823)
**Author:** [@Alan\_Home](https://discuss.elastic.co/u/Alan_Home)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 8:55pm UTC](https://discuss.elastic.co/t/visualization-for-top-90-average/195823 "2019-08-20T20:55:20Z")
In SumoLogic we created a visualization that took an average of all the execution times and filtered out the top 10%, so you could see a truer average of processtime rather than a couple of outliers creating spikes. The… --- ## [Performance considerations for indexed nested fields](https://discuss.elastic.co/t/performance-considerations-for-indexed-nested-fields/195792)
**Author:** [@Ben\_Wilde](https://discuss.elastic.co/u/Ben_Wilde)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 8:43pm UTC](https://discuss.elastic.co/t/performance-considerations-for-indexed-nested-fields/195792 "2019-08-20T20:43:52Z")
We are reaching a point where we will end up having a dozen or so indexed nested fields on each of our documents (which as we know creates an additional indexed document for each nested entry). We're looking to understa… --- ## [Process - Reshape a CSV file using logstash](https://discuss.elastic.co/t/process-reshape-a-csv-file-using-logstash/195270)
**Author:** [@baselai](https://discuss.elastic.co/u/baselai)\ **Replies:** 29\ **Last updated:** [August 20, 2019, 8:42pm UTC](https://discuss.elastic.co/t/process-reshape-a-csv-file-using-logstash/195270 "2019-08-20T20:42:42Z")
Is there a way where I can process any csv file dynamically detect the data\_type for the columns, either float or string. as an example, I have this csv file table and I need to dynamically turn it into this schema a… --- ## [Role Vs User for Query](https://discuss.elastic.co/t/role-vs-user-for-query/195998)
**Author:** [@shri\_palchuri](https://discuss.elastic.co/u/shri_palchuri)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 8:28pm UTC](https://discuss.elastic.co/t/role-vs-user-for-query/195998 "2019-08-20T20:28:37Z")
Can I specify Run as Role as part of elasticsearch query instead of creating too many uses? If yes, please redirect me to the documentation. --- ## [Input file reads only newly added files](https://discuss.elastic.co/t/input-file-reads-only-newly-added-files/195956)
**Author:** [@baselai](https://discuss.elastic.co/u/baselai)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 8:18pm UTC](https://discuss.elastic.co/t/input-file-reads-only-newly-added-files/195956 "2019-08-20T20:18:43Z")
I have a service that outputs two files into a file system, csv and manifest files, both have same file name but different extension. I need to build a logstash config file that does the following: Once the files are … --- ## [Spaces](https://discuss.elastic.co/t/spaces/195811)
**Author:** [@ajhstn](https://discuss.elastic.co/u/ajhstn)\ **Replies:** 3\ **Last updated:** [August 20, 2019, 8:16pm UTC](https://discuss.elastic.co/t/spaces/195811 "2019-08-20T20:16:24Z")
Hey Lasties, I have a handful of teams sharing winlogbeat and metricbeat indices, and i have set them each up with a space. They are in different spaces because they will have different indices and visuals setup, howev… --- ## [Performance and curiosity question on combined filter queries + nested queries](https://discuss.elastic.co/t/performance-and-curiosity-question-on-combined-filter-queries-nested-queries/195990)
**Author:** [@ljak](https://discuss.elastic.co/u/ljak)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 7:39pm UTC](https://discuss.elastic.co/t/performance-and-curiosity-question-on-combined-filter-queries-nested-queries/195990 "2019-08-20T19:39:11Z")
Hello everyone, More a curiosity question than everything else, is there any difference between: GET /my\_index/\_search { "profile": "true", "query": { "nested": { "path": "projects", "query": { … --- ## [Unable to extract the message filed from the logstash filter](https://discuss.elastic.co/t/unable-to-extract-the-message-filed-from-the-logstash-filter/195807)
**Author:** [@Arun\_Soman](https://discuss.elastic.co/u/Arun_Soman)\ **Replies:** 6\ **Last updated:** [August 20, 2019, 7:02pm UTC](https://discuss.elastic.co/t/unable-to-extract-the-message-filed-from-the-logstash-filter/195807 "2019-08-20T19:02:54Z")
I am trying to split my message into different fields . I used Grok filer on logstash but I am still getting the same message content in the Kibana discover dash board. My message as follows. 2019-8-16T18:37:16.45 CT3 … --- ## [Elasticsearch logs showing delete index?](https://discuss.elastic.co/t/elasticsearch-logs-showing-delete-index/195981)
**Author:** [@w0lfxpunk](https://discuss.elastic.co/u/w0lfxpunk)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 5:50pm UTC](https://discuss.elastic.co/t/elasticsearch-logs-showing-delete-index/195981 "2019-08-20T17:50:23Z")
Hi , We have integrated elasticsearch with Magento2 using smile/elasticsuite. When I check logs of elasticsearch in every few minutes it shows me logs like below \[2019-08-20T17:47:22,008\]\[INFO \]\[o.e.c.m.MetaDataDelet… --- ## [Heartbeat with protected API's](https://discuss.elastic.co/t/heartbeat-with-protected-apis/195977)
**Author:** [@Johnnie843](https://discuss.elastic.co/u/Johnnie843)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 5:01pm UTC](https://discuss.elastic.co/t/heartbeat-with-protected-apis/195977 "2019-08-20T17:01:15Z")
Hello Everyone, We have an application deployed with a bunch of API's exposed. They are protected via Keycloak(OAuth2). Is there a way to authenticate to test the Uptime of the API Url? If not I will always get the for… --- ## [Hard code Time lion graphs line so not affected by time picker on dashboard](https://discuss.elastic.co/t/hard-code-time-lion-graphs-line-so-not-affected-by-time-picker-on-dashboard/195886)
**Author:** [@ek9boy](https://discuss.elastic.co/u/ek9boy)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 4:28pm UTC](https://discuss.elastic.co/t/hard-code-time-lion-graphs-line-so-not-affected-by-time-picker-on-dashboard/195886 "2019-08-20T16:28:13Z")
So I would like to Hard code the Time lion graphs line so it is not affected by time picker when used on a dashboard is this possiable --- ## [\[Kibana 7.3\]Install Radar Map Plugin](https://discuss.elastic.co/t/kibana-7-3-install-radar-map-plugin/195847)
**Author:** [@Scorpion21](https://discuss.elastic.co/u/Scorpion21)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 4:21pm UTC](https://discuss.elastic.co/t/kibana-7-3-install-radar-map-plugin/195847 "2019-08-20T16:21:52Z")
Hi guys, I would like to draw some radar maps in Kibana. Unfortunately, after trying all installation steps shown in this repository, I am still not able to get the kbn\_radar work in either Windows or Ubuntu. Some … --- ## [Tuning logstash and elasticsearch for loading data from oracle database](https://discuss.elastic.co/t/tuning-logstash-and-elasticsearch-for-loading-data-from-oracle-database/195795)
**Author:** [@abygin.martin](https://discuss.elastic.co/u/abygin.martin)\ **Replies:** 12\ **Last updated:** [August 20, 2019, 4:18pm UTC](https://discuss.elastic.co/t/tuning-logstash-and-elasticsearch-for-loading-data-from-oracle-database/195795 "2019-08-20T16:18:35Z")
Hi Team, We are trying to load data from oracle database to elasticsearch using logstash. We have created a config file with input section having the driver info, connection to db etc. The data is extracted using select… --- ## [Can Kibana create static visualization/dashboard?](https://discuss.elastic.co/t/can-kibana-create-static-visualization-dashboard/195837)
**Author:** [@mmk1995](https://discuss.elastic.co/u/mmk1995)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 4:15pm UTC](https://discuss.elastic.co/t/can-kibana-create-static-visualization-dashboard/195837 "2019-08-20T16:15:48Z")
Hi all, I wonder if I can create a static dashboard? In my case, I have documents with timestamp, I want to create a dashboard containing visualizations which each visualization display data for each month, like 2019-… --- ## [ElasticsearchLRUQueryCache use much memory cause node OutOfMemoryError](https://discuss.elastic.co/t/elasticsearchlruquerycache-use-much-memory-cause-node-outofmemoryerror/195966)
**Author:** [@LoadingZhang](https://discuss.elastic.co/u/LoadingZhang)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 3:28pm UTC](https://discuss.elastic.co/t/elasticsearchlruquerycache-use-much-memory-cause-node-outofmemoryerror/195966 "2019-08-20T15:28:12Z")
Elasticsearch version: 7.2.0 JVM version: Build-in JDK12 OS version: CentOS 7.3 I have a index with join field, heap usage will raise to 90%+ when doing has\_child query. MAT report shows org.elasticsearch.indices.In… --- ## [Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release on mac](https://discuss.elastic.co/t/java-hotspot-tm-64-bit-server-vm-warning-option-useconcmarksweepgc-was-deprecated-in-version-9-0-and-will-likely-be-removed-in-a-future-release-on-mac/195908)
**Author:** [@nijanthan0](https://discuss.elastic.co/u/nijanthan0)\ **Replies:** 3\ **Last updated:** [August 20, 2019, 3:24pm UTC](https://discuss.elastic.co/t/java-hotspot-tm-64-bit-server-vm-warning-option-useconcmarksweepgc-was-deprecated-in-version-9-0-and-will-likely-be-removed-in-a-future-release-on-mac/195908 "2019-08-20T15:24:01Z")
Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. \[2019-08-20T17:09:16,659\]\[WARN \]\[o.e.b.ElasticsearchUncaughtExceptionHand… --- ## [Searches performed by the user](https://discuss.elastic.co/t/searches-performed-by-the-user/195891)
**Author:** [@JoMod](https://discuss.elastic.co/u/JoMod)\ **Replies:** 3\ **Last updated:** [August 20, 2019, 3:18pm UTC](https://discuss.elastic.co/t/searches-performed-by-the-user/195891 "2019-08-20T15:18:53Z")
Hello, I have an ES that has been running for several years and I would like to know what users are looking for in the search field. Is this possible? Is there this data in a log file somewhere? Thank you in advance. … --- ## [Visualize some kind of rolling sum?](https://discuss.elastic.co/t/visualize-some-kind-of-rolling-sum/195774)
**Author:** [@cgmelastic](https://discuss.elastic.co/u/cgmelastic)\ **Replies:** 4\ **Last updated:** [August 20, 2019, 3:01pm UTC](https://discuss.elastic.co/t/visualize-some-kind-of-rolling-sum/195774 "2019-08-20T15:01:01Z")
Okay, let's say I'm getting sporadic deliveries of something, approximately every 2-3 hours but sometimes 2 in quick succession, sometimes none for 8 hours, etc. Each time a delivery is made, the amount delivered is put … --- ## [KV filter plugin install](https://discuss.elastic.co/t/kv-filter-plugin-install/195952)
**Author:** [@dcrocker](https://discuss.elastic.co/u/dcrocker)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 1:57pm UTC](https://discuss.elastic.co/t/kv-filter-plugin-install/195952 "2019-08-20T13:57:42Z")
I am new to using logstash. I need to install the kv filter but having issues. I get an error when I try to run the following command: gem 'logstash-filter-kv', '~\> 4.4' The error is: ERROR: While executing gem ...… --- ## [Certificate added via GUI only distributed to 2 of 3 nodes](https://discuss.elastic.co/t/certificate-added-via-gui-only-distributed-to-2-of-3-nodes/195916)
**Author:** [@logger](https://discuss.elastic.co/u/logger)\ **Replies:** 5\ **Last updated:** [August 20, 2019, 2:36pm UTC](https://discuss.elastic.co/t/certificate-added-via-gui-only-distributed-to-2-of-3-nodes/195916 "2019-08-20T14:36:58Z")
Hi there, we have created a 3 node ECE Cluster. Almost everything is working fine. Except the certificates. We have created the pem as described in the documentation and uploaded it via the GUI in Platform -\> Settings … --- ## [Unable to pass the custom pattern](https://discuss.elastic.co/t/unable-to-pass-the-custom-pattern/195953)
**Author:** [@Nithani25](https://discuss.elastic.co/u/Nithani25)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 2:06pm UTC](https://discuss.elastic.co/t/unable-to-pass-the-custom-pattern/195953 "2019-08-20T14:06:41Z")
Hi Team, I am trying to parse the time which is anchored Eg \ I have created custom pattern it in different location patterns\_dir =\> \[ "/etc/logstash/custompaterns/patterns" \] WEBLOG\_TIM… --- ## [Logstash: parsing AWS WAF log](https://discuss.elastic.co/t/logstash-parsing-aws-waf-log/195925)
**Author:** [@Igor\_Belyakov](https://discuss.elastic.co/u/Igor_Belyakov)\ **Replies:** 4\ **Last updated:** [August 20, 2019, 1:58pm UTC](https://discuss.elastic.co/t/logstash-parsing-aws-waf-log/195925 "2019-08-20T13:58:20Z")
Hi. Can i use HTTP filter (or other filter) to parse some fields from json AWS WAF logs from s3 bucket? logstash.conf: input{ s3 { bucket =\> "XXXX" access\_key\_id =\> "XXXX" secret\_access\_key =\> "XXXX" region =\> "XX… --- ## [Problem with elasticsearch and fluentbit in Kubernetes Cluster](https://discuss.elastic.co/t/problem-with-elasticsearch-and-fluentbit-in-kubernetes-cluster/195947)
**Author:** [@David\_Oceans](https://discuss.elastic.co/u/David_Oceans)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 1:39pm UTC](https://discuss.elastic.co/t/problem-with-elasticsearch-and-fluentbit-in-kubernetes-cluster/195947 "2019-08-20T13:39:33Z")
Hi I have elastic search with fluentbit in my gke cluster installed with helm helm install --name elastic-stack stable/elastic-stack -f custom-values.yaml --namespace logging fluent-bit: enabled: true backend: … --- ## [Kibana Authentication not working](https://discuss.elastic.co/t/kibana-authentication-not-working/194828)
**Author:** [@vbrundavanam](https://discuss.elastic.co/u/vbrundavanam)\ **Replies:** 6\ **Last updated:** [August 20, 2019, 1:39pm UTC](https://discuss.elastic.co/t/kibana-authentication-not-working/194828 "2019-08-20T13:39:06Z")
Hi, I am using kibana 6.3.2. I am trying to integrate Kibana with our AD. In that process i have done the below steps. License changed to Trail which gives us to add authentication. 2.Downloaded X-Pack -6.2.4 and to … --- ## [Enable source to track faulty objects (parsing exception)](https://discuss.elastic.co/t/enable-source-to-track-faulty-objects-parsing-exception/195944)
**Author:** [@DidierB](https://discuss.elastic.co/u/DidierB)\ **Replies:** 0\ **Last updated:** [August 20, 2019, 1:27pm UTC](https://discuss.elastic.co/t/enable-source-to-track-faulty-objects-parsing-exception/195944 "2019-08-20T13:27:56Z")
Hello, I have some \[2019-08-20T13:49:59,076\]\[DEBUG\]\[o.e.a.b.TransportShardBulkAction\] \[index\_20190820\]\[8\] failed to execute bulk item (index) BulkShardRequest \[\[index\_20190820\]\[8\]\] containing \[416\] requests org.elasti… --- ## [Problem with combining xmlfilter and ruby code to compute a time difference](https://discuss.elastic.co/t/problem-with-combining-xmlfilter-and-ruby-code-to-compute-a-time-difference/195924)
**Author:** [@Franco](https://discuss.elastic.co/u/Franco)\ **Replies:** 2\ **Last updated:** [August 20, 2019, 1:24pm UTC](https://discuss.elastic.co/t/problem-with-combining-xmlfilter-and-ruby-code-to-compute-a-time-difference/195924 "2019-08-20T13:24:44Z")
Hi all, I have an xml log which looks like this: \ **Author:** [@Efstathios\_Xagoraris](https://discuss.elastic.co/u/Efstathios_Xagoraris)\ **Replies:** 2\ **Last updated:** [August 20, 2019, 1:21pm UTC](https://discuss.elastic.co/t/rabbitmq-input-plugin-with-empty-payload/195927 "2019-08-20T13:21:37Z") Hello, I am wondering if other users are experiencing the same issue. I have a rabbitmq server with the event exchange plugin enabled. I would like to use logstash to consume the messages: The configuration is straight… --- ## [Adding search bar to my web application](https://discuss.elastic.co/t/adding-search-bar-to-my-web-application/195899)
**Author:** [@saurabhbora](https://discuss.elastic.co/u/saurabhbora)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 12:36pm UTC](https://discuss.elastic.co/t/adding-search-bar-to-my-web-application/195899 "2019-08-20T12:36:53Z")
I have a single database with 20+ tables in MySQL with different structures and linking. How should I ingest them in elasticsearch with the same format and how many indexes must be used? --- ## [Node Validation Exception Bootstrap Checks Failed](https://discuss.elastic.co/t/node-validation-exception-bootstrap-checks-failed/195913)
**Author:** [@Bidhan\_Bastola](https://discuss.elastic.co/u/Bidhan_Bastola)\ **Replies:** 1\ **Last updated:** [August 20, 2019, 12:29pm UTC](https://discuss.elastic.co/t/node-validation-exception-bootstrap-checks-failed/195913 "2019-08-20T12:29:47Z")
\[2019-08-20T17:28:28,212\]\[INFO \]\[o.e.p.PluginsService \] \[k8s-master.citytech.global\] loaded module \[x-pack-security\] \[2019-08-20T17:28:28,212\]\[INFO \]\[o.e.p.PluginsService \] \[k8s-master.citytech.global\] loade… [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1948) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1950)