# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1384 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1385 --- ## [Winlogbeat or Endpoint Security](https://discuss.elastic.co/t/winlogbeat-or-endpoint-security/274909)
**Author:** [@lepepa9493](https://discuss.elastic.co/u/lepepa9493)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 6:20pm UTC](https://discuss.elastic.co/t/winlogbeat-or-endpoint-security/274909 "2021-06-03T18:20:36Z")
hi! What is the difference between the data winlogbeat and endpoint security send? Do I need both? Thanks for your advice --- ## [RE: "File structure cannot be determined" - Visualize data from a log file](https://discuss.elastic.co/t/re-file-structure-cannot-be-determined-visualize-data-from-a-log-file/274671)
**Author:** [@momo1104](https://discuss.elastic.co/u/momo1104)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 6:16pm UTC](https://discuss.elastic.co/t/re-file-structure-cannot-be-determined-visualize-data-from-a-log-file/274671 "2021-06-03T18:16:51Z")
Hello everyone, I keep on getting a "File structure cannot be determined" error message whenever I try to manually upload a JSON .txt and/or .csv wayy under 100MB (as pictured). Links to dataset: KDD Cup 1999 Data NSL-… --- ## [Metricbeats does not ship data](https://discuss.elastic.co/t/metricbeats-does-not-ship-data/274904)
**Author:** [@farciarz121](https://discuss.elastic.co/u/farciarz121)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 5:38pm UTC](https://discuss.elastic.co/t/metricbeats-does-not-ship-data/274904 "2021-06-03T17:38:54Z")
Hi I have successfuly connected metric beat to the elastic cloud instance. I have setup dashboards, indexes and mapping. However, I can not open dashboards and there is no data under "observability-metrics". This are lo… --- ## [Query regarding Azure module in Metricbeat](https://discuss.elastic.co/t/query-regarding-azure-module-in-metricbeat/273469)
**Author:** [@adhiraj-g](https://discuss.elastic.co/u/adhiraj-g)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 5:36pm UTC](https://discuss.elastic.co/t/query-regarding-azure-module-in-metricbeat/273469 "2021-06-03T17:36:15Z")
Hi There, For Azure Module in metricbeat, we are required to create a service principal with relevant access permissions in order to access metrics data from Azure. In case of Azure setup with multiple ADs, how do we m… --- ## [Dynamically creating a Kibana dashboard](https://discuss.elastic.co/t/dynamically-creating-a-kibana-dashboard/274903)
**Author:** [@blackberrySherbet](https://discuss.elastic.co/u/blackberrySherbet)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 6:00pm UTC](https://discuss.elastic.co/t/dynamically-creating-a-kibana-dashboard/274903 "2021-06-03T18:00:00Z")
I want my users to run a script (bash or python or anything) with some data as input and that script should create a new Kibana dashboard for the user to visualize the data they gave the script as input. How can I do thi… --- ## [Error loading config file: yaml: line 177: could not find expected ':'](https://discuss.elastic.co/t/error-loading-config-file-yaml-line-177-could-not-find-expected/274430)
**Author:** [@1234](https://discuss.elastic.co/u/1234)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 5:32pm UTC](https://discuss.elastic.co/t/error-loading-config-file-yaml-line-177-could-not-find-expected/274430 "2021-06-03T17:32:49Z")
\# These settings simplify using Filebeat with the Elastic Cloud (https://cloud.elastic.co/) #The cloud.id setting overwrites the output.elasticsearch.hosts and setup.kibana.host options. You can find the cloud.id in… --- ## [Kibana - FATAL ERROR: Zone Allocation failed - process out of memory](https://discuss.elastic.co/t/kibana-fatal-error-zone-allocation-failed-process-out-of-memory/274893)
**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 4:34pm UTC](https://discuss.elastic.co/t/kibana-fatal-error-zone-allocation-failed-process-out-of-memory/274893 "2021-06-03T16:34:04Z")
Hello all, Hope you are doing well! I have been struggling with starting Kibana server from yesterday. so after starting Elasticsearch cluster, when i start Kibana, it takes hours and gives me the following errors. can … --- ## [Lengthy label is getting cropped](https://discuss.elastic.co/t/lengthy-label-is-getting-cropped/274829)
**Author:** [@Yashaswini](https://discuss.elastic.co/u/Yashaswini)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 4:08pm UTC](https://discuss.elastic.co/t/lengthy-label-is-getting-cropped/274829 "2021-06-03T16:08:57Z")
How can u split x-axis label into multiple lines --- ## [Logstash date filter](https://discuss.elastic.co/t/logstash-date-filter/274864)
**Author:** [@Kamikaze\_K](https://discuss.elastic.co/u/Kamikaze_K)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 3:49pm UTC](https://discuss.elastic.co/t/logstash-date-filter/274864 "2021-06-03T15:49:40Z")
I have logs that I am parsing and the date does not contain the year which should be default current year. The field that I get after grok etc is 06/25 11:33:19.9 PM and 06/25 11:33:19.9 PM etc I am trying to use the d… --- ## [Precision Threshold of Count in Canvas](https://discuss.elastic.co/t/precision-threshold-of-count-in-canvas/274664)
**Author:** [@Amy\_Collins](https://discuss.elastic.co/u/Amy_Collins)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 3:33pm UTC](https://discuss.elastic.co/t/precision-threshold-of-count-in-canvas/274664 "2021-06-03T15:33:10Z")
Hi, Is there a way to set the precision threshold when performing a unique/distinct count using Canvas? I need the count to be as accurate as possible. All hints and tips welcome. --- ## [ESRALLY Continuous index](https://discuss.elastic.co/t/esrally-continuous-index/274800)
**Author:** [@contregm](https://discuss.elastic.co/u/contregm)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 3:15pm UTC](https://discuss.elastic.co/t/esrally-continuous-index/274800 "2021-06-03T15:15:17Z")
I haven't run it in a while but I am trying to run the esrally elastic logs-continuous-index-and-query but cannot seem to find the data for this anymore. --- ## [Elasticsearch](https://discuss.elastic.co/t/elasticsearch/274889)
**Author:** [@Roshaan\_Zafar](https://discuss.elastic.co/u/Roshaan_Zafar)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 2:48pm UTC](https://discuss.elastic.co/t/elasticsearch/274889 "2021-06-03T14:48:54Z")
Hi I just wanted to know that is elasticsearch platinum only cloud based not locally? Actually I am asking because I need to connect odbc elastic with power bi and it supports elasticsearch platinum only while I wanted… --- ## [Parsing json logs using logstash](https://discuss.elastic.co/t/parsing-json-logs-using-logstash/274240)
**Author:** [@learningelk](https://discuss.elastic.co/u/learningelk)\ **Replies:** 10\ **Last updated:** [June 3, 2021, 2:15pm UTC](https://discuss.elastic.co/t/parsing-json-logs-using-logstash/274240 "2021-06-03T14:15:03Z")
Hi I want to parse the json logs using logstash and send them to elastic .There are multiple nested fields in my logs but I want very specific fields for eg , here is my log format : { "\_index": "ekslogs-2021.05.27", … --- ## [Logstash data not visible in Kibana](https://discuss.elastic.co/t/logstash-data-not-visible-in-kibana/274880)
**Author:** [@Reszel](https://discuss.elastic.co/u/Reszel)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 2:05pm UTC](https://discuss.elastic.co/t/logstash-data-not-visible-in-kibana/274880 "2021-06-03T14:05:38Z")
Hello guys, I'm newbie to ELK and i was trying to connect Logstash to Kibana/Elastic with my own configuration. Logstash seems to be running, but Kibana can't see any data, when i try to create index pattern. Here is my … --- ## [Metrcbeat withlogstach](https://discuss.elastic.co/t/metrcbeat-withlogstach/274877)
**Author:** [@mohamed\_el\_mannouti](https://discuss.elastic.co/u/mohamed_el_mannouti)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 1:45pm UTC](https://discuss.elastic.co/t/metrcbeat-withlogstach/274877 "2021-06-03T13:45:33Z")
logs not found to kibana --- ## [Scheduler Java Input plugin Logstash](https://discuss.elastic.co/t/scheduler-java-input-plugin-logstash/274876)
**Author:** [@aalagia](https://discuss.elastic.co/u/aalagia)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 1:37pm UTC](https://discuss.elastic.co/t/scheduler-java-input-plugin-logstash/274876 "2021-06-03T13:37:17Z")
Hi, I try to write a java plugin for Logstash, i need to schedule my program with a parameter passed in the configuration file. I tried to use the Java Timer for this but doesn't work. The pipeline execute the code but … --- ## [Using an image as a map in a kibana dashboard](https://discuss.elastic.co/t/using-an-image-as-a-map-in-a-kibana-dashboard/274713)
**Author:** [@Marc2](https://discuss.elastic.co/u/Marc2)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 1:13pm UTC](https://discuss.elastic.co/t/using-an-image-as-a-map-in-a-kibana-dashboard/274713 "2021-06-03T13:13:52Z")
Hello everybody. The thing is I must use a a facory layout I got in an image as a map in a dashboard and I don't know how. I guess I should add coordenates to that image and then upload it in some way. Is there anybody… --- ## [Xml filter Xpath not Working](https://discuss.elastic.co/t/xml-filter-xpath-not-working/274847)
**Author:** [@venmaniselvan](https://discuss.elastic.co/u/venmaniselvan)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 12:21pm UTC](https://discuss.elastic.co/t/xml-filter-xpath-not-working/274847 "2021-06-03T12:21:20Z")
Hello, I have the following below XML: \ \CUSTINQ2104001\ \MOB\ \abcfinance:referenceNumConsumer\ \ **Author:** [@schawla](https://discuss.elastic.co/u/schawla)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 11:27am UTC](https://discuss.elastic.co/t/pagination-with-field-collapse/274863 "2021-06-03T11:27:01Z") How is it possible to implement pagination in elastic search when we are field collapsing and returning top 5 results from each index. GET /my-index-000001/\_search { "query": { "match": { "message": "GET /se… --- ## [Logstash - beats input - NullPointerException](https://discuss.elastic.co/t/logstash-beats-input-nullpointerexception/274862)
**Author:** [@George\_Kossionis](https://discuss.elastic.co/u/George_Kossionis)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 11:19am UTC](https://discuss.elastic.co/t/logstash-beats-input-nullpointerexception/274862 "2021-06-03T11:19:28Z")
Using the following filebeat config in OCP: filebeat.autodiscover: providers: - type: kubernetes node: ${NODE\_NAME} templates: - condition: equals: … --- ## [Filebeat not reading the input log file](https://discuss.elastic.co/t/filebeat-not-reading-the-input-log-file/274854)
**Author:** [@Ashwani\_Shukla](https://discuss.elastic.co/u/Ashwani_Shukla)\ **Replies:** 3\ **Last updated:** [June 3, 2021, 11:06am UTC](https://discuss.elastic.co/t/filebeat-not-reading-the-input-log-file/274854 "2021-06-03T11:06:55Z")
I am trying to fetch data using beats input from a log file whose path I have given in filebeat.yml. But the log file is not read by the logstash while running. filebeat.inputs: - type: log enabled: true paths: … --- ## [Elasticsearch-rest-high-level-client-6.8.13 vs Elastic server 7.5.2](https://discuss.elastic.co/t/elasticsearch-rest-high-level-client-6-8-13-vs-elastic-server-7-5-2/274707)
**Author:** [@Prabaharan\_Kathiresa](https://discuss.elastic.co/u/Prabaharan_Kathiresa)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 10:33am UTC](https://discuss.elastic.co/t/elasticsearch-rest-high-level-client-6-8-13-vs-elastic-server-7-5-2/274707 "2021-06-03T10:33:16Z")
Hi Team We are trying to upgrade elastic server from 6.8.5 to 7.5.2. Now our micro services are using elasticsearch-rest-high-level-client version 6.8.13. We don't see any problems in communication between elastic serv… --- ## [Automatic indexing data from MySQL to Kibana](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274849)
**Author:** [@pablixelastic](https://discuss.elastic.co/u/pablixelastic)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 10:18am UTC](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274849 "2021-06-03T10:18:26Z")
Hi there, I want to know which tool do i have to use to automatically index data from my MySQL table (where i also do changes in the existing data) to my index in Kibana. I've been trying modifying the mysql.conf and t… --- ## [Create dynamically type](https://discuss.elastic.co/t/create-dynamically-type/274788)
**Author:** [@Abdoul\_Kande](https://discuss.elastic.co/u/Abdoul_Kande)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 10:12am UTC](https://discuss.elastic.co/t/create-dynamically-type/274788 "2021-06-03T10:12:00Z")
How can i create dynamically type in index ? Or in \_doc, create multiple \_type --- ## [Automatic indexing data from MySQL to Kibana](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274760)
**Author:** [@pablixelastic](https://discuss.elastic.co/u/pablixelastic)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 10:11am UTC](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274760 "2021-06-03T10:11:01Z")
Hi there, I want to know which tool do i have to use to automatically index data from my MySQL table (where i also do changes in the existing data) to my index in Kibana. I've been trying modifying the mysql.conf and t… --- ## [SQL DISTINCT Pair of Values in Elasticsearch](https://discuss.elastic.co/t/sql-distinct-pair-of-values-in-elasticsearch/274583)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 9:59am UTC](https://discuss.elastic.co/t/sql-distinct-pair-of-values-in-elasticsearch/274583 "2021-06-03T09:59:49Z")
I want to ask how to use SQL DISTINCT Pair of Values in Elasticsearch . Like below, SELECT distinct username, city from country\_table I can run below query for just one field. In the aggs json, I can only see "username… --- ## [Multi phase deduplication on query-time](https://discuss.elastic.co/t/multi-phase-deduplication-on-query-time/274846)
**Author:** [@osmanmesutozcan](https://discuss.elastic.co/u/osmanmesutozcan)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 9:40am UTC](https://discuss.elastic.co/t/multi-phase-deduplication-on-query-time/274846 "2021-06-03T09:40:42Z")
Alright so I think I have a somewhat interesting query problem to solve. Any help is appreciated. I need to do a multi phase deduplication on query time. To elaborate more, my data is shared between multiple tenants and… --- ## [Aggregation fails silently when ran on huge data, instead of error returns the default response of 10 docs and hits](https://discuss.elastic.co/t/aggregation-fails-silently-when-ran-on-huge-data-instead-of-error-returns-the-default-response-of-10-docs-and-hits/273412)
**Author:** [@rohit.shisode](https://discuss.elastic.co/u/rohit.shisode)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 9:38am UTC](https://discuss.elastic.co/t/aggregation-fails-silently-when-ran-on-huge-data-instead-of-error-returns-the-default-response-of-10-docs-and-hits/273412 "2021-06-03T09:38:22Z")
Stack details - ES version - 7.10.1 Kibana version - 7.10.1 Java high level client version - 7.2.0 I have a production cluster of 4 nodes where huge amounts of data is stored in one of the index (approx 30M+ docs, ea… --- ## [Unable to access Kibana with "License is not available."](https://discuss.elastic.co/t/unable-to-access-kibana-with-license-is-not-available/274175)
**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 8:52am UTC](https://discuss.elastic.co/t/unable-to-access-kibana-with-license-is-not-available/274175 "2021-06-03T08:52:11Z")
Kibana, which was working fine until now, can no longer be accessed. The cause is that I added x-pack configuration to elasticsearch in order to introduce Workplace Search. Using the basic license of x-pack, I want to … --- ## [Elasticsearch Split Processor preserve\_trailing value](https://discuss.elastic.co/t/elasticsearch-split-processor-preserve-trailing-value/274836)
**Author:** [@jeje232](https://discuss.elastic.co/u/jeje232)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:41am UTC](https://discuss.elastic.co/t/elasticsearch-split-processor-preserve-trailing-value/274836 "2021-06-03T08:41:26Z")
Hi, I have the follwing message and try to to split values and remove at the same time the empty value with preserve\_trailing: Members\[ xxx.xxx.xxx.xxx:xxxx … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1383) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1385)