# Latest **URL:** https://discuss.elastic.co/latest.md?page=1643 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1644 --- ## [Filebeat not reading the input log file](https://discuss.elastic.co/t/filebeat-not-reading-the-input-log-file/274854)
**Author:** [@Ashwani\_Shukla](https://discuss.elastic.co/u/Ashwani_Shukla)\ **Replies:** 3\ **Last updated:** [June 3, 2021, 11:06am UTC](https://discuss.elastic.co/t/filebeat-not-reading-the-input-log-file/274854 "2021-06-03T11:06:55Z")
I am trying to fetch data using beats input from a log file whose path I have given in filebeat.yml. But the log file is not read by the logstash while running. filebeat.inputs: - type: log enabled: true paths: … --- ## [Elasticsearch-rest-high-level-client-6.8.13 vs Elastic server 7.5.2](https://discuss.elastic.co/t/elasticsearch-rest-high-level-client-6-8-13-vs-elastic-server-7-5-2/274707)
**Author:** [@Prabaharan\_Kathiresa](https://discuss.elastic.co/u/Prabaharan_Kathiresa)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 10:33am UTC](https://discuss.elastic.co/t/elasticsearch-rest-high-level-client-6-8-13-vs-elastic-server-7-5-2/274707 "2021-06-03T10:33:16Z")
Hi Team We are trying to upgrade elastic server from 6.8.5 to 7.5.2. Now our micro services are using elasticsearch-rest-high-level-client version 6.8.13. We don't see any problems in communication between elastic serv… --- ## [Automatic indexing data from MySQL to Kibana](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274849)
**Author:** [@pablixelastic](https://discuss.elastic.co/u/pablixelastic)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 10:18am UTC](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274849 "2021-06-03T10:18:26Z")
Hi there, I want to know which tool do i have to use to automatically index data from my MySQL table (where i also do changes in the existing data) to my index in Kibana. I've been trying modifying the mysql.conf and t… --- ## [Create dynamically type](https://discuss.elastic.co/t/create-dynamically-type/274788)
**Author:** [@Abdoul\_Kande](https://discuss.elastic.co/u/Abdoul_Kande)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 10:12am UTC](https://discuss.elastic.co/t/create-dynamically-type/274788 "2021-06-03T10:12:00Z")
How can i create dynamically type in index ? Or in \_doc, create multiple \_type --- ## [Automatic indexing data from MySQL to Kibana](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274760)
**Author:** [@pablixelastic](https://discuss.elastic.co/u/pablixelastic)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 10:11am UTC](https://discuss.elastic.co/t/automatic-indexing-data-from-mysql-to-kibana/274760 "2021-06-03T10:11:01Z")
Hi there, I want to know which tool do i have to use to automatically index data from my MySQL table (where i also do changes in the existing data) to my index in Kibana. I've been trying modifying the mysql.conf and t… --- ## [Problème de communication entre elasticsearch et nuxeo : Erreur lors de la lecture de \[aggregates\]](https://discuss.elastic.co/t/probleme-de-communication-entre-elasticsearch-et-nuxeo-erreur-lors-de-la-lecture-de-aggregates/274835)
**Author:** [@EAmel](https://discuss.elastic.co/u/EAmel)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 10:07am UTC](https://discuss.elastic.co/t/probleme-de-communication-entre-elasticsearch-et-nuxeo-erreur-lors-de-la-lecture-de-aggregates/274835 "2021-06-03T10:07:09Z")
Bonjour, J'ai un problème de communication entre ES et nuxeo; depuis la plateforme nuxeo quand je clique sur l'onglet “Recherche” ou l'onglet “Elasticsearch” dans le menu “Admin” ça bug et j'ai eu le message d'erreur qu… --- ## [SQL DISTINCT Pair of Values in Elasticsearch](https://discuss.elastic.co/t/sql-distinct-pair-of-values-in-elasticsearch/274583)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 9:59am UTC](https://discuss.elastic.co/t/sql-distinct-pair-of-values-in-elasticsearch/274583 "2021-06-03T09:59:49Z")
I want to ask how to use SQL DISTINCT Pair of Values in Elasticsearch . Like below, SELECT distinct username, city from country\_table I can run below query for just one field. In the aggs json, I can only see "username… --- ## [Multi phase deduplication on query-time](https://discuss.elastic.co/t/multi-phase-deduplication-on-query-time/274846)
**Author:** [@osmanmesutozcan](https://discuss.elastic.co/u/osmanmesutozcan)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 9:40am UTC](https://discuss.elastic.co/t/multi-phase-deduplication-on-query-time/274846 "2021-06-03T09:40:42Z")
Alright so I think I have a somewhat interesting query problem to solve. Any help is appreciated. I need to do a multi phase deduplication on query time. To elaborate more, my data is shared between multiple tenants and… --- ## [Aggregation fails silently when ran on huge data, instead of error returns the default response of 10 docs and hits](https://discuss.elastic.co/t/aggregation-fails-silently-when-ran-on-huge-data-instead-of-error-returns-the-default-response-of-10-docs-and-hits/273412)
**Author:** [@rohit.shisode](https://discuss.elastic.co/u/rohit.shisode)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 9:38am UTC](https://discuss.elastic.co/t/aggregation-fails-silently-when-ran-on-huge-data-instead-of-error-returns-the-default-response-of-10-docs-and-hits/273412 "2021-06-03T09:38:22Z")
Stack details - ES version - 7.10.1 Kibana version - 7.10.1 Java high level client version - 7.2.0 I have a production cluster of 4 nodes where huge amounts of data is stored in one of the index (approx 30M+ docs, ea… --- ## [Fleet Server won't start - certificate error](https://discuss.elastic.co/t/fleet-server-wont-start-certificate-error/274617)
**Author:** [@finbarr996](https://discuss.elastic.co/u/finbarr996)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 9:06am UTC](https://discuss.elastic.co/t/fleet-server-wont-start-certificate-error/274617 "2021-06-03T09:06:51Z")
I've been running 7.12 with 10 test endpoints all operating in Fleet without any problem. After upgrading to 7.13, I'm trying to re-deploy to the test endpoints (after manually removing the previous agent on each endpoi… --- ## [\[ANNOUNCEMENT\] - Elasticsearch Beyonder 7.13 released](https://discuss.elastic.co/t/announcement-elasticsearch-beyonder-7-13-released/274837)
**Author:** [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:56am UTC](https://discuss.elastic.co/t/announcement-elasticsearch-beyonder-7-13-released/274837 "2021-06-03T08:56:21Z")
The Elasticsearch Beyonder team is pleased to announce the elasticsearch-beyonder-7.13 release! Elasticsearch Beyonder Elasticsearch beyonder provides automatic index, mapping, alias or template creation when an elasti… --- ## [Unable to access Kibana with "License is not available."](https://discuss.elastic.co/t/unable-to-access-kibana-with-license-is-not-available/274175)
**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 8:52am UTC](https://discuss.elastic.co/t/unable-to-access-kibana-with-license-is-not-available/274175 "2021-06-03T08:52:11Z")
Kibana, which was working fine until now, can no longer be accessed. The cause is that I added x-pack configuration to elasticsearch in order to introduce Workplace Search. Using the basic license of x-pack, I want to … --- ## [Elasticsearch Split Processor preserve\_trailing value](https://discuss.elastic.co/t/elasticsearch-split-processor-preserve-trailing-value/274836)
**Author:** [@jeje232](https://discuss.elastic.co/u/jeje232)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:41am UTC](https://discuss.elastic.co/t/elasticsearch-split-processor-preserve-trailing-value/274836 "2021-06-03T08:41:26Z")
Hi, I have the follwing message and try to to split values and remove at the same time the empty value with preserve\_trailing: Members\[ xxx.xxx.xxx.xxx:xxxx … --- ## [How Sliced Scan Works in the background?](https://discuss.elastic.co/t/how-sliced-scan-works-in-the-background/274832)
**Author:** [@arkash20](https://discuss.elastic.co/u/arkash20)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:23am UTC](https://discuss.elastic.co/t/how-sliced-scan-works-in-the-background/274832 "2021-06-03T08:23:08Z")
Hi, I used scan method to retrieve data from a huge indice we have (200M records), using multiprocessing. For that I used sliced scan and set it to 6 slices, as the number of my shards. Now here comes the theory questi… --- ## [Elastic agent log parsing](https://discuss.elastic.co/t/elastic-agent-log-parsing/274827)
**Author:** [@Guncixx](https://discuss.elastic.co/u/Guncixx)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 6:59am UTC](https://discuss.elastic.co/t/elastic-agent-log-parsing/274827 "2021-06-03T06:59:39Z")
While testing Elastic SIEM and different shippers I discovered that both filebeat and elastic agent is not parsing Ubuntu auth log completely, there are some events where user and some other fields not getting populated.… --- ## [Canvas refresh rate permanent](https://discuss.elastic.co/t/canvas-refresh-rate-permanent/274174)
**Author:** [@accateo](https://discuss.elastic.co/u/accateo)\ **Replies:** 3\ **Last updated:** [June 3, 2021, 7:40am UTC](https://discuss.elastic.co/t/canvas-refresh-rate-permanent/274174 "2021-06-03T07:40:56Z")
Hello, I saw that it is possible to set the canvas refresh rate. Unfortunately, however, I have to set it in every canvas and every time I open it in a new browser. Is it possible to set the refresh rate permanently, … --- ## [Combining URL and field value/values](https://discuss.elastic.co/t/combining-url-and-field-value-values/274710)
**Author:** [@marija.timovska](https://discuss.elastic.co/u/marija.timovska)\ **Replies:** 25\ **Last updated:** [June 3, 2021, 8:08am UTC](https://discuss.elastic.co/t/combining-url-and-field-value-values/274710 "2021-06-03T08:08:14Z")
I would like some assistance with creating custom fields in Kibana. I am not sure why the filed I want is shown correctly in Discovery but when I want to Visualize it it changes back to how it is by default. … --- ## [Custom Field on the workplace Display Setting](https://discuss.elastic.co/t/custom-field-on-the-workplace-display-setting/273282)
**Author:** [@jeje232](https://discuss.elastic.co/u/jeje232)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 7:32am UTC](https://discuss.elastic.co/t/custom-field-on-the-workplace-display-setting/273282 "2021-06-03T07:32:54Z")
Hello, In the search application in Workplace Search I want to add at the end of the URL link Something like #toto=tata In the display settings I don't find nothing, just the comment but don't now if it's possible to p… --- ## [Can we use index pattern if we allow only alias in roles](https://discuss.elastic.co/t/can-we-use-index-pattern-if-we-allow-only-alias-in-roles/274725)
**Author:** [@kannan\_raj](https://discuss.elastic.co/u/kannan_raj)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 7:11am UTC](https://discuss.elastic.co/t/can-we-use-index-pattern-if-we-allow-only-alias-in-roles/274725 "2021-06-03T07:11:27Z")
unable to query the data by using index patterns. just assume the index name is test-20210602-00001 and the alias is testing. role is GET /\_xpack/security/role/test?pretty { "cluster": \[\], "indices": \[ … --- ## [BUG: Elasticsearch ignoring node.roles after upgrade from 7.6.1](https://discuss.elastic.co/t/bug-elasticsearch-ignoring-node-roles-after-upgrade-from-7-6-1/274465)
**Author:** [@mverbeek](https://discuss.elastic.co/u/mverbeek)\ **Replies:** 14\ **Last updated:** [June 3, 2021, 7:08am UTC](https://discuss.elastic.co/t/bug-elasticsearch-ignoring-node-roles-after-upgrade-from-7-6-1/274465 "2021-06-03T07:08:03Z")
Hello everyone, When upgrading from 7.6.1 to 7.10.2, I replaced the old node.master and node.data setting to the new node.roles setting. I changed 2 of the 5 data nodes to data\_cold only. But if the node has already bee… --- ## [Hdfs repository analysis check failed](https://discuss.elastic.co/t/hdfs-repository-analysis-check-failed/274815)
**Author:** [@zhoutiekui](https://discuss.elastic.co/u/zhoutiekui)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 7:07am UTC](https://discuss.elastic.co/t/hdfs-repository-analysis-check-failed/274815 "2021-06-03T07:07:35Z")
dear all, I tried to use the opensource hdfs as a snapshot repository, and when I excute the analysis API, there is an error below: POST /\_snapshot/06031016/\_analyze?blob\_count=10&max\_blob\_size=1mb&timeout=120s&concurr… --- ## [Installing Elasticsearch on a VM outside of the Internet](https://discuss.elastic.co/t/installing-elasticsearch-on-a-vm-outside-of-the-internet/274756)
**Author:** [@jyde](https://discuss.elastic.co/u/jyde)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 7:04am UTC](https://discuss.elastic.co/t/installing-elasticsearch-on-a-vm-outside-of-the-internet/274756 "2021-06-03T07:04:23Z")
Hi, I am tring to install ELK on a VM (let's name it foomachine) which is not connected to the Internet. With MobaXTerm, I have put the tar.gz file of the lastest version of Elasticsearch on foomachine, more precisely … --- ## [Requests coming from Postman does not reflected in API logs of App search](https://discuss.elastic.co/t/requests-coming-from-postman-does-not-reflected-in-api-logs-of-app-search/274721)
**Author:** [@vjerts](https://discuss.elastic.co/u/vjerts)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 6:45am UTC](https://discuss.elastic.co/t/requests-coming-from-postman-does-not-reflected-in-api-logs-of-app-search/274721 "2021-06-03T06:45:40Z")
We are using Enterprise search deployed to OpenShift with ECK and we are facing strange issue with App search...API requests are not registered into API logs if they are coming from API call with Postman for example. Bu… --- ## [Unable to see nginx response time field on kibana](https://discuss.elastic.co/t/unable-to-see-nginx-response-time-field-on-kibana/274563)
**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 6:32am UTC](https://discuss.elastic.co/t/unable-to-see-nginx-response-time-field-on-kibana/274563 "2021-06-03T06:32:50Z")
Hello Team, Our architecture is Beats--\>Logstash--\>Elasticsaerch--\>Kibana and version is 7.10.2 for whole ELK stack. We are sending the nginx access logs on logstash using Filebeat nginx module and at logstash we are u… --- ## [CSRF Protection in kibana 7.10.2](https://discuss.elastic.co/t/csrf-protection-in-kibana-7-10-2/274824)
**Author:** [@ravi\_yadav2](https://discuss.elastic.co/u/ravi_yadav2)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 5:51am UTC](https://discuss.elastic.co/t/csrf-protection-in-kibana-7-10-2/274824 "2021-06-03T05:51:15Z")
Continuing the discussion from CSRF Protection in kibana 7.10.2: --- ## [Error in autodiscover provider settings: error setting up docker autodiscover provider](https://discuss.elastic.co/t/error-in-autodiscover-provider-settings-error-setting-up-docker-autodiscover-provider/274822)
**Author:** [@justindn](https://discuss.elastic.co/u/justindn)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 4:33am UTC](https://discuss.elastic.co/t/error-in-autodiscover-provider-settings-error-setting-up-docker-autodiscover-provider/274822 "2021-06-03T04:33:31Z")
When I try to setup filebeat I get this error: filebeat | Exiting: error in autodiscover provider settings: error setting up docker autodiscover provider: Cannot connect to the Docker daemon at unix:///var/run/docker… --- ## [Config roles in Kibana](https://discuss.elastic.co/t/config-roles-in-kibana/274360)
**Author:** [@N1k-3l](https://discuss.elastic.co/u/N1k-3l)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 4:24am UTC](https://discuss.elastic.co/t/config-roles-in-kibana/274360 "2021-06-03T04:24:56Z")
Hello! I need to create a role only for viewing(read-only) Index Management. In Cluster privileges only one option(manage) enables able to see Index Management. Does option exist to read-only access to it? Thanks for… --- ## [Some logs missing in Kibana](https://discuss.elastic.co/t/some-logs-missing-in-kibana/274819)
**Author:** [@fsiu](https://discuss.elastic.co/u/fsiu)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 3:39am UTC](https://discuss.elastic.co/t/some-logs-missing-in-kibana/274819 "2021-06-03T03:39:55Z")
I have an api application that uses Logstash to send logs to Kibana, all logs are successfully sent. However some logs are missing when viewing the index using Discovery - Kibana. Can you help me to identify the issue … --- ## [Elasticsearch appears to be unreachable or down](https://discuss.elastic.co/t/elasticsearch-appears-to-be-unreachable-or-down/274814)
**Author:** [@abdallah](https://discuss.elastic.co/u/abdallah)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 2:53am UTC](https://discuss.elastic.co/t/elasticsearch-appears-to-be-unreachable-or-down/274814 "2021-06-03T02:53:32Z")
Hi, we suddenly lost the connection between our two logstash servers and the Elasticsearch nodes. The odd thing is that from logstash you can curl, telnet and ping the ElasticSearch nodes, but there is no sending logsta… --- ## [Logstash read file in what order?](https://discuss.elastic.co/t/logstash-read-file-in-what-order/274549)
**Author:** [@theirfan](https://discuss.elastic.co/u/theirfan)\ **Replies:** 21\ **Last updated:** [June 3, 2021, 2:52am UTC](https://discuss.elastic.co/t/logstash-read-file-in-what-order/274549 "2021-06-03T02:52:37Z")
Hi All, Would like to know how logstash "input" reads files from a directory. I have files which are created based on size limit and each new log creation is appended with the creation date in it's name. Ex: file-010… [Previous page](https://discuss.elastic.co/latest.md?page=1642) [Next page](https://discuss.elastic.co/latest.md?page=1644)