# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1939 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1940 --- ## [Old stale shards in path.data](https://discuss.elastic.co/t/old-stale-shards-in-path-data/240637)
**Author:** [@asmith](https://discuss.elastic.co/u/asmith)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 9:39am UTC](https://discuss.elastic.co/t/old-stale-shards-in-path-data/240637 "2020-07-10T09:39:39Z")
Hello, I just noticed that we have a massive shard imbalance in our 7.1.0 cluster. I'm assuming it must've happened due to many partial/failed recoveries or similar, and it seems that a lot of data must've just been lef… --- ## [Concatenate two columns](https://discuss.elastic.co/t/concatenate-two-columns/240662)
**Author:** [@Jasmin](https://discuss.elastic.co/u/Jasmin)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 9:24am UTC](https://discuss.elastic.co/t/concatenate-two-columns/240662 "2020-07-10T09:24:01Z")
Hi , i want to select only new entries , and i am gonna use last sql value , but in my case i am wokring on shops , so i have two dates , date of creation ( if somebody buy something ) and date of modification ( if som… --- ## [How to start Fscrawler after downloading its Zip file](https://discuss.elastic.co/t/how-to-start-fscrawler-after-downloading-its-zip-file/240584)
**Author:** [@Deepika\_Rawat](https://discuss.elastic.co/u/Deepika_Rawat)\ **Replies:** 6\ **Last updated:** [July 10, 2020, 9:00am UTC](https://discuss.elastic.co/t/how-to-start-fscrawler-after-downloading-its-zip-file/240584 "2020-07-10T09:00:29Z")
I want to read a PDF file through Fscrawler but i just dont know how to start it after downloading it was written that start with bin command but when i explore the folder there was no bin folder List item spacesbeans… --- ## [Locked out of my node, How to run as a service](https://discuss.elastic.co/t/locked-out-of-my-node-how-to-run-as-a-service/240659)
**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 8:50am UTC](https://discuss.elastic.co/t/locked-out-of-my-node-how-to-run-as-a-service/240659 "2020-07-10T08:50:08Z")
Hi, I am currently trying to run elastic as a windows service. But it fails every time. When I start it from the terminal it connects to the other nodes. When I start it as a service it doesn't connect. Why? But thats … --- ## [Master not discovered or elected yet, an election requires one or more nodes that have already participated as master-eligible nodes in the cluster but this node was not master-eligible the last time it joined the cluster, have discovered](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-one-or-more-nodes-that-have-already-participated-as-master-eligible-nodes-in-the-cluster-but-this-node-was-not-master-eligible-the-last-time-it-joined-the-cluster-have-discovered/240416)
**Author:** [@nvelumani](https://discuss.elastic.co/u/nvelumani)\ **Replies:** 9\ **Last updated:** [July 10, 2020, 8:13am UTC](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-one-or-more-nodes-that-have-already-participated-as-master-eligible-nodes-in-the-cluster-but-this-node-was-not-master-eligible-the-last-time-it-joined-the-cluster-have-discovered/240416 "2020-07-10T08:13:08Z")
Hello Team, I had Elastic cluster with node1(Master) and node2 with 7.8.0 Elastic and Kibana working Fine on Centos Servers. I had to format node1 so formatted it and installed a fresh Elastic and Kibaka and used the s… --- ## [Logstash not forwarding messages to elasticsearch but able to write to file locally](https://discuss.elastic.co/t/logstash-not-forwarding-messages-to-elasticsearch-but-able-to-write-to-file-locally/240111)
**Author:** [@satish92](https://discuss.elastic.co/u/satish92)\ **Replies:** 4\ **Last updated:** [July 10, 2020, 7:29am UTC](https://discuss.elastic.co/t/logstash-not-forwarding-messages-to-elasticsearch-but-able-to-write-to-file-locally/240111 "2020-07-10T07:29:51Z")
Im facing strange issue and im new to elastic stack this is my flow logstash A (input application logs , output kafka topics) =\> kafka (topics , all topics to logstash consumer group) =\> logstash B ( input kafka , outp… --- ## [Filebeat data path already locked](https://discuss.elastic.co/t/filebeat-data-path-already-locked/240559)
**Author:** [@Imad\_Bouchakour](https://discuss.elastic.co/u/Imad_Bouchakour)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 7:16am UTC](https://discuss.elastic.co/t/filebeat-data-path-already-locked/240559 "2020-07-10T07:16:08Z")
Hi, how to fix ? ERROR instance/beat.go:958 Exiting: data path already locked by another beat. Please make sure that multiple beats are not sharing the same data path (path.data). Exiting: data path already locked by … --- ## [Field\_data\_type default True](https://discuss.elastic.co/t/field-data-type-default-true/240087)
**Author:** [@vinayborra](https://discuss.elastic.co/u/vinayborra)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 7:01am UTC](https://discuss.elastic.co/t/field-data-type-default-true/240087 "2020-07-10T07:01:38Z")
Hello, Can you tell me how to set default value of field\_datatype is true. Whenever i delete indices in this location Management --\> Index Management --\> indices in kibana. Field\_datatype is changed to false automatica… --- ## [Cannot connect data node to master node](https://discuss.elastic.co/t/cannot-connect-data-node-to-master-node/240594)
**Author:** [@vinci](https://discuss.elastic.co/u/vinci)\ **Replies:** 1\ **Last updated:** [July 9, 2020, 8:24pm UTC](https://discuss.elastic.co/t/cannot-connect-data-node-to-master-node/240594 "2020-07-09T20:24:03Z")
Hello, I'm configuring elasticsearch 7.8.0 directly on Ubuntu 18.04.4 on two hosts, but I have an error which I really don't understand when the data node tries to connect to the master, which keeps repeating over and o… --- ## [Modifying the stylesheets](https://discuss.elastic.co/t/modifying-the-stylesheets/240322)
**Author:** [@MarcoRocco](https://discuss.elastic.co/u/MarcoRocco)\ **Replies:** 4\ **Last updated:** [July 10, 2020, 6:45am UTC](https://discuss.elastic.co/t/modifying-the-stylesheets/240322 "2020-07-10T06:45:24Z")
Hey everyone, I'm looking for a way to modify the look for kibana 7.8, I'm working on the development mode of kibana so I can modify the codebase but it seems that there is no longer an intuitive way to modify the style… --- ## [Performance impact of multiple BoolQueries](https://discuss.elastic.co/t/performance-impact-of-multiple-boolqueries/240647)
**Author:** [@viswanathk243](https://discuss.elastic.co/u/viswanathk243)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 6:38am UTC](https://discuss.elastic.co/t/performance-impact-of-multiple-boolqueries/240647 "2020-07-10T06:38:53Z")
To my understanding the search queue gets executed sequentially on the Lucene segments, and the search queue length is fixed. Assuming that my previous understand was correct, how does a search request from client trans… --- ## [Use static data in Vega Visualisation](https://discuss.elastic.co/t/use-static-data-in-vega-visualisation/239955)
**Author:** [@biplabd67](https://discuss.elastic.co/u/biplabd67)\ **Replies:** 3\ **Last updated:** [July 10, 2020, 6:37am UTC](https://discuss.elastic.co/t/use-static-data-in-vega-visualisation/239955 "2020-07-10T06:37:28Z")
I would like to use a static set of data instead of a url query to evaluate a Vega code I am trying to design. Somehow I am not able to use the static data , any help or assistance pointer would be appreciated. --- ## [How many shards should I have in Elasticsearch Node with v7.7?](https://discuss.elastic.co/t/how-many-shards-should-i-have-in-elasticsearch-node-with-v7-7/240452)
**Author:** [@begin](https://discuss.elastic.co/u/begin)\ **Replies:** 6\ **Last updated:** [July 10, 2020, 6:34am UTC](https://discuss.elastic.co/t/how-many-shards-should-i-have-in-elasticsearch-node-with-v7-7/240452 "2020-07-10T06:34:47Z")
Hello, I know, I keep number of shards per node below 20 per GB heap it has configured. https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster But, I know Elasticsearch heap memory usag… --- ## [Metricbeat not using name in http monitoring](https://discuss.elastic.co/t/metricbeat-not-using-name-in-http-monitoring/240368)
**Author:** [@Tasmanien](https://discuss.elastic.co/u/Tasmanien)\ **Replies:** 3\ **Last updated:** [July 10, 2020, 6:17am UTC](https://discuss.elastic.co/t/metricbeat-not-using-name-in-http-monitoring/240368 "2020-07-10T06:17:44Z")
Hi, I'm using http monitoring on my metricbeat, so I can see it in Kibana Monitoring. I've setup like this: metricbeat.yml: http.enabled: true http.port: 5067 name: NAME-I-PICKED beat-xpack.yml: module: beat me… --- ## [Search UI is not suupoting hashing in url](https://discuss.elastic.co/t/search-ui-is-not-suupoting-hashing-in-url/240519)
**Author:** [@ranjeet.tiwari](https://discuss.elastic.co/u/ranjeet.tiwari)\ **Replies:** 5\ **Last updated:** [July 10, 2020, 5:56am UTC](https://discuss.elastic.co/t/search-ui-is-not-suupoting-hashing-in-url/240519 "2020-07-10T05:56:59Z")
We are using search ui library that allows to quickly implement search experience leveraging Elasticsearch. We have used hashing in the url routing (which generate the url like this http://www.example.com/#/Search, it i… --- ## [Indian currency abbreviation format](https://discuss.elastic.co/t/indian-currency-abbreviation-format/239916)
**Author:** [@DILIP\_SHARMA](https://discuss.elastic.co/u/DILIP_SHARMA)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 5:45am UTC](https://discuss.elastic.co/t/indian-currency-abbreviation-format/239916 "2020-07-10T05:45:10Z")
Hi , i am trying abbreviation the big number in kibana, i know there is abb. like million billion changing the format to 0.00a . but i want to in indan format , which is 100 k= 1 lakh 1 million = 10 lakh 10 millio… --- ## [How to create a new field combining values of other field values](https://discuss.elastic.co/t/how-to-create-a-new-field-combining-values-of-other-field-values/238087)
**Author:** [@Matish\_Bhuyan](https://discuss.elastic.co/u/Matish_Bhuyan)\ **Replies:** 36\ **Last updated:** [July 10, 2020, 5:32am UTC](https://discuss.elastic.co/t/how-to-create-a-new-field-combining-values-of-other-field-values/238087 "2020-07-10T05:32:08Z")
Hi All, I am using elk version 7.2 I have two keywords 1- result 2 - service using the values of these keywords i want to create another field which will met the condition and keep the data according to the conditio… --- ## [Unstrucutred data](https://discuss.elastic.co/t/unstrucutred-data/240644)
**Author:** [@kluvi](https://discuss.elastic.co/u/kluvi)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 5:10am UTC](https://discuss.elastic.co/t/unstrucutred-data/240644 "2020-07-10T05:10:57Z")
Hi. We are currently using Elasticsearch as our primary database for some data about products. One document in Elasticsearch is one product, which have some predictable properties (like price, name,...). This products a… --- ## [Elasticsearch: empty slices when using scroll api with slice](https://discuss.elastic.co/t/elasticsearch-empty-slices-when-using-scroll-api-with-slice/239586)
**Author:** [@PierreC](https://discuss.elastic.co/u/PierreC)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 5:00am UTC](https://discuss.elastic.co/t/elasticsearch-empty-slices-when-using-scroll-api-with-slice/239586 "2020-07-10T05:00:01Z")
I have a simple setup with a green cluster (v7.5.2) of 1 instance with 1 index (replica 0) with 8 shards. 61,500 documents indexed. If I create 8 slices with these queries (POST queries) http://localhost:9202/products… --- ## [Logstash 7.6.2 (EPIPE) Broken pipe Error (pipeline stopped processing new events)](https://discuss.elastic.co/t/logstash-7-6-2-epipe-broken-pipe-error-pipeline-stopped-processing-new-events/238366)
**Author:** [@iscorpio23](https://discuss.elastic.co/u/iscorpio23)\ **Replies:** 3\ **Last updated:** [July 10, 2020, 4:48am UTC](https://discuss.elastic.co/t/logstash-7-6-2-epipe-broken-pipe-error-pipeline-stopped-processing-new-events/238366 "2020-07-10T04:48:22Z")
Hi All, Just upgrade Logstash version from version 6.2.3 to 7.6.2 by RPM upgrade and i have 9 pipeline. Logstash will push log to Elasticsearch cloud version 7.4. After the upgrade, log can be seen in Kibana, but daily … --- ## [How to run or test Logstash pipeline?](https://discuss.elastic.co/t/how-to-run-or-test-logstash-pipeline/240638)
**Author:** [@prabhpahul](https://discuss.elastic.co/u/prabhpahul)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 4:05am UTC](https://discuss.elastic.co/t/how-to-run-or-test-logstash-pipeline/240638 "2020-07-10T04:05:24Z")
I am trying to build a logstash pipeline to pool data from sql server continuously. But I am not able to test the pipeline on the cloud? --- ## [Remote cluster connected but not listed](https://discuss.elastic.co/t/remote-cluster-connected-but-not-listed/238203)
**Author:** [@Sebastian\_Treu](https://discuss.elastic.co/u/Sebastian_Treu)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 3:14am UTC](https://discuss.elastic.co/t/remote-cluster-connected-but-not-listed/238203 "2020-07-10T03:14:47Z")
Hey there, I'm trying to connect a local cluster (7.8.0) with a remote cluster (7.3.2) where both has secured xpack.security.transport.ssl.enabled=true with the same certificate, key and ca, and both are deployed using d… --- ## [Check if a value of a field has changed in a single query](https://discuss.elastic.co/t/check-if-a-value-of-a-field-has-changed-in-a-single-query/240629)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 2:16am UTC](https://discuss.elastic.co/t/check-if-a-value-of-a-field-has-changed-in-a-single-query/240629 "2020-07-10T02:16:07Z")
Hi, Its is posible to check if a value of a field has changed in a single query? Maybe comparing the last value with the actual value? --- ## [Installing elasticsearch for Graylog](https://discuss.elastic.co/t/installing-elasticsearch-for-graylog/240624)
**Author:** [@Morgan\_Hausmann](https://discuss.elastic.co/u/Morgan_Hausmann)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 1:29am UTC](https://discuss.elastic.co/t/installing-elasticsearch-for-graylog/240624 "2020-07-10T01:29:55Z")
Trying to install and start elasticsearch to get Graylog working. I've been following the steps from the link above but for Amazon AMI Linux. Getting this error and I cannot figure out what's going on. --- ## [Problem with URL field](https://discuss.elastic.co/t/problem-with-url-field/239748)
**Author:** [@kvtang](https://discuss.elastic.co/u/kvtang)\ **Replies:** 4\ **Last updated:** [July 10, 2020, 1:19am UTC](https://discuss.elastic.co/t/problem-with-url-field/239748 "2020-07-10T01:19:44Z")
Hi all, Currently I have a "log" field which is pointed to a Windows file share. However, when I try to change the format of "log" to URL, it seems to add https://... before my file share and changed all backslash into … --- ## [ML node restart, job recovery](https://discuss.elastic.co/t/ml-node-restart-job-recovery/240441)
**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 1:14am UTC](https://discuss.elastic.co/t/ml-node-restart-job-recovery/240441 "2020-07-10T01:14:00Z")
Hi If all available ML nodes are incidentally restarted and all running jobs go into an open/stopped mode, what would be the recommended way to resume all jobs? I've been able to start the datafeed manually for each sto… --- ## [Controls showing one value in kibana 7.1](https://discuss.elastic.co/t/controls-showing-one-value-in-kibana-7-1/240569)
**Author:** [@renu\_jessi](https://discuss.elastic.co/u/renu_jessi)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 12:09am UTC](https://discuss.elastic.co/t/controls-showing-one-value-in-kibana-7-1/240569 "2020-07-10T00:09:19Z")
Hi, Iam getting only one value in control dropdown visualization even though index has multiple values. i searched every where thr solution is lilr upgrading kibana version. but my customer insisting on 7.1.1 version on… --- ## [Logstash since\_db =\> "NUL" not forcing reload](https://discuss.elastic.co/t/logstash-since-db-nul-not-forcing-reload/240566)
**Author:** [@noamc](https://discuss.elastic.co/u/noamc)\ **Replies:** 7\ **Last updated:** [July 9, 2020, 10:11pm UTC](https://discuss.elastic.co/t/logstash-since-db-nul-not-forcing-reload/240566 "2020-07-09T22:11:30Z")
Hello all, I've built a ELK stack that loads a CSV on an hourly basis. The CSV is of all our tasks from jira, and so every change in an issue gets updated in the CSV, and needs to be reloaded to Kibana. The stack works… --- ## [Index two parts of document in two different index](https://discuss.elastic.co/t/index-two-parts-of-document-in-two-different-index/240609)
**Author:** [@Bouraoui\_Kacem](https://discuss.elastic.co/u/Bouraoui_Kacem)\ **Replies:** 1\ **Last updated:** [July 9, 2020, 9:53pm UTC](https://discuss.elastic.co/t/index-two-parts-of-document-in-two-different-index/240609 "2020-07-09T21:53:51Z")
I received a document which contains an array of objects , i want to index all the document in index1 and the content of the array in indexTwo , how can i configure that with logstash please with filter and output ? --- ## [Query ES API for a Geofence Containing Most Docs](https://discuss.elastic.co/t/query-es-api-for-a-geofence-containing-most-docs/105303)
**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\ **Replies:** 1\ **Last updated:** [July 9, 2020, 9:35pm UTC](https://discuss.elastic.co/t/query-es-api-for-a-geofence-containing-most-docs/105303 "2020-07-09T21:35:44Z")
ES v5.6.2 I have a use case where I need to determine a geofence containing a large numbers of requests. It would be nice to get any geofence with \>10% of requests, however this ask is flexible depending on what's possi… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1938) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1940)