# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1345 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1346 --- ## [How to make elasticsearch returns products from stores that deliver to the user's region?](https://discuss.elastic.co/t/how-to-make-elasticsearch-returns-products-from-stores-that-deliver-to-the-users-region/277234)
**Author:** [@ironzep](https://discuss.elastic.co/u/ironzep)\ **Replies:** 1\ **Last updated:** [June 29, 2021, 2:01am UTC](https://discuss.elastic.co/t/how-to-make-elasticsearch-returns-products-from-stores-that-deliver-to-the-users-region/277234 "2021-06-29T02:01:06Z")
I am struggling with this for a time. The scenario is the following: I have an elasticsearch index which has products and each product has a store. The store has fields that store its latitude, longitude and the max dist… --- ## [I can't do any snapshot related task due to error "No space left on device"](https://discuss.elastic.co/t/i-cant-do-any-snapshot-related-task-due-to-error-no-space-left-on-device/277258)
**Author:** [@valleram](https://discuss.elastic.co/u/valleram)\ **Replies:** 1\ **Last updated:** [June 29, 2021, 1:39am UTC](https://discuss.elastic.co/t/i-cant-do-any-snapshot-related-task-due-to-error-no-space-left-on-device/277258 "2021-06-29T01:39:28Z")
Hi All, The snapshot repository I've registered on my cluster is full. I've being trying to delete some of older snapshots but I keep receiving "No Space left on device" error message. I tried deleting them directly t… --- ## [Shard Allocation Failures After 5 Retries](https://discuss.elastic.co/t/shard-allocation-failures-after-5-retries/276969)
**Author:** [@xianhechen](https://discuss.elastic.co/u/xianhechen)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 11:54pm UTC](https://discuss.elastic.co/t/shard-allocation-failures-after-5-retries/276969 "2021-06-28T23:54:03Z")
Hi, We have a 23 nodes cluster with 5 master nodes, 3 coordinator nodes, and 15 data nodes. Our index has a total of 30 primary shards and 3 replicas. Size of the index is around 800Gb. Earlier this week we found that t… --- ## [Figure out shard size from size before creating Elasticsearch index in python](https://discuss.elastic.co/t/figure-out-shard-size-from-size-before-creating-elasticsearch-index-in-python/276302)
**Author:** [@NLSVTN](https://discuss.elastic.co/u/NLSVTN)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 9:45pm UTC](https://discuss.elastic.co/t/figure-out-shard-size-from-size-before-creating-elasticsearch-index-in-python/276302 "2021-06-28T21:45:32Z")
Hi, We need to know the size of each shard before creating an index in ES. We are using Hail python library, and have MatrixTable that we convert to Table, and then write to Elasticsearch: mt = mt.rows() # Converts ne… --- ## [Kibana Lens - Drop partial buckets](https://discuss.elastic.co/t/kibana-lens-drop-partial-buckets/277244)
**Author:** [@Dennis1](https://discuss.elastic.co/u/Dennis1)\ **Replies:** 7\ **Last updated:** [June 28, 2021, 9:29pm UTC](https://discuss.elastic.co/t/kibana-lens-drop-partial-buckets/277244 "2021-06-28T21:29:37Z")
Is there planned work to include the option to drop partial buckets in Kibana Lens visualizations? We are currently trying to display data aggregations grouped by year, but when we select a specific year, the data from … --- ## [Logstash Create new field from existing field and remove character from new field](https://discuss.elastic.co/t/logstash-create-new-field-from-existing-field-and-remove-character-from-new-field/277268)
**Author:** [@Annette1](https://discuss.elastic.co/u/Annette1)\ **Replies:** 4\ **Last updated:** [June 28, 2021, 9:16pm UTC](https://discuss.elastic.co/t/logstash-create-new-field-from-existing-field-and-remove-character-from-new-field/277268 "2021-06-28T21:16:45Z")
I have a simple request but seem unable to be able execute it correctly. I have a field named logname that has several name forms. For instance are logname-app, logname-os, logname-access, and logname. The logname is … --- ## [Setting the default route for Kibana](https://discuss.elastic.co/t/setting-the-default-route-for-kibana/277270)
**Author:** [@Rafael\_Ribeiro](https://discuss.elastic.co/u/Rafael_Ribeiro)\ **Replies:** 1\ **Last updated:** [June 28, 2021, 9:15pm UTC](https://discuss.elastic.co/t/setting-the-default-route-for-kibana/277270 "2021-06-28T21:15:50Z")
Hello, I am trying to change the default route for Kibana on Stack Management \> Advanced Settings to /app/discover. But every time I log into Kibana, I am redirected to /app/home. I am using Elasticsearch 7.10 (AWS man… --- ## [Which node to connect to](https://discuss.elastic.co/t/which-node-to-connect-to/276408)
**Author:** [@Bo-Wyatt](https://discuss.elastic.co/u/Bo-Wyatt)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 7:55pm UTC](https://discuss.elastic.co/t/which-node-to-connect-to/276408 "2021-06-28T19:55:55Z")
Hello, this is a dum question. But I have two nodes on my cluster (One is master). And I always use the master IP (or URL) to fetch for Info, for example in my Grafana data source I use the Node1 URL to Connect. Is alwa… --- ## [High system load during search when total index size is large](https://discuss.elastic.co/t/high-system-load-during-search-when-total-index-size-is-large/274439)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 8\ **Last updated:** [June 28, 2021, 6:56pm UTC](https://discuss.elastic.co/t/high-system-load-during-search-when-total-index-size-is-large/274439 "2021-06-28T18:56:56Z")
I have a cluster setup where some nodes can experience high system load for a specific index. Index The index is time-based, and is named as such: index-2021.03 index-2021.04 index-2021.05 In other words, I begin a n… --- ## [How can I make a visualization where only the latest data point is a different color?](https://discuss.elastic.co/t/how-can-i-make-a-visualization-where-only-the-latest-data-point-is-a-different-color/277136)
**Author:** [@blackberrySherbet](https://discuss.elastic.co/u/blackberrySherbet)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 6:53pm UTC](https://discuss.elastic.co/t/how-can-i-make-a-visualization-where-only-the-latest-data-point-is-a-different-color/277136 "2021-06-28T18:53:59Z")
As titled. I want to create a line graph of one metric versus another and the most recent (chronologically) must be one colour and everything else another colour. How can I do this? I'd like to avoid vega if I can. --- ## [Configure filebeat to route logs from providers (with hints enabled) to specific elastic instances](https://discuss.elastic.co/t/configure-filebeat-to-route-logs-from-providers-with-hints-enabled-to-specific-elastic-instances/277267)
**Author:** [@mitesh](https://discuss.elastic.co/u/mitesh)\ **Replies:** 0\ **Last updated:** [June 28, 2021, 6:48pm UTC](https://discuss.elastic.co/t/configure-filebeat-to-route-logs-from-providers-with-hints-enabled-to-specific-elastic-instances/277267 "2021-06-28T18:48:11Z")
Hi, I am quite new to the ELK stack and would appreciate some guidance on the brief mentioned in the subject. My goal is to have multiple providers (nginx1, nginx2) broadcasting beats events with hints enabled to fileb… --- ## [Output Using CEF codec and to Kafka Server](https://discuss.elastic.co/t/output-using-cef-codec-and-to-kafka-server/277243)
**Author:** [@Wilks](https://discuss.elastic.co/u/Wilks)\ **Replies:** 4\ **Last updated:** [June 28, 2021, 6:34pm UTC](https://discuss.elastic.co/t/output-using-cef-codec-and-to-kafka-server/277243 "2021-06-28T18:34:01Z")
Hi, Is there a way to nest the Output statement so that I can first output using the CEF codec and then Output to a Kafka topic. The requirement is that I have to covert the data to CEF and then send to a Kafka topic. … --- ## [How to build a plugin for a not yet released version?](https://discuss.elastic.co/t/how-to-build-a-plugin-for-a-not-yet-released-version/276833)
**Author:** [@rafis](https://discuss.elastic.co/u/rafis)\ **Replies:** 6\ **Last updated:** [June 28, 2021, 6:21pm UTC](https://discuss.elastic.co/t/how-to-build-a-plugin-for-a-not-yet-released-version/276833 "2021-06-28T18:21:04Z")
Hello, I need to test a fix for elasticsearch 7.14.0 code with my plugin installed. The plugin version must match to be installed, but the latest publicly available build-tools is 7.13.2. I can build elasticsearch-7.14.… --- ## [Find newly added Event that have a unique ID](https://discuss.elastic.co/t/find-newly-added-event-that-have-a-unique-id/276690)
**Author:** [@Zentas](https://discuss.elastic.co/u/Zentas)\ **Replies:** 5\ **Last updated:** [June 28, 2021, 6:10pm UTC](https://discuss.elastic.co/t/find-newly-added-event-that-have-a-unique-id/276690 "2021-06-28T18:10:29Z")
Hello, is there any existing feature or way to do this? I need to see Data that has been newly added (fresh ID) in a specific time frame. Example: Time 12:00 Data: Ex 1 - ID: 1 - Name: ... Ex 2 - ID: 2 - Name: ... … --- ## [Can not purge Logstash](https://discuss.elastic.co/t/can-not-purge-logstash/277225)
**Author:** [@Vladimir](https://discuss.elastic.co/u/Vladimir)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 5:44pm UTC](https://discuss.elastic.co/t/can-not-purge-logstash/277225 "2021-06-28T17:44:17Z")
Hi, can somebody help me please to remove logstash from Ubuntu? I had a broken Elastic + Kibana + Logstash + Filebeat installtion so I decided to remove it completely and start installation again. All packages are gone … --- ## [How to convert logstash elasticsearch plugin in ingest pipeline?](https://discuss.elastic.co/t/how-to-convert-logstash-elasticsearch-plugin-in-ingest-pipeline/277156)
**Author:** [@crpj](https://discuss.elastic.co/u/crpj)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 5:38pm UTC](https://discuss.elastic.co/t/how-to-convert-logstash-elasticsearch-plugin-in-ingest-pipeline/277156 "2021-06-28T17:38:41Z")
Hello, I would like to know if and how it is possible to use the logstash elasticsearch plugin in an ingest pipeline, currently the use of a workaround in logstash which enables enriching data based in a query from ano… --- ## [Alphabetically sort name field](https://discuss.elastic.co/t/alphabetically-sort-name-field/276505)
**Author:** [@gautamz07](https://discuss.elastic.co/u/gautamz07)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 5:26pm UTC](https://discuss.elastic.co/t/alphabetically-sort-name-field/276505 "2021-06-28T17:26:13Z")
I have the following definition for the name field "name": { "type": "text", "fields": { "keyword": { "type": "keyword", "ignore\_above": 256 } } }, How do i sort this alphabetically ? I am tr… --- ## [Grok pattern not working with spaces](https://discuss.elastic.co/t/grok-pattern-not-working-with-spaces/277254)
**Author:** [@kriss332](https://discuss.elastic.co/u/kriss332)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 4:54pm UTC](https://discuss.elastic.co/t/grok-pattern-not-working-with-spaces/277254 "2021-06-28T16:54:40Z")
Hi all , I am trying to get a pattern for tbelow log in GrokDebugger site. Jun 27 00:00:12 location2-squid2 SQUID 1624732203.029 877 172.1.1.1 TCP\_MISS/200 70205 GET http://10.10.1.1/v1/loading/summary? - HIER\_DIRECT… --- ## [Problem install logstash-7.13.2-x86](https://discuss.elastic.co/t/problem-install-logstash-7-13-2-x86/277249)
**Author:** [@mylogstash](https://discuss.elastic.co/u/mylogstash)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 4:22pm UTC](https://discuss.elastic.co/t/problem-install-logstash-7-13-2-x86/277249 "2021-06-28T16:22:53Z")
On Centos 7.9 During upgrade of logstash-7.13.2-x86 the ownership /usr/share/logstash changes from logstash:logstash to root:root. Why does the installation changes the owner of /usr/share/logstash ? --- ## [Proximity searches](https://discuss.elastic.co/t/proximity-searches/276850)
**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 3:49pm UTC](https://discuss.elastic.co/t/proximity-searches/276850 "2021-06-28T15:49:02Z")
I’m trying to achieve Proximity searches with whole wild card, • (Alice \* Bob) NEAR/4 (Sam \* \* John): find all the documents having the phrase “Alice \* Bob” within 4 words distance to “Sam \* \* John”. I’ve tried followi… --- ## [Custom Domain Name](https://discuss.elastic.co/t/custom-domain-name/276056)
**Author:** [@andremarzo](https://discuss.elastic.co/u/andremarzo)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 3:45pm UTC](https://discuss.elastic.co/t/custom-domain-name/276056 "2021-06-28T15:45:03Z")
I am using cloud.elastic.co instance but it provides you long URL to access ES like XXXXXXXXXXXXXX.us-east-xx.aws.found.io How is possible to use your own domain name with elastic cloud instance? --- ## [Not whitelisted in reindex.remote.whitelist error with Docker clusters](https://discuss.elastic.co/t/not-whitelisted-in-reindex-remote-whitelist-error-with-docker-clusters/277253)
**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\ **Replies:** 0\ **Last updated:** [June 28, 2021, 3:39pm UTC](https://discuss.elastic.co/t/not-whitelisted-in-reindex-remote-whitelist-error-with-docker-clusters/277253 "2021-06-28T15:39:28Z")
I have 2 ES docker clusters. I want to re-index some indexes from the smaller docker es cluster to my larger es docker cluster. When i follow the instructions to reindex i get the "not whitelisted in reindex.remote.wh… --- ## [Yet again a run with on prem package-registry issue](https://discuss.elastic.co/t/yet-again-a-run-with-on-prem-package-registry-issue/276294)
**Author:** [@DartShinigami](https://discuss.elastic.co/u/DartShinigami)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 3:12pm UTC](https://discuss.elastic.co/t/yet-again-a-run-with-on-prem-package-registry-issue/276294 "2021-06-28T15:12:07Z")
I tried the workaround but with no luck any inside that you could provide me. I'm using kibana and elastic on docker ubuntu 20.04 here is my docker compose file for kibana. kib01: image: docker.elastic.co/kibana/kib… --- ## [Search Rate zero in Kibana monitoring dashboard for Suggestion Queries](https://discuss.elastic.co/t/search-rate-zero-in-kibana-monitoring-dashboard-for-suggestion-queries/277197)
**Author:** [@Rosita\_Andrade](https://discuss.elastic.co/u/Rosita_Andrade)\ **Replies:** 0\ **Last updated:** [June 28, 2021, 10:06am UTC](https://discuss.elastic.co/t/search-rate-zero-in-kibana-monitoring-dashboard-for-suggestion-queries/277197 "2021-06-28T10:06:13Z")
Hey guys, I have an index where all the queries to it are Suggestion Queries. The Kibana monitoring shows the correct indexing rate but the search rate is always 0. When I checked the stats for the index using the stats … --- ## [How can I build verticalBar chart based on some custom calculation](https://discuss.elastic.co/t/how-can-i-build-verticalbar-chart-based-on-some-custom-calculation/276964)
**Author:** [@vivu007x](https://discuss.elastic.co/u/vivu007x)\ **Replies:** 4\ **Last updated:** [June 28, 2021, 2:38pm UTC](https://discuss.elastic.co/t/how-can-i-build-verticalbar-chart-based-on-some-custom-calculation/276964 "2021-06-28T14:38:13Z")
Hi, I have created a VerticalBar chart in Kibana. I used the Metrics and Buckets option to choose the index and terms. Say, totalValue is an index with values \[available/offline/suspended\] errorValue is an index w… --- ## [elasticsearch-7.14.0-SNAPSHOT and 7.x branch depend on different versions of lucene](https://discuss.elastic.co/t/elasticsearch-7-14-0-snapshot-and-7-x-branch-depend-on-different-versions-of-lucene/277216)
**Author:** [@rafis](https://discuss.elastic.co/u/rafis)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 1:46pm UTC](https://discuss.elastic.co/t/elasticsearch-7-14-0-snapshot-and-7-x-branch-depend-on-different-versions-of-lucene/277216 "2021-06-28T13:46:54Z")
Hello, https://snapshots.elastic.co/maven/org/elasticsearch/elasticsearch/7.14.0-SNAPSHOT/elasticsearch-7.14.0-SNAPSHOT.pom depends on lucene 8.9.0-snapshot-ddc238e5df8, but 7.x branch of elasticsearch repository - on 8… --- ## [Does Kibana use python in runtime?](https://discuss.elastic.co/t/does-kibana-use-python-in-runtime/277017)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 12:40pm UTC](https://discuss.elastic.co/t/does-kibana-use-python-in-runtime/277017 "2021-06-28T12:40:04Z")
We saw that xpack has few py files. Hence if we bundle rpm, rpmbuild expects /usr/bin/python. RHEL seems not having python as they have upgraded to python3. So I just wanted to know whether Kibana use python for runtim… --- ## [Kibana7.13 development problems](https://discuss.elastic.co/t/kibana7-13-development-problems/276975)
**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\ **Replies:** 3\ **Last updated:** [June 28, 2021, 12:36pm UTC](https://discuss.elastic.co/t/kibana7-13-development-problems/276975 "2021-06-28T12:36:33Z")
Hello all, I hope you are doing well! I have been trying to develop Kibana 7.13 and using yarn 1.22.5 and node v14.16.1. It's been a week since I am trying and nothing's happening. I am using windows 10. somebody aske… --- ## [Long ECS-Logged error.stack\_trace not shown in Kibana-Discover Document-Table](https://discuss.elastic.co/t/long-ecs-logged-error-stack-trace-not-shown-in-kibana-discover-document-table/277222)
**Author:** [@cproinger\_rbigroupit](https://discuss.elastic.co/u/cproinger_rbigroupit)\ **Replies:** 0\ **Last updated:** [June 28, 2021, 12:14pm UTC](https://discuss.elastic.co/t/long-ecs-logged-error-stack-trace-not-shown-in-kibana-discover-document-table/277222 "2021-06-28T12:14:38Z")
The problem is the following: Our Applications use ECS-Logs (Overview | Elastic Common Schema (ECS) Reference \[1.10\] | Elastic) to be indexed by filebeat. We use the default configuration which uses an "ignore\_above: 102… --- ## [Is there any Kibana API endpoint to get index pattern for the current login user or if there is an existing implementation for it?](https://discuss.elastic.co/t/is-there-any-kibana-api-endpoint-to-get-index-pattern-for-the-current-login-user-or-if-there-is-an-existing-implementation-for-it/276941)
**Author:** [@HemaS](https://discuss.elastic.co/u/HemaS)\ **Replies:** 2\ **Last updated:** [June 28, 2021, 11:57am UTC](https://discuss.elastic.co/t/is-there-any-kibana-api-endpoint-to-get-index-pattern-for-the-current-login-user-or-if-there-is-an-existing-implementation-for-it/276941 "2021-06-28T11:57:04Z")
I'm developing custom Kibana plugin and I want to get the current logged in user information from my plugin server. It would be great if any Kibana API endpoint is available to get such details. [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1344) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1346)