# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1545

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1546

---

## [Embedd kibana in customer's own elasticsearch](https://discuss.elastic.co/t/embedd-kibana-in-customers-own-elasticsearch/280215)

<div class="topic-metadata">

**Author:** [@mogi](https://discuss.elastic.co/u/mogi)\
**Replies:** 3\
**Last updated:** [August 3, 2021, 6:49am UTC](https://discuss.elastic.co/t/embedd-kibana-in-customers-own-elasticsearch/280215 "2021-08-03T06:49:47Z")

</div>

We are planning to create dashboard for customers, that use elasticseach as part of our product. By that, we try to build default dashboards, that analyze the same data for each customer, but specified on their on index.…

---

## [Enterprise Search - Error: key not found: "plugins" at org/jruby/RubyHash.java:1261:in \`fetch'](https://discuss.elastic.co/t/enterprise-search-error-key-not-found-plugins-at-org-jruby-rubyhash-javain-fetch/280259)

<div class="topic-metadata">

**Author:** [@manolosolalinde](https://discuss.elastic.co/u/manolosolalinde)\
**Replies:** 1\
**Last updated:** [August 3, 2021, 4:35am UTC](https://discuss.elastic.co/t/enterprise-search-error-key-not-found-plugins-at-org-jruby-rubyhash-javain-fetch/280259 "2021-08-03T04:35:10Z")

</div>

Hi. I'm trying to get Enterprise Search to work using aws elasticsearch service. I have tried using docker with the following configuration: docker run -p 3002:3002 --name app07134 --rm \\ -e elasticsearch.host='https://…

---

## [Cannot access elasticsearch or kibana on browser but able to access within the server using curl](https://discuss.elastic.co/t/cannot-access-elasticsearch-or-kibana-on-browser-but-able-to-access-within-the-server-using-curl/280270)

<div class="topic-metadata">

**Author:** [@Srinivas1602](https://discuss.elastic.co/u/Srinivas1602)\
**Replies:** 2\
**Last updated:** [August 3, 2021, 4:29am UTC](https://discuss.elastic.co/t/cannot-access-elasticsearch-or-kibana-on-browser-but-able-to-access-within-the-server-using-curl/280270 "2021-08-03T04:29:48Z")

</div>

Hi, I am facing a problem while connecting to elastic search urls on browser. I have an elastic search with one master node and 2 datanodes configured and running on the respective servers. When I curl on the respecti…

---

## [Logstash "Rejected mapping update", not sure how to rectify the situation](https://discuss.elastic.co/t/logstash-rejected-mapping-update-not-sure-how-to-rectify-the-situation/280269)

<div class="topic-metadata">

**Author:** [@CameronCenic](https://discuss.elastic.co/u/CameronCenic)\
**Replies:** 5\
**Last updated:** [August 3, 2021, 4:22am UTC](https://discuss.elastic.co/t/logstash-rejected-mapping-update-not-sure-how-to-rectify-the-situation/280269 "2021-08-03T04:22:36Z")

</div>

I am seeing an error: Rejecting mapping update to \[logstash-INDEXNAME-2021.08.03\] as the final mapping would have more than 1 type: \[\_doc, doc\] I suspect this is due to me switching my template from using doc to usin…

---

## [Maximum load of a single logstash instance](https://discuss.elastic.co/t/maximum-load-of-a-single-logstash-instance/280205)

<div class="topic-metadata">

**Author:** [@Rahul\_Dey](https://discuss.elastic.co/u/Rahul_Dey)\
**Replies:** 1\
**Last updated:** [August 3, 2021, 4:17am UTC](https://discuss.elastic.co/t/maximum-load-of-a-single-logstash-instance/280205 "2021-08-03T04:17:15Z")

</div>

We have build a logging system using Elastic Stack which is currently ingesting log data from different applications for monitoring. We have plans of adding more applications to our logging system in the future. Only one…

---

## [Logstash Config Error-JAVA](https://discuss.elastic.co/t/logstash-config-error-java/125546)

<div class="topic-metadata">

**Author:** [@Nagu\_R\_Pujari](https://discuss.elastic.co/u/Nagu_R_Pujari)\
**Replies:** 10\
**Last updated:** [August 3, 2021, 3:24am UTC](https://discuss.elastic.co/t/logstash-config-error-java/125546 "2021-08-03T03:24:15Z")

</div>

i have performing basic setup of logstash getting JAVA error. not able to complete the config test. Error: ERROR: Failed to load settings file from "path.settings". Aborting... path.setting=/etc/logstash/logstash.yml, …

---

## [Treating Logs as Milk, not Wine (the art of playing catchup)](https://discuss.elastic.co/t/treating-logs-as-milk-not-wine-the-art-of-playing-catchup/280257)

<div class="topic-metadata">

**Author:** [@cknz](https://discuss.elastic.co/u/cknz)\
**Replies:** 9\
**Last updated:** [August 3, 2021, 3:04am UTC](https://discuss.elastic.co/t/treating-logs-as-milk-not-wine-the-art-of-playing-catchup/280257 "2021-08-03T03:04:29Z")

</div>

I'm have a logging pipeline that looks something like the following: Logstash/Rsyslog/etc (submission) -\> Kafka -\> Logstash (enrichment) -\> Elasticsearch Metrics tells me that the by-far slowest part of my pipeline in …

---

## [Spring cloud gateway distribute to other service, transaction.id is different](https://discuss.elastic.co/t/spring-cloud-gateway-distribute-to-other-service-transaction-id-is-different/280049)

<div class="topic-metadata">

**Author:** [@black295](https://discuss.elastic.co/u/black295)\
**Replies:** 3\
**Last updated:** [August 3, 2021, 2:56am UTC](https://discuss.elastic.co/t/spring-cloud-gateway-distribute-to-other-service-transaction-id-is-different/280049 "2021-08-03T02:56:01Z")

</div>

If you are asking about a problem you are experiencing, please use the following template, as it will help us help you. If you have a different problem, please delete all of this text :slight\_smile: TIP 1: select at lea…

---

## [Elasticsearch Index Shards](https://discuss.elastic.co/t/elasticsearch-index-shards/280206)

<div class="topic-metadata">

**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\
**Replies:** 1\
**Last updated:** [August 3, 2021, 1:47am UTC](https://discuss.elastic.co/t/elasticsearch-index-shards/280206 "2021-08-03T01:47:24Z")

</div>

Hi Im creating an elasticsearch index with 3 shards. But as of today I have single node elasticsearch. I have future plan to have 3 nodes cluster and hence created 3 shards now. Will it be a right approach

---

## [Elastic-agent.exe not running on target](https://discuss.elastic.co/t/elastic-agent-exe-not-running-on-target/279197)

<div class="topic-metadata">

**Author:** [@MKirby](https://discuss.elastic.co/u/MKirby)\
**Replies:** 14\
**Last updated:** [August 3, 2021, 1:20am UTC](https://discuss.elastic.co/t/elastic-agent-exe-not-running-on-target/279197 "2021-08-03T01:20:43Z")

</div>

I have set up a virtual machine to install McAfee ePO and solidcore for testing. So I am taking the opportunity to connect my VM to the Elastic stack. I copied over the Agent and the agent.yml file. Made the changes t…

---

## [Issues with viewing index data in kibana](https://discuss.elastic.co/t/issues-with-viewing-index-data-in-kibana/279452)

<div class="topic-metadata">

**Author:** [@Vajb12](https://discuss.elastic.co/u/Vajb12)\
**Replies:** 4\
**Last updated:** [August 3, 2021, 1:14am UTC](https://discuss.elastic.co/t/issues-with-viewing-index-data-in-kibana/279452 "2021-08-03T01:14:23Z")

</div>

We currently have a pipeline setup in our environment to fetch nginx logs to kibana. In the web server, we have a filebeat configuration to push the nginx logs to logstash server for processing. In logstash server, there…

---

## [ECK: Added nodes and now queries are unable to find stored scripts](https://discuss.elastic.co/t/eck-added-nodes-and-now-queries-are-unable-to-find-stored-scripts/279301)

<div class="topic-metadata">

**Author:** [@Thomas\_Doman](https://discuss.elastic.co/u/Thomas_Doman)\
**Replies:** 12\
**Last updated:** [August 2, 2021, 11:28pm UTC](https://discuss.elastic.co/t/eck-added-nodes-and-now-queries-are-unable-to-find-stored-scripts/279301 "2021-08-02T23:28:18Z")

</div>

ES: 6.8.13 We're in the process of moving from manually maintained ES clusters to Elastic Cloud on Kubernetes (ECK). In our first test environment (a single node cluster), we added 3 ECK nodes. Afterward, all our sear…

---

## [Elasticsearch timeout error on operations](https://discuss.elastic.co/t/elasticsearch-timeout-error-on-operations/280239)

<div class="topic-metadata">

**Author:** [@iuryfukuda](https://discuss.elastic.co/u/iuryfukuda)\
**Replies:** 4\
**Last updated:** [August 2, 2021, 11:22pm UTC](https://discuss.elastic.co/t/elasticsearch-timeout-error-on-operations/280239 "2021-08-02T23:22:46Z")

</div>

We have timeout error on worker clients who use ES go client: time="2021-08-02T16:04:45Z" level=error msg="error handling connection with queue: error saving bulk: error making bulk request dial tcp 20.96.122.135:9200:…

---

## [Update documents based on other updates](https://discuss.elastic.co/t/update-documents-based-on-other-updates/280237)

<div class="topic-metadata">

**Author:** [@nilei](https://discuss.elastic.co/u/nilei)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 10:44pm UTC](https://discuss.elastic.co/t/update-documents-based-on-other-updates/280237 "2021-08-02T22:44:56Z")

</div>

Hi :wave: I have two indices where one of them potentially contains several million documents (let us say index "installation") and the other one only a few hundreds (index "product" for now). Now, I want to update some…

---

## [Need help with filebeat index pattern - Mapping conflict with host.ip](https://discuss.elastic.co/t/need-help-with-filebeat-index-pattern-mapping-conflict-with-host-ip/279673)

<div class="topic-metadata">

**Author:** [@Cdnvballer](https://discuss.elastic.co/u/Cdnvballer)\
**Replies:** 7\
**Last updated:** [August 2, 2021, 10:18pm UTC](https://discuss.elastic.co/t/need-help-with-filebeat-index-pattern-mapping-conflict-with-host-ip/279673 "2021-08-02T22:18:45Z")

</div>

filebeat index pattern shows warning that host.ip is showing both type ip and text. I believe this is somehow related to IPv6 host.ip is in type text and IPv4 host.ip in type ip how do fix this ? at this point I don't …

---

## [Monitoring Cluster Sizing](https://discuss.elastic.co/t/monitoring-cluster-sizing/280229)

<div class="topic-metadata">

**Author:** [@shahidraza](https://discuss.elastic.co/u/shahidraza)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 9:37pm UTC](https://discuss.elastic.co/t/monitoring-cluster-sizing/280229 "2021-08-02T21:37:39Z")

</div>

Hi Team, I want to set up a Monitoring Cluster for my Dev, Test, and Non-Prod & Prod Cluster. Are any hardware sizing documents available for the same which I can refer for standard sizing? Dev and Test one Monitorin…

---

## [Elasticsearch client memory is not getting utilized](https://discuss.elastic.co/t/elasticsearch-client-memory-is-not-getting-utilized/279966)

<div class="topic-metadata">

**Author:** [@Varun\_S](https://discuss.elastic.co/u/Varun_S)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 9:28pm UTC](https://discuss.elastic.co/t/elasticsearch-client-memory-is-not-getting-utilized/279966 "2021-08-02T21:28:18Z")

</div>

Hi Team, We have deployed elasticsearch in kubernetes environment with the below memory and cpu configuration. Data has been pushed to elasticsearch from multiple clients\[7 clients\], elasticsearch data memory is get…

---

## [Is it possible to run a shell script from Kibana?](https://discuss.elastic.co/t/is-it-possible-to-run-a-shell-script-from-kibana/280230)

<div class="topic-metadata">

**Author:** [@danibe](https://discuss.elastic.co/u/danibe)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 9:24pm UTC](https://discuss.elastic.co/t/is-it-possible-to-run-a-shell-script-from-kibana/280230 "2021-08-02T21:24:44Z")

</div>

Is it possible to customize one of the Kibana web pages to have a link/button that runs a shell script (in the server that hosts Kibana) upon clicking it? If so, where do I find documentation or tutorial that explains h…

---

## [SAML Authentication: Forbidden access to deployment](https://discuss.elastic.co/t/saml-authentication-forbidden-access-to-deployment/280096)

<div class="topic-metadata">

**Author:** [@Thomas\_Vaudry-Read](https://discuss.elastic.co/u/Thomas_Vaudry-Read)\
**Replies:** 7\
**Last updated:** [August 2, 2021, 8:39pm UTC](https://discuss.elastic.co/t/saml-authentication-forbidden-access-to-deployment/280096 "2021-08-02T20:39:46Z")

</div>

Hi, I have installed Elastic Cloud Enterprise on an AWS virtual machine, and have a ELK stack deployment configured. I have configured an authentication provider (SAML) to login to ECE. It is working correctly and prope…

---

## [Error connecting to package registry](https://discuss.elastic.co/t/error-connecting-to-package-registry/279721)

<div class="topic-metadata">

**Author:** [@Nil\_Battey\_Sannata](https://discuss.elastic.co/u/Nil_Battey_Sannata)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 7:33pm UTC](https://discuss.elastic.co/t/error-connecting-to-package-registry/279721 "2021-08-02T19:33:00Z")

</div>

Since Zscaler proxy is enabled, My Kibana started giving an error So I simply added Zscaler RootCA.crt to ubuntu server (where ELK is running) in /usr/share/ca-certificates and reconfigured ca-certficates dpkg. Now c…

---

## [Counting faults per region given there are no repeats](https://discuss.elastic.co/t/counting-faults-per-region-given-there-are-no-repeats/279747)

<div class="topic-metadata">

**Author:** [@ammaars](https://discuss.elastic.co/u/ammaars)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 7:18pm UTC](https://discuss.elastic.co/t/counting-faults-per-region-given-there-are-no-repeats/279747 "2021-08-02T19:18:45Z")

</div>

I'm planning on having live data streaming to kibana on elasticsearch. The fields of concern will be "failure" (0 or 1), region (e.g. region 1-12) and a unique endpoint identifier. What I'd like to do is have a query whi…

---

## [ESRALLY : CREATE/DELETE operations fail 100% everytime](https://discuss.elastic.co/t/esrally-create-delete-operations-fail-100-everytime/280162)

<div class="topic-metadata">

**Author:** [@mots](https://discuss.elastic.co/u/mots)\
**Replies:** 2\
**Last updated:** [August 2, 2021, 6:20pm UTC](https://discuss.elastic.co/t/esrally-create-delete-operations-fail-100-everytime/280162 "2021-08-02T18:20:04Z")

</div>

I have created a custom track with 2 documents just to debug this use case. I am running this on a remote target index deployed on AWS. I am trying to debug why my create/delete operations always fail with 100%. I canno…

---

## [Very very new to this](https://discuss.elastic.co/t/very-very-new-to-this/280248)

<div class="topic-metadata">

**Author:** [@vinceisvince](https://discuss.elastic.co/u/vinceisvince)\
**Replies:** 0\
**Last updated:** [August 2, 2021, 6:14pm UTC](https://discuss.elastic.co/t/very-very-new-to-this/280248 "2021-08-02T18:14:18Z")

</div>

I'll do a high level overview. We are using IBM's APIC v10. It uses Kubernetes which I'm all but a few days new to it. They seemt o have used logstash on top of that for their propriety "analytics server". I feel l…

---

## [Logstash strip string from field](https://discuss.elastic.co/t/logstash-strip-string-from-field/280233)

<div class="topic-metadata">

**Author:** [@Hamza\_El\_Aouane](https://discuss.elastic.co/u/Hamza_El_Aouane)\
**Replies:** 8\
**Last updated:** [August 2, 2021, 5:24pm UTC](https://discuss.elastic.co/t/logstash-strip-string-from-field/280233 "2021-08-02T17:24:16Z")

</div>

Hi guys. In my logstash stream, I have a some filter to add a fields which is the merging of other fields. as follow: if \[destinationUserName\] and \[sourceUserName\] { mutate { add\_field =\> { "userID" =\> "%{ad.login…

---

## [Incorrect Postgres Timestamp with Filebeat & ES](https://discuss.elastic.co/t/incorrect-postgres-timestamp-with-filebeat-es/280152)

<div class="topic-metadata">

**Author:** [@kellizer](https://discuss.elastic.co/u/kellizer)\
**Replies:** 6\
**Last updated:** [August 2, 2021, 5:24pm UTC](https://discuss.elastic.co/t/incorrect-postgres-timestamp-with-filebeat-es/280152 "2021-08-02T17:24:00Z")

</div>

I've been knocking my head on this one for days and can't seem to debug what is happening.. I've setup the filebeat module to stream postgres-13 csv logs into ES - everything works great except the time is out of sync (c…

---

## [Drop incoming messages](https://discuss.elastic.co/t/drop-incoming-messages/280236)

<div class="topic-metadata">

**Author:** [@rosboc](https://discuss.elastic.co/u/rosboc)\
**Replies:** 6\
**Last updated:** [August 2, 2021, 5:22pm UTC](https://discuss.elastic.co/t/drop-incoming-messages/280236 "2021-08-02T17:22:44Z")

</div>

Hi, i am using logstash 6.1.1 with following configuration and need to drop messages containing "type= traffic" string and i am not able to get it working. input { udp { port =\> 2514 type =\> "syslog…

---

## [Find documents containing not more terms than in the query with fuzzines](https://discuss.elastic.co/t/find-documents-containing-not-more-terms-than-in-the-query-with-fuzzines/280043)

<div class="topic-metadata">

**Author:** [@karolix1279](https://discuss.elastic.co/u/karolix1279)\
**Replies:** 6\
**Last updated:** [August 2, 2021, 5:19pm UTC](https://discuss.elastic.co/t/find-documents-containing-not-more-terms-than-in-the-query-with-fuzzines/280043 "2021-08-02T17:19:10Z")

</div>

Let's assume there are three documents in database: {name: "John"} {name: "John Brown"} {name: "Brown"} I would like to search documents in the following way: Search: "John". Result: document 1 Search: "John Brown".…

---

## [Urgent help: How to feed live data from Kibana or from Grafana into Excel?](https://discuss.elastic.co/t/urgent-help-how-to-feed-live-data-from-kibana-or-from-grafana-into-excel/280228)

<div class="topic-metadata">

**Author:** [@BIIntern1](https://discuss.elastic.co/u/BIIntern1)\
**Replies:** 2\
**Last updated:** [August 2, 2021, 4:13pm UTC](https://discuss.elastic.co/t/urgent-help-how-to-feed-live-data-from-kibana-or-from-grafana-into-excel/280228 "2021-08-02T16:13:36Z")

</div>

Hi all, I have been trying to create Grafana dashboard for visualization and I have been using Excel for data analysis. I figured out it would be best for me to use “What-if-analysis” in Excel to answer my project quest…

---

## [Sorting fragments returned by hit highlighting](https://discuss.elastic.co/t/sorting-fragments-returned-by-hit-highlighting/278707)

<div class="topic-metadata">

**Author:** [@timforr](https://discuss.elastic.co/u/timforr)\
**Replies:** 1\
**Last updated:** [August 2, 2021, 4:04pm UTC](https://discuss.elastic.co/t/sorting-fragments-returned-by-hit-highlighting/278707 "2021-08-02T16:04:45Z")

</div>

I have documents with multiple content fields which I am getting highlighted fragments from. The fragments from within the same field are sorted according to score, but the order the fields are returned in is random. I…

---

## [Superuser doesn't have access to read a document?](https://discuss.elastic.co/t/superuser-doesnt-have-access-to-read-a-document/280128)

<div class="topic-metadata">

**Author:** [@panagiss](https://discuss.elastic.co/u/panagiss)\
**Replies:** 3\
**Last updated:** [August 2, 2021, 1:43pm UTC](https://discuss.elastic.co/t/superuser-doesnt-have-access-to-read-a-document/280128 "2021-08-02T13:43:26Z")

</div>

This is my user's privileges { "cluster" : \[ "all" \], "global" : \[ \], "indices" : \[ { "names" : \[ "\*" \], "privileges" : \[ "all" \], "allow\_restricted\_indices"…

[Previous page](https://discuss.elastic.co/latest.md?page=1544)

[Next page](https://discuss.elastic.co/latest.md?page=1546)
