# Latest **URL:** https://discuss.elastic.co/latest.md?page=1549 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1550 --- ## [Concerns with scaling Logstash when using the Aggregate filter](https://discuss.elastic.co/t/concerns-with-scaling-logstash-when-using-the-aggregate-filter/279855)
**Author:** [@nsouth](https://discuss.elastic.co/u/nsouth)\ **Replies:** 5\ **Last updated:** [July 30, 2021, 11:26am UTC](https://discuss.elastic.co/t/concerns-with-scaling-logstash-when-using-the-aggregate-filter/279855 "2021-07-30T11:26:55Z")
The aggregate filter is working great in my testing, but I'm concerned about scale because it is stateful and requires setting filter workers to 1 (-w 1 flag). We have about 150 servers, each of which will generate ~2GB … --- ## [Continuously merging documents from multiple indexes](https://discuss.elastic.co/t/continuously-merging-documents-from-multiple-indexes/279953)
**Author:** [@roll](https://discuss.elastic.co/u/roll)\ **Replies:** 2\ **Last updated:** [July 30, 2021, 10:50am UTC](https://discuss.elastic.co/t/continuously-merging-documents-from-multiple-indexes/279953 "2021-07-30T10:50:38Z")
Hi all, I'm fairly new to elasticsearch and have a question regarding merging of documents and removing duplicates. I got the following data structure: topic1: { "\_id": “a12345", "userId" : "x123”, … --- ## [Search\_phase\_execution\_exception (500)](https://discuss.elastic.co/t/search-phase-execution-exception-500/279718)
**Author:** [@fntkg](https://discuss.elastic.co/u/fntkg)\ **Replies:** 0\ **Last updated:** [July 27, 2021, 11:17am UTC](https://discuss.elastic.co/t/search-phase-execution-exception-500/279718 "2021-07-27T11:17:11Z")
When opening apm app in Kibana, i get an error all the time: search\_phase\_execution\_exception (500) and kibana logs (debug mode) doesn't give me any useful info. Can someone give me a hand? :slight\_smile: This is my … --- ## [Get the "request" that a dashboard or a visualization have](https://discuss.elastic.co/t/get-the-request-that-a-dashboard-or-a-visualization-have/279769)
**Author:** [@aza-zil](https://discuss.elastic.co/u/aza-zil)\ **Replies:** 1\ **Last updated:** [July 30, 2021, 10:44am UTC](https://discuss.elastic.co/t/get-the-request-that-a-dashboard-or-a-visualization-have/279769 "2021-07-30T10:44:27Z")
Hey, is there anyway to get the request that a dashboard or a visualization uses to get the data programmatically? Or is there any api that I can use to get the data of a dashboard? thanks --- ## [Kibana monitoring with Metricbeat](https://discuss.elastic.co/t/kibana-monitoring-with-metricbeat/279728)
**Author:** [@PraveenKT](https://discuss.elastic.co/u/PraveenKT)\ **Replies:** 1\ **Last updated:** [July 30, 2021, 10:16am UTC](https://discuss.elastic.co/t/kibana-monitoring-with-metricbeat/279728 "2021-07-30T10:16:55Z")
I am trying to monitor kibana with Metricbeat kibana-xpack. But i am getting below log messages. Jul 27 05:47:09 xxxxxxxxx metricbeat\[149229\]: 2021-07-27T05:47:09.110-0700#011ERROR#011\[kibana.stats\]#011stats/stats.go:79… --- ## [Limit ElasticSearch repetitive logs after exception](https://discuss.elastic.co/t/limit-elasticsearch-repetitive-logs-after-exception/279695)
**Author:** [@Stefan\_Speranta](https://discuss.elastic.co/u/Stefan_Speranta)\ **Replies:** 0\ **Last updated:** [July 27, 2021, 7:28am UTC](https://discuss.elastic.co/t/limit-elasticsearch-repetitive-logs-after-exception/279695 "2021-07-27T07:28:50Z")
Hi, We have developed a project using Elastic, Logstash and Kibana as log management. After some site attacks one area of application got into endless loops of exceptions and filled Elastic with the same log massage ag… --- ## [How to pass parameter filter from dashboard to Visualize Kibana](https://discuss.elastic.co/t/how-to-pass-parameter-filter-from-dashboard-to-visualize-kibana/279948)
**Author:** [@HuongCV](https://discuss.elastic.co/u/HuongCV)\ **Replies:** 4\ **Last updated:** [July 30, 2021, 9:46am UTC](https://discuss.elastic.co/t/how-to-pass-parameter-filter-from-dashboard-to-visualize-kibana/279948 "2021-07-30T09:46:51Z")
Hi all, In Dashboard, I have range filter: confirmation\_year from A year to B year. In Elastic have field dead\_year. In metric Visualize , I want to count documents that satisfy the condition: 'dead\_year' less than or… --- ## [How to get all buckets of last 24hrs in date histogram](https://discuss.elastic.co/t/how-to-get-all-buckets-of-last-24hrs-in-date-histogram/279616)
**Author:** [@prathamesh7](https://discuss.elastic.co/u/prathamesh7)\ **Replies:** 1\ **Last updated:** [July 30, 2021, 9:45am UTC](https://discuss.elastic.co/t/how-to-get-all-buckets-of-last-24hrs-in-date-histogram/279616 "2021-07-30T09:45:42Z")
Hi All, I am using Date Histogram with Minimum interval as Hourly to get the results of Last 24 Hours and getting below graph. (v is 7.4) The request is , GET access\*/\_search?pretty=true { "aggs": { "2": { … --- ## [Logstash. Mutate's split doesn't split string](https://discuss.elastic.co/t/logstash-mutates-split-doesnt-split-string/280035)
**Author:** [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)\ **Replies:** 1\ **Last updated:** [July 30, 2021, 9:28am UTC](https://discuss.elastic.co/t/logstash-mutates-split-doesnt-split-string/280035 "2021-07-30T09:28:14Z")
Hi, community. I have field "temp" with this value: "2.4.3-371989". I want split it by dots. With this purpose I use mutate filter this way: mutate { split =\> \["temp", "."\] } But after split "temp" field still equals… --- ## [Unknown setting \[index.lifecycl.parse\_origination\_date\]](https://discuss.elastic.co/t/unknown-setting-index-lifecycl-parse-origination-date/279937)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 2\ **Last updated:** [July 30, 2021, 9:17am UTC](https://discuss.elastic.co/t/unknown-setting-index-lifecycl-parse-origination-date/279937 "2021-07-30T09:17:36Z")
I wan to reindex my old index.If i do reindexing it will create new index and the old index which should be deleted on 30 days of rollover (that time) and new index will delete after 30 days even if delete old index man… --- ## [What is the highest version of Elasticsearch Sentinl can currently support? 7. X support?](https://discuss.elastic.co/t/what-is-the-highest-version-of-elasticsearch-sentinl-can-currently-support-7-x-support/278605)
**Author:** [@liuliugang](https://discuss.elastic.co/u/liuliugang)\ **Replies:** 1\ **Last updated:** [July 22, 2021, 9:38am UTC](https://discuss.elastic.co/t/what-is-the-highest-version-of-elasticsearch-sentinl-can-currently-support-7-x-support/278605 "2021-07-22T09:38:18Z")
sentinl: thanks --- ## [Logstash stopped due to an error in one of the pipeline configurations](https://discuss.elastic.co/t/logstash-stopped-due-to-an-error-in-one-of-the-pipeline-configurations/279574)
**Author:** [@subash](https://discuss.elastic.co/u/subash)\ **Replies:** 5\ **Last updated:** [July 30, 2021, 7:25am UTC](https://discuss.elastic.co/t/logstash-stopped-due-to-an-error-in-one-of-the-pipeline-configurations/279574 "2021-07-30T07:25:20Z")
We have 10 conf files running in pipeline. The problem is, if any one of the pipeline configurations has some errors then the entire Logstash instance stops though the other pipeline configurations has no errors. How do … --- ## [API Authorization](https://discuss.elastic.co/t/api-authorization/280033)
**Author:** [@shashikant.deshmukh](https://discuss.elastic.co/u/shashikant.deshmukh)\ **Replies:** 2\ **Last updated:** [July 30, 2021, 6:14am UTC](https://discuss.elastic.co/t/api-authorization/280033 "2021-07-30T06:14:18Z")
Dear Expert, I am new to ELK. I need your help to achieve below Request API 1 =\> https://\*\*\*\*\*\*\*\*\*\*\*/api/Account/Authenticate Parameter to pass { "tenancyName": "", "usernameOrEmailAddress": "", "password": "\*\*\*\*… --- ## [How to calculate the elapsed time of a flag status per day?](https://discuss.elastic.co/t/how-to-calculate-the-elapsed-time-of-a-flag-status-per-day/279494)
**Author:** [@MaximeG](https://discuss.elastic.co/u/MaximeG)\ **Replies:** 11\ **Last updated:** [July 30, 2021, 6:35am UTC](https://discuss.elastic.co/t/how-to-calculate-the-elapsed-time-of-a-flag-status-per-day/279494 "2021-07-30T06:35:11Z")
I'd like to figure out the elapsed time between flag status changes. Simplified example : a person can only be sad or happy. I'd like to know how long each mood was active until it changed. I'm looking for a general be… --- ## [Seeing if its possible to add a timeout to the sample web session detail script](https://discuss.elastic.co/t/seeing-if-its-possible-to-add-a-timeout-to-the-sample-web-session-detail-script/279737)
**Author:** [@jjammin92](https://discuss.elastic.co/u/jjammin92)\ **Replies:** 5\ **Last updated:** [July 30, 2021, 6:22am UTC](https://discuss.elastic.co/t/seeing-if-its-possible-to-add-a-timeout-to-the-sample-web-session-detail-script/279737 "2021-07-30T06:22:08Z")
Hello, I've been reviewing different ways to aggregate log messages together that have a start event but no end event. Been struggling with the logstash aggregate filter plugin and was looking at retrofitting an old en… --- ## [How do I set the mandatory insertion of all fields when creating a document](https://discuss.elastic.co/t/how-do-i-set-the-mandatory-insertion-of-all-fields-when-creating-a-document/279849)
**Author:** [@myly-zyr](https://discuss.elastic.co/u/myly-zyr)\ **Replies:** 10\ **Last updated:** [July 30, 2021, 6:00am UTC](https://discuss.elastic.co/t/how-do-i-set-the-mandatory-insertion-of-all-fields-when-creating-a-document/279849 "2021-07-30T06:00:30Z")
In our project, a program does not insert all fields when creating a document, and other programs will report errors when reading the document. I want to set elasticsearch to insert all fields when creating a document. H… --- ## [Search field tags](https://discuss.elastic.co/t/search-field-tags/279932)
**Author:** [@reka.gay](https://discuss.elastic.co/u/reka.gay)\ **Replies:** 2\ **Last updated:** [July 30, 2021, 4:43am UTC](https://discuss.elastic.co/t/search-field-tags/279932 "2021-07-30T04:43:18Z")
My documents have a concept field which has values that act like tags. I would all concepts to be treated individually so I can use them as filters. Imagine e.g. A genre field on a movie database. With the limitation of… --- ## [Timestamp changes in logstash input?](https://discuss.elastic.co/t/timestamp-changes-in-logstash-input/280027)
**Author:** [@jclemons7](https://discuss.elastic.co/u/jclemons7)\ **Replies:** 0\ **Last updated:** [July 30, 2021, 4:28am UTC](https://discuss.elastic.co/t/timestamp-changes-in-logstash-input/280027 "2021-07-30T04:28:37Z")
Hello all, I have had this index going for like at least the last 2 years.. and all of a sudden the timezone seems to not be working correctly. The pipeline has some transforms in it, but nothing touches the @timestamp … --- ## [How can I ingest SharePoint content into AppSearch?](https://discuss.elastic.co/t/how-can-i-ingest-sharepoint-content-into-appsearch/279978)
**Author:** [@kurokaze204](https://discuss.elastic.co/u/kurokaze204)\ **Replies:** 3\ **Last updated:** [July 30, 2021, 3:12am UTC](https://discuss.elastic.co/t/how-can-i-ingest-sharepoint-content-into-appsearch/279978 "2021-07-30T03:12:58Z")
Hi, we have been using AppSearch for several years now as our internal enterprise search engine. We now wish to index SharePoint and HP Trim. Since our rollout, Workplace Search has been released. Is there any way for… --- ## [Is Rust client for Elasticsearch safe for corporation/production use?](https://discuss.elastic.co/t/is-rust-client-for-elasticsearch-safe-for-corporation-production-use/277138)
**Author:** [@odyssey\_2001](https://discuss.elastic.co/u/odyssey_2001)\ **Replies:** 10\ **Last updated:** [July 30, 2021, 2:10am UTC](https://discuss.elastic.co/t/is-rust-client-for-elasticsearch-safe-for-corporation-production-use/277138 "2021-07-30T02:10:48Z")
Hi, I was on Github and I saw that apparently there is an official client for Elasticsearch written in Rust which is a language that I admire a lot. Here is the link. However they say: The project is still very much … --- ## [How to enable Document-level security in Kibana Dashboard](https://discuss.elastic.co/t/how-to-enable-document-level-security-in-kibana-dashboard/279885)
**Author:** [@tong6462](https://discuss.elastic.co/u/tong6462)\ **Replies:** 6\ **Last updated:** [July 30, 2021, 2:03am UTC](https://discuss.elastic.co/t/how-to-enable-document-level-security-in-kibana-dashboard/279885 "2021-07-30T02:03:42Z")
Hi, Is there any way to enable Document-level security in Kibana Dashboard ? --- ## [Error in Elasticsearch cluster on Openshift after restarting nodes](https://discuss.elastic.co/t/error-in-elasticsearch-cluster-on-openshift-after-restarting-nodes/280010)
**Author:** [@fefontana](https://discuss.elastic.co/u/fefontana)\ **Replies:** 7\ **Last updated:** [July 30, 2021, 1:20am UTC](https://discuss.elastic.co/t/error-in-elasticsearch-cluster-on-openshift-after-restarting-nodes/280010 "2021-07-30T01:20:02Z")
Hi there, I have an Elasticsearch cluster 7.13.2 : 2 data nodes 3 master nodes 2 client nodes all of them deployed on Openshift with minimal security enabled. TLS security is not enabled, is not necessary in our case… --- ## [Access Kibana from remote machine](https://discuss.elastic.co/t/access-kibana-from-remote-machine/279924)
**Author:** [@Rickenson\_Robert](https://discuss.elastic.co/u/Rickenson_Robert)\ **Replies:** 10\ **Last updated:** [July 30, 2021, 12:54am UTC](https://discuss.elastic.co/t/access-kibana-from-remote-machine/279924 "2021-07-30T00:54:27Z")
Hi all, I have Kibana running on one machine and I would like to access that instance of Kibana on another machine. That is to say, I want to host Kibana on on my local computer and access it through the web browser of … --- ## [Circuit Breaker Exception - version 5.2.0](https://discuss.elastic.co/t/circuit-breaker-exception-version-5-2-0/279799)
**Author:** [@chateesh](https://discuss.elastic.co/u/chateesh)\ **Replies:** 5\ **Last updated:** [July 30, 2021, 12:26am UTC](https://discuss.elastic.co/t/circuit-breaker-exception-version-5-2-0/279799 "2021-07-30T00:26:18Z")
Hi, Client node is unresponsive and getting error as below "org.elasticsearch.common.breaker.CircuitBreakingException: \[parent\] Data too large, data for \[\\] would be larger than limit of \[24003005644/22.3g… --- ## [Simple way to deploy Elastic Security](https://discuss.elastic.co/t/simple-way-to-deploy-elastic-security/279910)
**Author:** [@lisa99](https://discuss.elastic.co/u/lisa99)\ **Replies:** 3\ **Last updated:** [July 29, 2021, 10:01pm UTC](https://discuss.elastic.co/t/simple-way-to-deploy-elastic-security/279910 "2021-07-29T22:01:18Z")
I am trying to install the Elastic Stack locally on a single VM to keep the setup simple. The use case is Security, which requires installing ELK as well as many configurations here and there to enable features like Ela… --- ## [Observability Engineer Lab 4.4: Enrich policy](https://discuss.elastic.co/t/observability-engineer-lab-4-4-enrich-policy/279536)
**Author:** [@StashLogs](https://discuss.elastic.co/u/StashLogs)\ **Replies:** 5\ **Last updated:** [July 29, 2021, 9:38pm UTC](https://discuss.elastic.co/t/observability-engineer-lab-4-4-enrich-policy/279536 "2021-07-29T21:38:51Z")
Hi, I was following the lab to enrich the geo city/zip code using the enrich policy creation steps. The city name that showed up for me showed the wrong zip code as the address index contains many states with the same c… --- ## [Http Broken Pipe](https://discuss.elastic.co/t/http-broken-pipe/280003)
**Author:** [@tofubeats](https://discuss.elastic.co/u/tofubeats)\ **Replies:** 0\ **Last updated:** [July 29, 2021, 4:12pm UTC](https://discuss.elastic.co/t/http-broken-pipe/280003 "2021-07-29T16:12:36Z")
Hello, I'm new to Elasticstack. I am using HTTP output plugin but am getting the following error: \[\[main\]\>worker2\] http - \[HTTP Output Failure\] Could not fetch URL {:url=\>"https://{{fqdn}}:5059", :method=\>:post, :messa… --- ## [What all shards are included in "open shards": (active / unassigned /relocating / initializing) all of them?](https://discuss.elastic.co/t/what-all-shards-are-included-in-open-shards-active-unassigned-relocating-initializing-all-of-them/279754)
**Author:** [@Bhavik92](https://discuss.elastic.co/u/Bhavik92)\ **Replies:** 2\ **Last updated:** [July 29, 2021, 8:02pm UTC](https://discuss.elastic.co/t/what-all-shards-are-included-in-open-shards-active-unassigned-relocating-initializing-all-of-them/279754 "2021-07-29T20:02:23Z")
I'm trying to build some monitoring to avoid the errors like this: " this cluster currently has \[999\]/\[1000\] maximum shards open Looking at response from cluster\_health I see shards in 4 categories: active / unassigned… --- ## [400 Bad Request when trying to query elasticsearch using HttpClient](https://discuss.elastic.co/t/400-bad-request-when-trying-to-query-elasticsearch-using-httpclient/279898)
**Author:** [@MarkCo](https://discuss.elastic.co/u/MarkCo)\ **Replies:** 5\ **Last updated:** [July 29, 2021, 5:58pm UTC](https://discuss.elastic.co/t/400-bad-request-when-trying-to-query-elasticsearch-using-httpclient/279898 "2021-07-29T17:58:42Z")
I am trying to perform a query searching in elasticsearch using httpclient. Whenever I do so though, I get an error when hitting my HttpResponseMessage response variable. It tells me it is a 400 (Bad request). I checked… --- ## [Drop messages that end with specific substring](https://discuss.elastic.co/t/drop-messages-that-end-with-specific-substring/279994)
**Author:** [@bgingras](https://discuss.elastic.co/u/bgingras)\ **Replies:** 2\ **Last updated:** [July 29, 2021, 5:55pm UTC](https://discuss.elastic.co/t/drop-messages-that-end-with-specific-substring/279994 "2021-07-29T17:55:35Z")
Hello everyone, I'm trying to implement a Logstash filter that drops syslogs messages that end with a specific substring, something like this: filter { if \[message\].endsWith("substring") { drop { } } } Ha… [Previous page](https://discuss.elastic.co/latest.md?page=1548) [Next page](https://discuss.elastic.co/latest.md?page=1550)