# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1164 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1165 --- ## [Can anyone please offer assistance in relation to Multi-level Sankey diagrams with Kibana](https://discuss.elastic.co/t/can-anyone-please-offer-assistance-in-relation-to-multi-level-sankey-diagrams-with-kibana/288376)
**Author:** [@Buzzaes](https://discuss.elastic.co/u/Buzzaes)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 2:06pm UTC](https://discuss.elastic.co/t/can-anyone-please-offer-assistance-in-relation-to-multi-level-sankey-diagrams-with-kibana/288376 "2021-11-15T14:06:32Z")
Hi Everyone, I'm stuck getting a multi tier Sankey diagram working in Kibana. E.g. one that looks like this: I have a simple one working e.g. one with a single source and destination, as per here but I'm stuck o… --- ## [Watcher detect number of ip blocked and generate alert by email](https://discuss.elastic.co/t/watcher-detect-number-of-ip-blocked-and-generate-alert-by-email/289198)
**Author:** [@Xor44](https://discuss.elastic.co/u/Xor44)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 12:56pm UTC](https://discuss.elastic.co/t/watcher-detect-number-of-ip-blocked-and-generate-alert-by-email/289198 "2021-11-15T12:56:50Z")
i'm trying to create a Watcher alert , every time an IP is blocked by a security device . The alert must be based on the number of the logs generated by this device . If there is more than 10 logs per minute on a speci… --- ## [Elastic-agent filebeat logs spams error messages and overflows the memory](https://discuss.elastic.co/t/elastic-agent-filebeat-logs-spams-error-messages-and-overflows-the-memory/289188)
**Author:** [@LaurisJakobsons](https://discuss.elastic.co/u/LaurisJakobsons)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 11:15am UTC](https://discuss.elastic.co/t/elastic-agent-filebeat-logs-spams-error-messages-and-overflows-the-memory/289188 "2021-11-15T11:15:45Z")
We are running elastic-agent (7.15.1) to monitor Kubernetes cluster we have encountered a problem with filebeat filling the logs with error messages and overflowing the memory causing agent processes (filebeat, metricsbe… --- ## [Using redis read replica in logstash input configuration](https://discuss.elastic.co/t/using-redis-read-replica-in-logstash-input-configuration/289182)
**Author:** [@vdere1](https://discuss.elastic.co/u/vdere1)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 10:28am UTC](https://discuss.elastic.co/t/using-redis-read-replica-in-logstash-input-configuration/289182 "2021-11-15T10:28:38Z")
Hello, I am having a throttling issue on redis which could be due to the usage of just the primary endpoint to collect the logs from redis using logstash input configuration. Is it possible to use the redis read replic… --- ## [Unable to find index from logstash config in kibana while creating a new index pattern](https://discuss.elastic.co/t/unable-to-find-index-from-logstash-config-in-kibana-while-creating-a-new-index-pattern/289159)
**Author:** [@Aryan\_Saxena](https://discuss.elastic.co/u/Aryan_Saxena)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 10:12am UTC](https://discuss.elastic.co/t/unable-to-find-index-from-logstash-config-in-kibana-while-creating-a-new-index-pattern/289159 "2021-11-15T10:12:11Z")
--- ## [Kibana: Can it automatically adjust the dashboard time window to fit real-time data so I don't have to?](https://discuss.elastic.co/t/kibana-can-it-automatically-adjust-the-dashboard-time-window-to-fit-real-time-data-so-i-dont-have-to/288944)
**Author:** [@GPartenza](https://discuss.elastic.co/u/GPartenza)\ **Replies:** 3\ **Last updated:** [November 15, 2021, 9:28am UTC](https://discuss.elastic.co/t/kibana-can-it-automatically-adjust-the-dashboard-time-window-to-fit-real-time-data-so-i-dont-have-to/288944 "2021-11-15T09:28:49Z")
Hi all, I am using the Elastic Stack to visualize data in real time for video games. In my experience, Kibana works great for visualizing real time data, however, I have come across a strange use-case where I am having … --- ## [Nest Client not allowing default Boolean Queries](https://discuss.elastic.co/t/nest-client-not-allowing-default-boolean-queries/286871)
**Author:** [@jimmymacGA](https://discuss.elastic.co/u/jimmymacGA)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:54am UTC](https://discuss.elastic.co/t/nest-client-not-allowing-default-boolean-queries/286871 "2021-11-15T08:54:05Z")
I am trying to use the Nest client to create a custom class that can be instantiated with a default request. I am using the following code to create a boolean query that will become part of a default SearchRequest objec… --- ## [Bulk Insert from datatable using c#.net](https://discuss.elastic.co/t/bulk-insert-from-datatable-using-c-net/287516)
**Author:** [@balupad14](https://discuss.elastic.co/u/balupad14)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:50am UTC](https://discuss.elastic.co/t/bulk-insert-from-datatable-using-c-net/287516 "2021-11-15T08:50:28Z")
Hi All, I have a situation that I have to use the bulk insert using c#.net. The thing is the source is from the data table (dynamic data). Can you please someone help me to solve this ? Advance wishes. Thank you --- ## [Get Array FieldValues ElasticSearch NEST](https://discuss.elastic.co/t/get-array-fieldvalues-elasticsearch-nest/288911)
**Author:** [@Mr\_X](https://discuss.elastic.co/u/Mr_X)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:46am UTC](https://discuss.elastic.co/t/get-array-fieldvalues-elasticsearch-nest/288911 "2021-11-15T08:46:31Z")
Is there a way to get Arrays returned in FieldValues using NEST. Consider the following query var searchResponse = client.Search\(s =\> s .Index("specs") .Source(… --- ## [How to specify Refresh.WaitFor with an IndexMany request?](https://discuss.elastic.co/t/how-to-specify-refresh-waitfor-with-an-indexmany-request/287934)
**Author:** [@astanton1978](https://discuss.elastic.co/u/astanton1978)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:43am UTC](https://discuss.elastic.co/t/how-to-specify-refresh-waitfor-with-an-indexmany-request/287934 "2021-11-15T08:43:30Z")
For the .net clients I dont see the option to wait for indexing to complete before returning the response when performing an IndexMany or IndexManyAsync. Its present for Index and IndexAsync. Is there a way to specify… --- ## [Trouble authenticating with API Keys and the .Net Client Elasticsearch.Extensions.Logging](https://discuss.elastic.co/t/trouble-authenticating-with-api-keys-and-the-net-client-elasticsearch-extensions-logging/288392)
**Author:** [@ajuch](https://discuss.elastic.co/u/ajuch)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:37am UTC](https://discuss.elastic.co/t/trouble-authenticating-with-api-keys-and-the-net-client-elasticsearch-extensions-logging/288392 "2021-11-15T08:37:36Z")
Hi, I'm having a hard time getting log data from an aspnet core application into an elastic cloud instance. I created an API Key in Kibana and passed the Base64 encoded variant of the API Key and the Cloud ID to the .Ad… --- ## [Filebeat cloudwatch input log\_group\_name\_prefix only starts one input](https://discuss.elastic.co/t/filebeat-cloudwatch-input-log-group-name-prefix-only-starts-one-input/289168)
**Author:** [@Kkakku](https://discuss.elastic.co/u/Kkakku)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 8:31am UTC](https://discuss.elastic.co/t/filebeat-cloudwatch-input-log-group-name-prefix-only-starts-one-input/289168 "2021-11-15T08:31:47Z")
I'm trying to use aws-cloudwatch input with Filebeat 7.15.2, because I don't want to add every lambda log group separately. I've tried following input config in my filebeat.yml: filebeat.inputs: - type: aws-cloudwatch … --- ## [Microsoft windows clusters](https://discuss.elastic.co/t/microsoft-windows-clusters/289065)
**Author:** [@tractor\_boy](https://discuss.elastic.co/u/tractor_boy)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 8:23am UTC](https://discuss.elastic.co/t/microsoft-windows-clusters/289065 "2021-11-15T08:23:56Z")
I need to capture metrics that are clustered (microsoft windows), such that specific resources move when the cluster moves. Some resources stay on the node, other move between nodes as the cluster moves. How are \*beats… --- ## [Perf stats](https://discuss.elastic.co/t/perf-stats/289061)
**Author:** [@tractor\_boy](https://discuss.elastic.co/u/tractor_boy)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 8:22am UTC](https://discuss.elastic.co/t/perf-stats/289061 "2021-11-15T08:22:37Z")
I have read the guides on configuring windows counters but cannot make any sense of what they are talking about, and the example seems incomplete. Would anyone have an example file that capture cpu, ram, and disk space.… --- ## [Elasticsearch-migrate returns java NullPointer error](https://discuss.elastic.co/t/elasticsearch-migrate-returns-java-nullpointer-error/289129)
**Author:** [@bchill](https://discuss.elastic.co/u/bchill)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 7:21am UTC](https://discuss.elastic.co/t/elasticsearch-migrate-returns-java-nullpointer-error/289129 "2021-11-15T07:21:19Z")
Hello, I am getting a java error when using Elasticsearch-migrate. I realize this tool is deprecated and don't expect help. To simplify the problem, I emptied the users file and created a single user, 'joe', with passw… --- ## [How do I get the real total when PAGING](https://discuss.elastic.co/t/how-do-i-get-the-real-total-when-paging/289156)
**Author:** [@KhalidDu](https://discuss.elastic.co/u/KhalidDu)\ **Replies:** 4\ **Last updated:** [November 15, 2021, 7:16am UTC](https://discuss.elastic.co/t/how-do-i-get-the-real-total-when-paging/289156 "2021-11-15T07:16:04Z")
When.NET uses NEST for paging query, when I get the total number of data from Hits, I find the maximum value is 10000, but my real data amount should be 50000+, I have set max\_result\_window value to 200000000, but it doe… --- ## [Create automatic indexes per client per day automatically](https://discuss.elastic.co/t/create-automatic-indexes-per-client-per-day-automatically/289148)
**Author:** [@stasya](https://discuss.elastic.co/u/stasya)\ **Replies:** 4\ **Last updated:** [November 15, 2021, 5:14am UTC](https://discuss.elastic.co/t/create-automatic-indexes-per-client-per-day-automatically/289148 "2021-11-15T05:14:38Z")
Hi All, I am writing the following documents structure into my Elasticsearch: { "date":"2021-11-03", "clientId":"123", ... \ } What I would like to happen, is that whenever a document is written to E… --- ## [Filebeat panics with multiple filestream inputs](https://discuss.elastic.co/t/filebeat-panics-with-multiple-filestream-inputs/289152)
**Author:** [@gwvandesteeg](https://discuss.elastic.co/u/gwvandesteeg)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 3:57am UTC](https://discuss.elastic.co/t/filebeat-panics-with-multiple-filestream-inputs/289152 "2021-11-15T03:57:38Z")
I'm seeing a bunch of errors when configuring filebeat with multiple filestream input types. The configuration is simple enough, filebeat (7.15.1) running on Ubuntu 18.04 LTS forwards everything to logstash using beats. … --- ## [Using only Kibana to preserve monthly data](https://discuss.elastic.co/t/using-only-kibana-to-preserve-monthly-data/289037)
**Author:** [@MinwooKim](https://discuss.elastic.co/u/MinwooKim)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 2:18am UTC](https://discuss.elastic.co/t/using-only-kibana-to-preserve-monthly-data/289037 "2021-11-15T02:18:41Z")
Using ILM, I am trying to confingure an index to only preserve monthly data. This index has a batch with a bulkprocessor to insert data every day. I intended to configure an ILM like this. However, for some indexes … --- ## [Kibana6.4 browser oom](https://discuss.elastic.co/t/kibana6-4-browser-oom/289140)
**Author:** [@qixian](https://discuss.elastic.co/u/qixian)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 1:39am UTC](https://discuss.elastic.co/t/kibana6-4-browser-oom/289140 "2021-11-15T01:39:32Z")
when I used the kibana6.4.0 to search my index,the chrome appear out of memory；the url is http://myaddress:5601/app/kibana#/discover?\_g=()&\_a=(columns:!(msg),filters:!(),index:program\_2021-11-11\_18,interval:auto,query:(… --- ## [Lens visualisation: bar chart breakdown of object values returns wrong count (mapping problem?)](https://discuss.elastic.co/t/lens-visualisation-bar-chart-breakdown-of-object-values-returns-wrong-count-mapping-problem/289013)
**Author:** [@sandbender](https://discuss.elastic.co/u/sandbender)\ **Replies:** 5\ **Last updated:** [November 14, 2021, 10:06pm UTC](https://discuss.elastic.co/t/lens-visualisation-bar-chart-breakdown-of-object-values-returns-wrong-count-mapping-problem/289013 "2021-11-14T22:06:37Z")
Hello, I would like to produce a rather simple bar chart that shows, for elements in a term aggregation, a unique count of one field in the aggregated objects that is then broken down according to a count of a different… --- ## [Elactic Injection .Data injection to particular node by index name](https://discuss.elastic.co/t/elactic-injection-data-injection-to-particular-node-by-index-name/289051)
**Author:** [@akshay\_dindure1994](https://discuss.elastic.co/u/akshay_dindure1994)\ **Replies:** 1\ **Last updated:** [November 14, 2021, 9:16pm UTC](https://discuss.elastic.co/t/elactic-injection-data-injection-to-particular-node-by-index-name/289051 "2021-11-14T21:16:38Z")
Hello Team, I have 3 node setup. 1 is master and 2 are data node. i am storing data in 2 data node. But i have one requirement to store data name wise to node. For e.g elastic-kibana-index-2021.01.\* -- \> node 1 a… --- ## [Displaying the most recent data in graph](https://discuss.elastic.co/t/displaying-the-most-recent-data-in-graph/289067)
**Author:** [@Ben\_Newton](https://discuss.elastic.co/u/Ben_Newton)\ **Replies:** 2\ **Last updated:** [November 14, 2021, 5:19pm UTC](https://discuss.elastic.co/t/displaying-the-most-recent-data-in-graph/289067 "2021-11-14T17:19:32Z")
Our product publishes posts to social media (Facebook, Twitter etc) and I'm trying to produce some graphs to analyse our data. What I'd like to show some graphs on how many posts publishes successfully vs how many fail t… --- ## [Error: Exiting: No paths were defined for input accessing config](https://discuss.elastic.co/t/error-exiting-no-paths-were-defined-for-input-accessing-config/289128)
**Author:** [@Rakesh\_Kapoor](https://discuss.elastic.co/u/Rakesh_Kapoor)\ **Replies:** 1\ **Last updated:** [November 14, 2021, 9:11pm UTC](https://discuss.elastic.co/t/error-exiting-no-paths-were-defined-for-input-accessing-config/289128 "2021-11-14T21:11:18Z")
I setup Elasticsearch and kibana on a secondary laptop and they are accessible from my primary laptop. i am setting up filebeat in my primary laptop. filebeat test config -e returns config ok filebeat run fails with e… --- ## [Some logs aren't being received by ElasticSearch / showing in Kibana](https://discuss.elastic.co/t/some-logs-arent-being-received-by-elasticsearch-showing-in-kibana/288139)
**Author:** [@nwright](https://discuss.elastic.co/u/nwright)\ **Replies:** 6\ **Last updated:** [November 14, 2021, 9:08pm UTC](https://discuss.elastic.co/t/some-logs-arent-being-received-by-elasticsearch-showing-in-kibana/288139 "2021-11-14T21:08:13Z")
I'm using Elasticsearch primarily to record log messages from a .NET API hosted on an AWS lambda. Whenever there are two or more API requests sent to this API, only the logs from one call are sent to Elasticsearch where… --- ## [Elasticsearch 6.8 Windows .msi upgrade from 6.8.2 to 6.8.20, using a service](https://discuss.elastic.co/t/elasticsearch-6-8-windows-msi-upgrade-from-6-8-2-to-6-8-20-using-a-service/289126)
**Author:** [@newschapmj1](https://discuss.elastic.co/u/newschapmj1)\ **Replies:** 1\ **Last updated:** [November 14, 2021, 5:42pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-windows-msi-upgrade-from-6-8-2-to-6-8-20-using-a-service/289126 "2021-11-14T17:42:55Z")
We are patching a single node cluster from 6.8.2 to 6.8.20 on Windows server 2012 R2. The original version was installed with .msi I have only had experience using the .zip file previously on Windows I've read the not… --- ## [What is the method to create Index Pattern in Python](https://discuss.elastic.co/t/what-is-the-method-to-create-index-pattern-in-python/289121)
**Author:** [@ElnurHello](https://discuss.elastic.co/u/ElnurHello)\ **Replies:** 4\ **Last updated:** [November 14, 2021, 4:14pm UTC](https://discuss.elastic.co/t/what-is-the-method-to-create-index-pattern-in-python/289121 "2021-11-14T16:14:20Z")
Hello, All In Python, I use let say "es.indices.put\_index\_template()" method to create Index Template, "es.indices.create()" to create index but what method should be used to create Index Pattern ? --- ## [How to remove scientific format](https://discuss.elastic.co/t/how-to-remove-scientific-format/288843)
**Author:** [@paigekim](https://discuss.elastic.co/u/paigekim)\ **Replies:** 1\ **Last updated:** [November 14, 2021, 2:54pm UTC](https://discuss.elastic.co/t/how-to-remove-scientific-format/288843 "2021-11-14T14:54:02Z")
Hello, I am currently using Elasticsearch query to find out an accumulated revenue and an accumulated sum. The values calculated fast as I needed it but I would like to get the numbers in float value, not by scientific … --- ## [Refresh interval guarantee](https://discuss.elastic.co/t/refresh-interval-guarantee/289125)
**Author:** [@krezno](https://discuss.elastic.co/u/krezno)\ **Replies:** 2\ **Last updated:** [November 14, 2021, 12:40pm UTC](https://discuss.elastic.co/t/refresh-interval-guarantee/289125 "2021-11-14T12:40:19Z")
The documentation on refreshes says: By default, Elasticsearch periodically refreshes indices every second, but only on indices that have received one search request or more in the last 30 seconds. What happens if th… --- ## [Creating a new table with multiple rows in Canvas](https://discuss.elastic.co/t/creating-a-new-table-with-multiple-rows-in-canvas/289057)
**Author:** [@bodach](https://discuss.elastic.co/u/bodach)\ **Replies:** 1\ **Last updated:** [November 14, 2021, 9:48am UTC](https://discuss.elastic.co/t/creating-a-new-table-with-multiple-rows-in-canvas/289057 "2021-11-14T09:48:52Z")
Hello, I am trying to create a new table based on 2 different queries. But its only giving me the first row: This is my code: var\_set name="Relet" value={essql "select Service\_Provider, round(avg(Score),2) as a … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1163) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1165)