# Latest **URL:** https://discuss.elastic.co/latest.md?page=1389 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1390 --- ## [Time series datastore altering](https://discuss.elastic.co/t/time-series-datastore-altering/288478)
**Author:** [@ailengcon](https://discuss.elastic.co/u/ailengcon)\ **Replies:** 5\ **Last updated:** [November 14, 2021, 9:15pm UTC](https://discuss.elastic.co/t/time-series-datastore-altering/288478 "2021-11-14T21:15:39Z")
I want to use Elasticsearch as a time series datastore. Where each event comes in with a timestamp and serial and all other data. I was told by @warkolm I can graph changes over time, either at an individual serial lev… --- ## [Custom analyzer with token replacement](https://discuss.elastic.co/t/custom-analyzer-with-token-replacement/289236)
**Author:** [@pistocop](https://discuss.elastic.co/u/pistocop)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 9:33pm UTC](https://discuss.elastic.co/t/custom-analyzer-with-token-replacement/289236 "2021-11-15T21:33:23Z")
2021-11-14T23:00:00Z (UTC) Hi to everyone, I was playing with custom analyzers and I had trouble with the following example. Basically, I want to index a document with a field named "user\_opinion" in two ways: with… --- ## [Working with JSON array of objects via Ruby code block](https://discuss.elastic.co/t/working-with-json-array-of-objects-via-ruby-code-block/289009)
**Author:** [@Colin\_K](https://discuss.elastic.co/u/Colin_K)\ **Replies:** 10\ **Last updated:** [November 15, 2021, 9:14pm UTC](https://discuss.elastic.co/t/working-with-json-array-of-objects-via-ruby-code-block/289009 "2021-11-15T21:14:29Z")
I have a JSON array of nested objects. I wrote a filter json { source =\> \['body'\] target =\> "parsed" } ruby { code =\> "mapped = event.get('parsed').map{ |h| \[h\['k1'\], h\['k2'\],h\['k3'\],h\['k4'\]\] }; event.set(… --- ## [Connecting to Elasticsearch node in Elastic cloud through python promt](https://discuss.elastic.co/t/connecting-to-elasticsearch-node-in-elastic-cloud-through-python-promt/289028)
**Author:** [@Sentel\_AI](https://discuss.elastic.co/u/Sentel_AI)\ **Replies:** 6\ **Last updated:** [November 15, 2021, 8:54pm UTC](https://discuss.elastic.co/t/connecting-to-elasticsearch-node-in-elastic-cloud-through-python-promt/289028 "2021-11-15T20:54:35Z")
Hi, In order to create an ingestion pipeline into the Elasticsearch node running in Elastic Cloud, I'm using the following code (API authentication): # API authentication config = configparser.ConfigParser() config.read… --- ## [LogStash Error](https://discuss.elastic.co/t/logstash-error/288444)
**Author:** [@John\_snow](https://discuss.elastic.co/u/John_snow)\ **Replies:** 18\ **Last updated:** [November 15, 2021, 7:30pm UTC](https://discuss.elastic.co/t/logstash-error/288444 "2021-11-15T19:30:37Z")
Hi Team, I'm getting exception=\>#\ … --- ## [Rally-eventdata-track with custom parameter\_sources](https://discuss.elastic.co/t/rally-eventdata-track-with-custom-parameter-sources/289098)
**Author:** [@BlueLegend](https://discuss.elastic.co/u/BlueLegend)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 6:43pm UTC](https://discuss.elastic.co/t/rally-eventdata-track-with-custom-parameter-sources/289098 "2021-11-15T18:43:53Z")
I am run rally-eventdata-track but want to change to my own mapping. I am curious as to how the data in parameter\_sources was generated so I can create my own from my data. Are there any docs on how I can do this? --- ## [Is there is any update on this subject, is there is any way to increase the number of filters that can be applied to be more than 32 filters?](https://discuss.elastic.co/t/is-there-is-any-update-on-this-subject-is-there-is-any-way-to-increase-the-number-of-filters-that-can-be-applied-to-be-more-than-32-filters/289019)
**Author:** [@AhmedTohamy01](https://discuss.elastic.co/u/AhmedTohamy01)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 6:30pm UTC](https://discuss.elastic.co/t/is-there-is-any-update-on-this-subject-is-there-is-any-way-to-increase-the-number-of-filters-that-can-be-applied-to-be-more-than-32-filters/289019 "2021-11-15T18:30:47Z")
@JasonStoltz Is there is any update on this subject, is there is any way to increase the number of filters that can be applied to be more than 32 filters? Continuing the discussion from I want to increase the number of… --- ## [Elastic Security Deployment for an MSSP](https://discuss.elastic.co/t/elastic-security-deployment-for-an-mssp/289085)
**Author:** [@afarley](https://discuss.elastic.co/u/afarley)\ **Replies:** 6\ **Last updated:** [November 15, 2021, 6:29pm UTC](https://discuss.elastic.co/t/elastic-security-deployment-for-an-mssp/289085 "2021-11-15T18:29:40Z")
Hello all, I am a security engineer for an MSSP and am currently having issues understanding how to best deploy Elastic Security for our multi-tenant environment. I've heard talk of isolating indexes by client and using… --- ## [Cannot access environment variables](https://discuss.elastic.co/t/cannot-access-environment-variables/288928)
**Author:** [@tofubeats](https://discuss.elastic.co/u/tofubeats)\ **Replies:** 7\ **Last updated:** [November 15, 2021, 6:15pm UTC](https://discuss.elastic.co/t/cannot-access-environment-variables/288928 "2021-11-15T18:15:16Z")
Hi, My config is really simple, I'm just trying to get a simple envornment variable to be accessed and used by a Logstash pipeline. It looks like this: input{ file { path =\> "${test}" } } filter {} output {… --- ## [APM-server autodiscovery](https://discuss.elastic.co/t/apm-server-autodiscovery/288814)
**Author:** [@Sergio\_Ferreyra](https://discuss.elastic.co/u/Sergio_Ferreyra)\ **Replies:** 10\ **Last updated:** [November 15, 2021, 6:14pm UTC](https://discuss.elastic.co/t/apm-server-autodiscovery/288814 "2021-11-15T18:14:45Z")
Hi guys! I am using APM 7.15.0 version with kibana same version (ELK stack) We are using on kubernetes, and I like to know if APM supports autodiscovery, we are using it for filebeat metricbeat and heartbeat to add a cus… --- ## [How to set indices.lifecycle.poll\_interval?](https://discuss.elastic.co/t/how-to-set-indices-lifecycle-poll-interval/289143)
**Author:** [@shi](https://discuss.elastic.co/u/shi)\ **Replies:** 4\ **Last updated:** [November 15, 2021, 6:13pm UTC](https://discuss.elastic.co/t/how-to-set-indices-lifecycle-poll-interval/289143 "2021-11-15T18:13:36Z")
How to set indices.lifecycle.poll\_interval? Read that it a cluster level setting. Thanks and regards shini --- ## [Calling on elasticsearch API endpoint directly](https://discuss.elastic.co/t/calling-on-elasticsearch-api-endpoint-directly/289207)
**Author:** [@tleduong](https://discuss.elastic.co/u/tleduong)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 5:26pm UTC](https://discuss.elastic.co/t/calling-on-elasticsearch-api-endpoint-directly/289207 "2021-11-15T17:26:49Z")
I'm using NEST client to talk to Elasticsearch and it is working fine. However, I have one endpoint where I couldn't figure out how to use NEST client and call on this API. Essentially I'd like to call on "GET my-inde… --- ## [Logstash Date Parse failure](https://discuss.elastic.co/t/logstash-date-parse-failure/289185)
**Author:** [@Stephy\_Jacob](https://discuss.elastic.co/u/Stephy_Jacob)\ **Replies:** 4\ **Last updated:** [November 15, 2021, 5:18pm UTC](https://discuss.elastic.co/t/logstash-date-parse-failure/289185 "2021-11-15T17:18:41Z")
Hello, I am banging my head for quite sometime to understand why am I getting dateparsefailure after trying multiple match combinations. Logstash Version = 7.9.2 sudo echo '2021-11-15T11:17:56.831Z' | /usr/share/logst… --- ## [Shard Failed- The data you are seeing might be incomplete or wrong](https://discuss.elastic.co/t/shard-failed-the-data-you-are-seeing-might-be-incomplete-or-wrong/288670)
**Author:** [@ptanguturi](https://discuss.elastic.co/u/ptanguturi)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 5:08pm UTC](https://discuss.elastic.co/t/shard-failed-the-data-you-are-seeing-might-be-incomplete-or-wrong/288670 "2021-11-15T17:08:17Z")
I am getting below error message. not sure what when wrong and didn't make any changes to index. script\_exception at shard 0index default-2021.11node weAPTkoJTm6njIweWotMLw Type script\_exception Reason runtime error … --- ## [Elastic query scipting issue using painless ( Too many dynamic script compilations )](https://discuss.elastic.co/t/elastic-query-scipting-issue-using-painless-too-many-dynamic-script-compilations/288693)
**Author:** [@Agnivesh\_Sharma](https://discuss.elastic.co/u/Agnivesh_Sharma)\ **Replies:** 3\ **Last updated:** [November 15, 2021, 4:53pm UTC](https://discuss.elastic.co/t/elastic-query-scipting-issue-using-painless-too-many-dynamic-script-compilations/288693 "2021-11-15T16:53:32Z")
A functional script query is working fine when i dont add certain scripts to it but it fails and returns \> \[script\] Too many dynamic script compilations within, max: \[75/5m\]; please use indexed, or scripts with parameter… --- ## [Kibana Canvas SQL LEFT JOIN WHERE](https://discuss.elastic.co/t/kibana-canvas-sql-left-join-where/288474)
**Author:** [@timka23](https://discuss.elastic.co/u/timka23)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 4:04pm UTC](https://discuss.elastic.co/t/kibana-canvas-sql-left-join-where/288474 "2021-11-15T16:04:17Z")
I want to insert the data in the Kibana Canvas table, but I do not work query. How to get data using such a request? SELECT \* FROM A LEFT JOIN B ON A.key = B.key My SQL: SELECT a.id as idn, COUNT(\*) as count, b.title… --- ## [App-Search alerts and warning sample search response](https://discuss.elastic.co/t/app-search-alerts-and-warning-sample-search-response/286724)
**Author:** [@Subhasis\_Dash](https://discuss.elastic.co/u/Subhasis_Dash)\ **Replies:** 11\ **Last updated:** [November 15, 2021, 3:45pm UTC](https://discuss.elastic.co/t/app-search-alerts-and-warning-sample-search-response/286724 "2021-11-15T15:45:11Z")
Hi "meta": { "alerts": \[\], "warnings": \[\], "page": { "current": 1, "total\_pages": 20, "total\_results": 200, "size": 10 }, "engine":… --- ## [Canvas integrate in Iframe](https://discuss.elastic.co/t/canvas-integrate-in-iframe/288975)
**Author:** [@AlexM566](https://discuss.elastic.co/u/AlexM566)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 3:43pm UTC](https://discuss.elastic.co/t/canvas-integrate-in-iframe/288975 "2021-11-15T15:43:39Z")
Hi everyone, I want to share my Canvas into a web-page using iframe and I want to get rid off by the top panel and the right panel and also display into a fullscreen mode. I know I can use the share on website option, b… --- ## [Handling misspell terms in app search](https://discuss.elastic.co/t/handling-misspell-terms-in-app-search/289120)
**Author:** [@miki\_haiat](https://discuss.elastic.co/u/miki_haiat)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 3:33pm UTC](https://discuss.elastic.co/t/handling-misspell-terms-in-app-search/289120 "2021-11-15T15:33:50Z")
In elasticsearch you can use fuzzy search in order to suggest terms that misspell. I cant found any similar option on app search guide For example if user search mami instead of miami we can still provide him s… --- ## [Elasticsearch is recreating indexes after they were deleted](https://discuss.elastic.co/t/elasticsearch-is-recreating-indexes-after-they-were-deleted/288039)
**Author:** [@kamillacrozara](https://discuss.elastic.co/u/kamillacrozara)\ **Replies:** 5\ **Last updated:** [November 15, 2021, 2:27pm UTC](https://discuss.elastic.co/t/elasticsearch-is-recreating-indexes-after-they-were-deleted/288039 "2021-11-15T14:27:34Z")
I am trying to sync relational data with Elasticsearch using Logstash. To do that I have crated a pipeline to Logstash like this: input { jdbc { tags =\> \["vehicles"\] jdbc\_driver\_library =\> "/usr/share/logstash… --- ## [Master not discovered yet, this node has not previously joined a bootstrapped](https://discuss.elastic.co/t/master-not-discovered-yet-this-node-has-not-previously-joined-a-bootstrapped/289075)
**Author:** [@Maks\_7v](https://discuss.elastic.co/u/Maks_7v)\ **Replies:** 15\ **Last updated:** [November 15, 2021, 2:29pm UTC](https://discuss.elastic.co/t/master-not-discovered-yet-this-node-has-not-previously-joined-a-bootstrapped/289075 "2021-11-15T14:29:59Z")
Hi there. I'm trying to deploy 3 masters, 2 data, and 2 ingest nodes to GCP k8s. There is a problem that masters struggle to discover each other. Here are the logs I get: "master not discovered yet, this node has not… --- ## [JDBC input/output with additional data transforming](https://discuss.elastic.co/t/jdbc-input-output-with-additional-data-transforming/289194)
**Author:** [@Stateros](https://discuss.elastic.co/u/Stateros)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 2:16pm UTC](https://discuss.elastic.co/t/jdbc-input-output-with-additional-data-transforming/289194 "2021-11-15T14:16:55Z")
Hello folks. I am pretty new in logstash. I have a task reload lot of data 5B records from mysql to another mysql with some aggregation. I need to load all fields param1, date group them and take count rows in main table… --- ## [Strange Issue : Logs not getting indexed and error shows nothing](https://discuss.elastic.co/t/strange-issue-logs-not-getting-indexed-and-error-shows-nothing/289166)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 2:11pm UTC](https://discuss.elastic.co/t/strange-issue-logs-not-getting-indexed-and-error-shows-nothing/289166 "2021-11-15T14:11:22Z")
Facing a strange issue, I am using filebeat module to fetch AWS and Azure logs. Since few days I saw some logs are getting indexed properly and some are not. I saw error logs of Elasticsearch and logstash both but nothin… --- ## [Can anyone please offer assistance in relation to Multi-level Sankey diagrams with Kibana](https://discuss.elastic.co/t/can-anyone-please-offer-assistance-in-relation-to-multi-level-sankey-diagrams-with-kibana/288376)
**Author:** [@Buzzaes](https://discuss.elastic.co/u/Buzzaes)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 2:06pm UTC](https://discuss.elastic.co/t/can-anyone-please-offer-assistance-in-relation-to-multi-level-sankey-diagrams-with-kibana/288376 "2021-11-15T14:06:32Z")
Hi Everyone, I'm stuck getting a multi tier Sankey diagram working in Kibana. E.g. one that looks like this: I have a simple one working e.g. one with a single source and destination, as per here but I'm stuck o… --- ## [How to view elasticsearch debug logs?](https://discuss.elastic.co/t/how-to-view-elasticsearch-debug-logs/288922)
**Author:** [@x00m](https://discuss.elastic.co/u/x00m)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 1:40pm UTC](https://discuss.elastic.co/t/how-to-view-elasticsearch-debug-logs/288922 "2021-11-15T13:40:51Z")
I need to see some logs about every http request that's coming in to Elasticsearch. I am using the ECK operator 1.8.0 I configured the log level to be trace for Elasticsearch but the logs from the -es-default- still do… --- ## [Watcher detect number of ip blocked and generate alert by email](https://discuss.elastic.co/t/watcher-detect-number-of-ip-blocked-and-generate-alert-by-email/289198)
**Author:** [@Xor44](https://discuss.elastic.co/u/Xor44)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 12:56pm UTC](https://discuss.elastic.co/t/watcher-detect-number-of-ip-blocked-and-generate-alert-by-email/289198 "2021-11-15T12:56:50Z")
i'm trying to create a Watcher alert , every time an IP is blocked by a security device . The alert must be based on the number of the logs generated by this device . If there is more than 10 logs per minute on a speci… --- ## [Elastic-agent filebeat logs spams error messages and overflows the memory](https://discuss.elastic.co/t/elastic-agent-filebeat-logs-spams-error-messages-and-overflows-the-memory/289188)
**Author:** [@LaurisJakobsons](https://discuss.elastic.co/u/LaurisJakobsons)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 11:15am UTC](https://discuss.elastic.co/t/elastic-agent-filebeat-logs-spams-error-messages-and-overflows-the-memory/289188 "2021-11-15T11:15:45Z")
We are running elastic-agent (7.15.1) to monitor Kubernetes cluster we have encountered a problem with filebeat filling the logs with error messages and overflowing the memory causing agent processes (filebeat, metricsbe… --- ## [Using redis read replica in logstash input configuration](https://discuss.elastic.co/t/using-redis-read-replica-in-logstash-input-configuration/289182)
**Author:** [@vdere1](https://discuss.elastic.co/u/vdere1)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 10:28am UTC](https://discuss.elastic.co/t/using-redis-read-replica-in-logstash-input-configuration/289182 "2021-11-15T10:28:38Z")
Hello, I am having a throttling issue on redis which could be due to the usage of just the primary endpoint to collect the logs from redis using logstash input configuration. Is it possible to use the redis read replic… --- ## [Unable to find index from logstash config in kibana while creating a new index pattern](https://discuss.elastic.co/t/unable-to-find-index-from-logstash-config-in-kibana-while-creating-a-new-index-pattern/289159)
**Author:** [@Aryan\_Saxena](https://discuss.elastic.co/u/Aryan_Saxena)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 10:12am UTC](https://discuss.elastic.co/t/unable-to-find-index-from-logstash-config-in-kibana-while-creating-a-new-index-pattern/289159 "2021-11-15T10:12:11Z")
--- ## [Kibana: Can it automatically adjust the dashboard time window to fit real-time data so I don't have to?](https://discuss.elastic.co/t/kibana-can-it-automatically-adjust-the-dashboard-time-window-to-fit-real-time-data-so-i-dont-have-to/288944)
**Author:** [@GPartenza](https://discuss.elastic.co/u/GPartenza)\ **Replies:** 3\ **Last updated:** [November 15, 2021, 9:28am UTC](https://discuss.elastic.co/t/kibana-can-it-automatically-adjust-the-dashboard-time-window-to-fit-real-time-data-so-i-dont-have-to/288944 "2021-11-15T09:28:49Z")
Hi all, I am using the Elastic Stack to visualize data in real time for video games. In my experience, Kibana works great for visualizing real time data, however, I have come across a strange use-case where I am having … [Previous page](https://discuss.elastic.co/latest.md?page=1388) [Next page](https://discuss.elastic.co/latest.md?page=1390)