# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1237 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1238 --- ## [Es nodes configuration](https://discuss.elastic.co/t/es-nodes-configuration/284362)
**Author:** [@v\_kumar](https://discuss.elastic.co/u/v_kumar)\ **Replies:** 2\ **Last updated:** [September 16, 2021, 7:34am UTC](https://discuss.elastic.co/t/es-nodes-configuration/284362 "2021-09-16T07:34:58Z")
Hi Team, Currently, in our cluster, this is the configuration, Nodes - 7 nodes(3master, 4datanodes, write happens 1 month once, so mostly read cluster) ES - 6.4 Memory - 128 GB(ES - 32 GB) Cores - 16 Shards - 13… --- ## [Help with scripted filed to compute difference between timestamps](https://discuss.elastic.co/t/help-with-scripted-filed-to-compute-difference-between-timestamps/281835)
**Author:** [@Jose\_E](https://discuss.elastic.co/u/Jose_E)\ **Replies:** 9\ **Last updated:** [September 16, 2021, 7:20am UTC](https://discuss.elastic.co/t/help-with-scripted-filed-to-compute-difference-between-timestamps/281835 "2021-09-16T07:20:40Z")
Hello, I'm trying to create a Scripted Field to compute the delay between timestamps: the time when logstashs sees the event - the actual timestamp from the log/event. And so far I'm having a terrible time getting to und… --- ## [Index UNASSIGNED CLUSTER\_RECOVERED](https://discuss.elastic.co/t/index-unassigned-cluster-recovered/284307)
**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Replies:** 2\ **Last updated:** [September 16, 2021, 6:19am UTC](https://discuss.elastic.co/t/index-unassigned-cluster-recovered/284307 "2021-09-16T06:19:38Z")
I have a single node cluster with 1 replica on all my indices. Somehow however I have 2 indices unallocated bin-dev and ilm-history-1-000004. GET /\_cat/shards?h=index,shard,prirep,state,unassigned.reason ilm-history-1-0… --- ## [High level REST client backwards compatibility](https://discuss.elastic.co/t/high-level-rest-client-backwards-compatibility/284345)
**Author:** [@Chris\_Gatihi](https://discuss.elastic.co/u/Chris_Gatihi)\ **Replies:** 3\ **Last updated:** [September 16, 2021, 6:17am UTC](https://discuss.elastic.co/t/high-level-rest-client-backwards-compatibility/284345 "2021-09-16T06:17:58Z")
In the transport client documentation I see this statement: The client must have the same major version (e.g. 2.x , or 5.x ) as the nodes in the cluster. Clients may connect to clusters which have a different minor ver… --- ## [Question about "Rollover" in Index Lifecycle Policy](https://discuss.elastic.co/t/question-about-rollover-in-index-lifecycle-policy/284005)
**Author:** [@vp096](https://discuss.elastic.co/u/vp096)\ **Replies:** 8\ **Last updated:** [September 16, 2021, 6:01am UTC](https://discuss.elastic.co/t/question-about-rollover-in-index-lifecycle-policy/284005 "2021-09-16T06:01:13Z")
Hello to all, I have a question when I configure my first "Index Lifecycle Policy". I am given the following option: Is this a problem or a risk of data loss if I don't enable it? Because I want to keep my data for … --- ## [ILM doesn't work](https://discuss.elastic.co/t/ilm-doesnt-work/284285)
**Author:** [@vp096](https://discuss.elastic.co/u/vp096)\ **Replies:** 3\ **Last updated:** [September 16, 2021, 5:58am UTC](https://discuss.elastic.co/t/ilm-doesnt-work/284285 "2021-09-16T05:58:24Z")
Hello everyone, I send data every day on one index, and I would like to delete all the data older than 15 minutes. I have set up the following ILM: I notice that after 15 minutes nothing happens, then after about 25… --- ## ["ServiceConfigurationError: NamedXContentProvider: MatrixStatsNamedXContentProvider not a subtype;" in Elasticsearch Kafka Connect Transform that uses Elasticsearch high level rest client](https://discuss.elastic.co/t/serviceconfigurationerror-namedxcontentprovider-matrixstatsnamedxcontentprovider-not-a-subtype-in-elasticsearch-kafka-connect-transform-that-uses-elasticsearch-high-level-rest-client/284315)
**Author:** [@lalithkota](https://discuss.elastic.co/u/lalithkota)\ **Replies:** 0\ **Last updated:** [September 15, 2021, 6:11pm UTC](https://discuss.elastic.co/t/serviceconfigurationerror-namedxcontentprovider-matrixstatsnamedxcontentprovider-not-a-subtype-in-elasticsearch-kafka-connect-transform-that-uses-elasticsearch-high-level-rest-client/284315 "2021-09-15T18:11:33Z")
I am trying to develop an Kafka Connect Transform for the Confluent's Elasticsearch Sink connector The transform has to take a preexisting index document data and insert it as a field to the current document. I want to… --- ## [SQL Server data to Elasticsearch using LogStash](https://discuss.elastic.co/t/sql-server-data-to-elasticsearch-using-logstash/283879)
**Author:** [@Navlesh](https://discuss.elastic.co/u/Navlesh)\ **Replies:** 3\ **Last updated:** [September 16, 2021, 5:49am UTC](https://discuss.elastic.co/t/sql-server-data-to-elasticsearch-using-logstash/283879 "2021-09-16T05:49:40Z")
Hi input { jdbc { # SqlServer jdbc connection string to your database, productdb # "jdbc:sqlserver://HostName\\instanceName;database=DBName;user=UserName;password=Password" jdbc\_connection\_string =\> "jdbc:sqlserver:… --- ## [Full-text search in the Rollup index](https://discuss.elastic.co/t/full-text-search-in-the-rollup-index/284283)
**Author:** [@IliaIsakhin](https://discuss.elastic.co/u/IliaIsakhin)\ **Replies:** 2\ **Last updated:** [September 16, 2021, 5:47am UTC](https://discuss.elastic.co/t/full-text-search-in-the-rollup-index/284283 "2021-09-16T05:47:21Z")
Greetings! I've configured roll-up jobs for my Elasticsearch cluster. As I see from docs, roll-up index by default contains fields with types keyword or numeric. I want to perform full-text search by certain fields in … --- ## [Is there any existing grok{} pattern for date format YYYY-MM-DD?](https://discuss.elastic.co/t/is-there-any-existing-grok-pattern-for-date-format-yyyy-mm-dd/284269)
**Author:** [@shi](https://discuss.elastic.co/u/shi)\ **Replies:** 3\ **Last updated:** [September 16, 2021, 5:14am UTC](https://discuss.elastic.co/t/is-there-any-existing-grok-pattern-for-date-format-yyyy-mm-dd/284269 "2021-09-16T05:14:28Z")
\[Is there any existing grok{} pattern for date format YYYY-MM-DD? I get error when i use %{DATE:datefield}, tried %{CUSTOM\_DATE:datefield} also , that also resulted in failure --- ## [A New TiDB Module for Filebeat](https://discuss.elastic.co/t/a-new-tidb-module-for-filebeat/283439)
**Author:** [@yifan](https://discuss.elastic.co/u/yifan)\ **Replies:** 1\ **Last updated:** [September 16, 2021, 4:41am UTC](https://discuss.elastic.co/t/a-new-tidb-module-for-filebeat/283439 "2021-09-16T04:41:08Z")
Hello everyone, I'm a developer from TiDB Community. TiDB is a popular open source HTAP database. TiDB users use tools such as TiUP and TiDB-operator to deploy TiDB clusters in a bare-metal or k8s environment. Many Ti… --- ## [Can we set up multiple output in metricbeat?](https://discuss.elastic.co/t/can-we-set-up-multiple-output-in-metricbeat/284168)
**Author:** [@abhi.logs](https://discuss.elastic.co/u/abhi.logs)\ **Replies:** 3\ **Last updated:** [September 16, 2021, 4:29am UTC](https://discuss.elastic.co/t/can-we-set-up-multiple-output-in-metricbeat/284168 "2021-09-16T04:29:18Z")
Hello, I want to set up multiple outputs in metricbeat.yml, Is it possible we can set up? output.elasticsearch: hosts: \["abc.com"\] username: "xxxxx" Password: "xxxx" output.elasticsearch: hosts: \["xyz.com"\] usern… --- ## [How to Autoreload kafka broker details in Logstash if any new broker added to the kafka cluster](https://discuss.elastic.co/t/how-to-autoreload-kafka-broker-details-in-logstash-if-any-new-broker-added-to-the-kafka-cluster/284350)
**Author:** [@suresh\_choudhary](https://discuss.elastic.co/u/suresh_choudhary)\ **Replies:** 0\ **Last updated:** [September 16, 2021, 3:42am UTC](https://discuss.elastic.co/t/how-to-autoreload-kafka-broker-details-in-logstash-if-any-new-broker-added-to-the-kafka-cluster/284350 "2021-09-16T03:42:46Z")
I am publishing data to Kafka using Logstash output. If the load increases, My Kafka cluster will add a new broker to the cluster. How to feed these changes(new broker IP and port) to Logstash without restarting it. Will… --- ## [Combine two fields in search](https://discuss.elastic.co/t/combine-two-fields-in-search/284277)
**Author:** [@markuso](https://discuss.elastic.co/u/markuso)\ **Replies:** 1\ **Last updated:** [September 15, 2021, 10:29pm UTC](https://discuss.elastic.co/t/combine-two-fields-in-search/284277 "2021-09-15T22:29:30Z")
Hey, I have the JSON data in elasticsearch as { "prefix": "+46", "number":"123456789" } So this is a phone number, together with the country code prefix. And searching for them as separate prefix: +46 number: 1… --- ## [Elastic Search SQL JDBC driver maps each index to a table](https://discuss.elastic.co/t/elastic-search-sql-jdbc-driver-maps-each-index-to-a-table/284334)
**Author:** [@saiyamlui](https://discuss.elastic.co/u/saiyamlui)\ **Replies:** 1\ **Last updated:** [September 15, 2021, 9:34pm UTC](https://discuss.elastic.co/t/elastic-search-sql-jdbc-driver-maps-each-index-to-a-table/284334 "2021-09-15T21:34:10Z")
I am trying to use Elastic Search SQL JDBC driver to connect to ES cluster. Our indices are partition by date dynamically, for example, we have testdata\_2021-0914, testdata\_2021-0915, etc. It appears each of these i… --- ## [Indexing beats hourly](https://discuss.elastic.co/t/indexing-beats-hourly/284271)
**Author:** [@tarekilani](https://discuss.elastic.co/u/tarekilani)\ **Replies:** 1\ **Last updated:** [September 15, 2021, 9:24pm UTC](https://discuss.elastic.co/t/indexing-beats-hourly/284271 "2021-09-15T21:24:00Z")
Hello, Please i'm searching for a way to index beats hourly in elasticsearch. As you know the default configuration in a beat yml file is : #index: "winlogbeat-%{\[agent.version\]}-%{+yyyy.MM.dd}" I tried changing that … --- ## [Setting default operator to AND in elasticsearch when using SearchSourceBuilder and XContentParser](https://discuss.elastic.co/t/setting-default-operator-to-and-in-elasticsearch-when-using-searchsourcebuilder-and-xcontentparser/284326)
**Author:** [@taugusti](https://discuss.elastic.co/u/taugusti)\ **Replies:** 0\ **Last updated:** [September 15, 2021, 7:32pm UTC](https://discuss.elastic.co/t/setting-default-operator-to-and-in-elasticsearch-when-using-searchsourcebuilder-and-xcontentparser/284326 "2021-09-15T19:32:55Z")
I have the below sample code to query elasticsearch. It receives the user query and uses XContentParser and SearchSourceBuilder. I don't want to tweak a lot on the existing code as it is has been in production for a whil… --- ## [Using indexes to simplify user access](https://discuss.elastic.co/t/using-indexes-to-simplify-user-access/284184)
**Author:** [@blackge](https://discuss.elastic.co/u/blackge)\ **Replies:** 3\ **Last updated:** [September 15, 2021, 9:21pm UTC](https://discuss.elastic.co/t/using-indexes-to-simplify-user-access/284184 "2021-09-15T21:21:20Z")
I'm building a solution that controls access to documents by library. Users gain access to libraries through subscriptions. We want our users to run searches across all of the libraries that they have access to, but not … --- ## [Add dynamic variable to item url](https://discuss.elastic.co/t/add-dynamic-variable-to-item-url/284250)
**Author:** [@yangesh4u](https://discuss.elastic.co/u/yangesh4u)\ **Replies:** 3\ **Last updated:** [September 15, 2021, 9:19pm UTC](https://discuss.elastic.co/t/add-dynamic-variable-to-item-url/284250 "2021-09-15T21:19:40Z")
We are trying to add a item url to an TOP N TSVB visualizations ,we have a requirement to pass an attribute name dynamically like given below. https://search.xxxyyyyyyzzzzzzzzz.es.amazonaws.com/\_plugin/kibana/app/discov… --- ## [Logstash tags \_dateparsefailure - How to separate pasted fields or fields together?](https://discuss.elastic.co/t/logstash-tags-dateparsefailure-how-to-separate-pasted-fields-or-fields-together/284318)
**Author:** [@Cristiane\_Marcarini](https://discuss.elastic.co/u/Cristiane_Marcarini)\ **Replies:** 3\ **Last updated:** [September 15, 2021, 9:15pm UTC](https://discuss.elastic.co/t/logstash-tags-dateparsefailure-how-to-separate-pasted-fields-or-fields-together/284318 "2021-09-15T21:15:05Z")
Hi! I have logs that have fields together or fields pasted together, and I don't know how to separate them. Here's a screenshot of how it looks in Kibana and another how it looks in Logstash. I need help with this as I… --- ## [Filebeat Dashboard Setup is a Hassle!](https://discuss.elastic.co/t/filebeat-dashboard-setup-is-a-hassle/282468)
**Author:** [@tomx1](https://discuss.elastic.co/u/tomx1)\ **Replies:** 16\ **Last updated:** [September 15, 2021, 9:11pm UTC](https://discuss.elastic.co/t/filebeat-dashboard-setup-is-a-hassle/282468 "2021-09-15T21:11:31Z")
I'm frustrated!!! It's such a hassle to load sample dashboards dashboards in Kibana, this should be an easy straight forward task. But somehow you guys managed to make it an hole day project. Sorry, but I'm pissed curren… --- ## [Winlogbeat cannot start service](https://discuss.elastic.co/t/winlogbeat-cannot-start-service/284332)
**Author:** [@marshallamey](https://discuss.elastic.co/u/marshallamey)\ **Replies:** 0\ **Last updated:** [September 15, 2021, 8:36pm UTC](https://discuss.elastic.co/t/winlogbeat-cannot-start-service/284332 "2021-09-15T20:36:12Z")
Hello, I am having the issue where I can start the winlogbeat application from PowerShell or CMD, but when I try to start the service I get the errors: (from services.msc) =\> Error 1053: The serivce did not respond to … --- ## [PointInTime api and SearchAfter in Nest](https://discuss.elastic.co/t/pointintime-api-and-searchafter-in-nest/283908)
**Author:** [@rizhaider](https://discuss.elastic.co/u/rizhaider)\ **Replies:** 6\ **Last updated:** [September 15, 2021, 8:28pm UTC](https://discuss.elastic.co/t/pointintime-api-and-searchafter-in-nest/283908 "2021-09-15T20:28:27Z")
I am working on a task in which I have to search a large number of documents in Elasticsearch using Nest client. I implemented ScrollAPI that works fine but need to use SearchAPI with SearchAfter and PointInTime as recom… --- ## [Error loading kibana iframe](https://discuss.elastic.co/t/error-loading-kibana-iframe/284317)
**Author:** [@Nanelastic](https://discuss.elastic.co/u/Nanelastic)\ **Replies:** 3\ **Last updated:** [September 15, 2021, 7:17pm UTC](https://discuss.elastic.co/t/error-loading-kibana-iframe/284317 "2021-09-15T19:17:20Z")
I am trying to load kibana visualizations using iframe . I copied iframe code using share option in kibana. I put the copied links in a html code to load two iframes sided by side. When i try to load the html page in c… --- ## [Use maps plugin in custom plugin](https://discuss.elastic.co/t/use-maps-plugin-in-custom-plugin/284244)
**Author:** [@abak\_programmer](https://discuss.elastic.co/u/abak_programmer)\ **Replies:** 1\ **Last updated:** [September 15, 2021, 7:14pm UTC](https://discuss.elastic.co/t/use-maps-plugin-in-custom-plugin/284244 "2021-09-15T19:14:09Z")
hi everyone, i want to use maps plugin features in my plugin, how i do it ? thanks --- ## [Kibana 7.12.0 CSV report empty (only header)](https://discuss.elastic.co/t/kibana-7-12-0-csv-report-empty-only-header/284260)
**Author:** [@jze1](https://discuss.elastic.co/u/jze1)\ **Replies:** 1\ **Last updated:** [September 15, 2021, 6:34pm UTC](https://discuss.elastic.co/t/kibana-7-12-0-csv-report-empty-only-header/284260 "2021-09-15T18:34:13Z")
Hello, I saved the results of a search (to be allowed to generate CSV report (why is this even needed?!?!?!)) and clicked on generating CSV report. After downloading it from Stack Management --\> Reporting it contained o… --- ## [Elasticsearch - Kibana - Monitors extraction query fails when documents doesn't have the field](https://discuss.elastic.co/t/elasticsearch-kibana-monitors-extraction-query-fails-when-documents-doesnt-have-the-field/283323)
**Author:** [@prashu421](https://discuss.elastic.co/u/prashu421)\ **Replies:** 2\ **Last updated:** [September 15, 2021, 6:17pm UTC](https://discuss.elastic.co/t/elasticsearch-kibana-monitors-extraction-query-fails-when-documents-doesnt-have-the-field/283323 "2021-09-15T18:17:27Z")
I have some monitors setup in Elasticsearch Kibana, using an extraction query to fetch the records where griefAttribute \> 0, this query works fine in case all the documents have the said field/attributes, otherwise the m… --- ## [Why don't Elastic Agent Integrations Leverage @timestamp Sorting?](https://discuss.elastic.co/t/why-dont-elastic-agent-integrations-leverage-timestamp-sorting/284071)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 3\ **Last updated:** [September 15, 2021, 5:06pm UTC](https://discuss.elastic.co/t/why-dont-elastic-agent-integrations-leverage-timestamp-sorting/284071 "2021-09-15T17:06:49Z")
Hi All, I was doing some research into some possible search performance tuning within my cluster, and I noticed that the Elastic Agent integrations don't leverage sorting the index on @timestamp. In release 7.6, Elasti… --- ## [Metricbeat service is not starting after adding metricbeat keystore](https://discuss.elastic.co/t/metricbeat-service-is-not-starting-after-adding-metricbeat-keystore/284223)
**Author:** [@prat](https://discuss.elastic.co/u/prat)\ **Replies:** 20\ **Last updated:** [September 15, 2021, 4:59pm UTC](https://discuss.elastic.co/t/metricbeat-service-is-not-starting-after-adding-metricbeat-keystore/284223 "2021-09-15T16:59:58Z")
Hi Team, I am following below link for metricbeat keystore setup on v7.14.0. I created the keystore as, /usr/share/metricbeat/bin/metricbeat keystore --path.config /etc/metricbeat create Created the key cat es\_p… --- ## [Caching Elasticsearch vs Redis](https://discuss.elastic.co/t/caching-elasticsearch-vs-redis/284289)
**Author:** [@Clayton\_D](https://discuss.elastic.co/u/Clayton_D)\ **Replies:** 3\ **Last updated:** [September 15, 2021, 4:59pm UTC](https://discuss.elastic.co/t/caching-elasticsearch-vs-redis/284289 "2021-09-15T16:59:39Z")
Architecture to support 2D GeoQuery As a background, I’m attempting to test a database to power backend of an app that matches users with other users based on time and coordinates (with preference for geoproximity but a… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1236) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1238)