# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=824

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 825

---

## [How can I generate lat long fields into geo point in elasticsearch](https://discuss.elastic.co/t/how-can-i-generate-lat-long-fields-into-geo-point-in-elasticsearch/312329)

<div class="topic-metadata">

**Author:** [@paris1](https://discuss.elastic.co/u/paris1)\
**Replies:** 4\
**Last updated:** [August 19, 2022, 6:06pm UTC](https://discuss.elastic.co/t/how-can-i-generate-lat-long-fields-into-geo-point-in-elasticsearch/312329 "2022-08-19T18:06:56Z")

</div>

0 I've ingested CSV data via pgsync from postgres RDS to elasticsearch.my index contains "lat" and "lng" "lat" : { "type" : "float" }, "lng" : { "type" : "float" How would I convert this into an ac…

---

## [SSL issue Logstash sending logs to a Kafka instance](https://discuss.elastic.co/t/ssl-issue-logstash-sending-logs-to-a-kafka-instance/312489)

<div class="topic-metadata">

**Author:** [@shanem](https://discuss.elastic.co/u/shanem)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 5:33pm UTC](https://discuss.elastic.co/t/ssl-issue-logstash-sending-logs-to-a-kafka-instance/312489 "2022-08-19T17:33:27Z")

</div>

We are getting a SSL error sending to Kafka from Logstash. We generated a csr, which was signed by the Kafka's CA. Then we took the pub and private key and converted them to a pkcs12 format with openssl with something …

---

## [Rule status is always pending](https://discuss.elastic.co/t/rule-status-is-always-pending/312424)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 6\
**Last updated:** [August 19, 2022, 4:11pm UTC](https://discuss.elastic.co/t/rule-status-is-always-pending/312424 "2022-08-19T16:11:51Z")

</div>

Hello World! Via Kibana -\> Management -\> Alerts and Insights -\> Rules and Connectors - all of my rules status is always Pending. per Get Alerting framework health API | Kibana Guide \[7.17\] | Elastic GET /api/alerting…

---

## [Proper maintenance of the Elastic Stack](https://discuss.elastic.co/t/proper-maintenance-of-the-elastic-stack/312030)

<div class="topic-metadata">

**Author:** [@MKirby](https://discuss.elastic.co/u/MKirby)\
**Replies:** 3\
**Last updated:** [August 19, 2022, 4:53pm UTC](https://discuss.elastic.co/t/proper-maintenance-of-the-elastic-stack/312030 "2022-08-19T16:53:45Z")

</div>

Good Afternoon Elasticsearch Guru's I have been running my ELK SIEM for a few months now, almost a year actually and my syslogs stopped being shown. I have them coming in again now, but I need to clean up my indices so…

---

## [Line graph with split by chart is not drawing all data points](https://discuss.elastic.co/t/line-graph-with-split-by-chart-is-not-drawing-all-data-points/312484)

<div class="topic-metadata">

**Author:** [@lachlann562](https://discuss.elastic.co/u/lachlann562)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 3:50pm UTC](https://discuss.elastic.co/t/line-graph-with-split-by-chart-is-not-drawing-all-data-points/312484 "2022-08-19T15:50:46Z")

</div>

I have created a line graph that shows the response time of our webservice in categories of 2-4 sec, 4-8, 8-16,16-32,32-64, 64+ seconds. We have set the visualization to split the chart by server so its easy to see which…

---

## [Threat Intel MISP](https://discuss.elastic.co/t/threat-intel-misp/312292)

<div class="topic-metadata">

**Author:** [@VitorBarroso](https://discuss.elastic.co/u/VitorBarroso)\
**Replies:** 3\
**Last updated:** [August 19, 2022, 2:36pm UTC](https://discuss.elastic.co/t/threat-intel-misp/312292 "2022-08-19T14:36:19Z")

</div>

I'm trying to use Threat Intel MISP on filebeat and when i start the filebeat i have this error Aug 17 14:11:20 ubuntuserver filebeat\[18895\]: {"log.level":"error","@timestamp":"2022-08-17T14:11:20.550Z","log.logger":"in…

---

## [Elasticsearch better settings, mapping and queries to match with regular and nested fields](https://discuss.elastic.co/t/elasticsearch-better-settings-mapping-and-queries-to-match-with-regular-and-nested-fields/312475)

<div class="topic-metadata">

**Author:** [@babuzrb](https://discuss.elastic.co/u/babuzrb)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 2:28pm UTC](https://discuss.elastic.co/t/elasticsearch-better-settings-mapping-and-queries-to-match-with-regular-and-nested-fields/312475 "2022-08-19T14:28:25Z")

</div>

I have multi level nested list of objects along with regular fields to index in elasticsearch. For example here is a document: { "main\_field\_1" : { "level\_1" : \[ "inner\_level\_1\_field\_1": "test-2", …

---

## [Kibana \<---\> Elasticsearch integration with SSL enable](https://discuss.elastic.co/t/kibana-elasticsearch-integration-with-ssl-enable/312298)

<div class="topic-metadata">

**Author:** [@Diego\_Lopes\_Penna](https://discuss.elastic.co/u/Diego_Lopes_Penna)\
**Replies:** 5\
**Last updated:** [August 19, 2022, 2:07pm UTC](https://discuss.elastic.co/t/kibana-elasticsearch-integration-with-ssl-enable/312298 "2022-08-19T14:07:00Z")

</div>

Hello, I've tried to find a solution for this on this forum but I was not able to find a solution that solves the problem. I'm trying to configure a Kibana/Elasticsearch integration. Each one of them is running on its …

---

## [Scoring issue with copy\_to](https://discuss.elastic.co/t/scoring-issue-with-copy-to/312472)

<div class="topic-metadata">

**Author:** [@lucie-wartelle](https://discuss.elastic.co/u/lucie-wartelle)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 2:06pm UTC](https://discuss.elastic.co/t/scoring-issue-with-copy-to/312472 "2022-08-19T14:06:40Z")

</div>

Hello ! I'm facing an issue with elasticsearch 8. I have an index that contains companies and I use a copy\_to parameters to group searchable fields of these companies. However, some fields can be null, and some can cont…

---

## [Elasticsearch v8 Java API client boost Query](https://discuss.elastic.co/t/elasticsearch-v8-java-api-client-boost-query/312410)

<div class="topic-metadata">

**Author:** [@ijaxahmed](https://discuss.elastic.co/u/ijaxahmed)\
**Replies:** 4\
**Last updated:** [August 19, 2022, 1:48pm UTC](https://discuss.elastic.co/t/elasticsearch-v8-java-api-client-boost-query/312410 "2022-08-19T13:48:40Z")

</div>

I am using new Java API client . I have a method in my code which returns Query of multiple types e.g bool, range public Query createQuery(String field, String value) { if(something) return Query.of(query-\>query.ra…

---

## [Restore data from data folder](https://discuss.elastic.co/t/restore-data-from-data-folder/312448)

<div class="topic-metadata">

**Author:** [@meternich](https://discuss.elastic.co/u/meternich)\
**Replies:** 3\
**Last updated:** [August 19, 2022, 1:31pm UTC](https://discuss.elastic.co/t/restore-data-from-data-folder/312448 "2022-08-19T13:31:00Z")

</div>

I've messed up something with my backups an I accidently deleted few indexes. I have a file system copy of an index (from elastic data folder), but I have deleted index in elastic. When I copy the files into elastic data…

---

## [Inconsistency in Security setup notes for Kubernetes (TLS), autogenerated keys missing?](https://discuss.elastic.co/t/inconsistency-in-security-setup-notes-for-kubernetes-tls-autogenerated-keys-missing/312468)

<div class="topic-metadata">

**Author:** [@FreshMike](https://discuss.elastic.co/u/FreshMike)\
**Replies:** 1\
**Last updated:** [August 19, 2022, 1:11pm UTC](https://discuss.elastic.co/t/inconsistency-in-security-setup-notes-for-kubernetes-tls-autogenerated-keys-missing/312468 "2022-08-19T13:11:05Z")

</div>

Hi All, Elastic 7.17.3 via Helm Chart I have trouble with the following: This Helm chart can generate a \[Kubernetes Secret\] or use an existing one to setup Elastic credentials. This chart is setting TLS and creating …

---

## [Index lifecycle management (cleanup) based on document fields](https://discuss.elastic.co/t/index-lifecycle-management-cleanup-based-on-document-fields/312465)

<div class="topic-metadata">

**Author:** [@joeripeeters](https://discuss.elastic.co/u/joeripeeters)\
**Replies:** 1\
**Last updated:** [August 19, 2022, 12:38pm UTC](https://discuss.elastic.co/t/index-lifecycle-management-cleanup-based-on-document-fields/312465 "2022-08-19T12:38:01Z")

</div>

Hi all, I have an index with data that contains a start-date and end-date. Documents that have an end-date past today, are not valuable anymore. So ideally, I want them out of the index. Is there a way to have index li…

---

## [How to get logs of multiple hostnames using scoll api](https://discuss.elastic.co/t/how-to-get-logs-of-multiple-hostnames-using-scoll-api/312453)

<div class="topic-metadata">

**Author:** [@Gojo](https://discuss.elastic.co/u/Gojo)\
**Replies:** 1\
**Last updated:** [August 19, 2022, 10:08am UTC](https://discuss.elastic.co/t/how-to-get-logs-of-multiple-hostnames-using-scoll-api/312453 "2022-08-19T10:08:33Z")

</div>

hi all , is it possible to pass multiple hosts in scroll api , i want to get multiple logs from multiple hosts using scroll request url = '{0}/{1}/\_search?scroll=1m&ignore\_unavailable=true'.format( …

---

## [Importing CoreSetup, CoreStart, etc](https://discuss.elastic.co/t/importing-coresetup-corestart-etc/312449)

<div class="topic-metadata">

**Author:** [@Sheereen](https://discuss.elastic.co/u/Sheereen)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 9:31am UTC](https://discuss.elastic.co/t/importing-coresetup-corestart-etc/312449 "2022-08-19T09:31:18Z")

</div>

We have to import CoreSetup, CoreStart,.... from @kbn/core/server or ../../src/core/public I found importing libraries in the above 2 ways in different documents. Which one should I use? I am creating a plugin exte…

---

## [Kibana PagerDuty Connector - ability to select document field as DedupKey option](https://discuss.elastic.co/t/kibana-pagerduty-connector-ability-to-select-document-field-as-dedupkey-option/311530)

<div class="topic-metadata">

**Author:** [@sivanov](https://discuss.elastic.co/u/sivanov)\
**Replies:** 4\
**Last updated:** [August 19, 2022, 7:46am UTC](https://discuss.elastic.co/t/kibana-pagerduty-connector-ability-to-select-document-field-as-dedupkey-option/311530 "2022-08-19T07:46:55Z")

</div>

Hi, As part of PagerDuty integration, we would like to use a document field as a DedupKey field in the setup. I am struggling to find documentation that explains how to reach out, if possible at all, to document fields…

---

## [Static Mappings Ignored by Some Fields While Others Work](https://discuss.elastic.co/t/static-mappings-ignored-by-some-fields-while-others-work/312415)

<div class="topic-metadata">

**Author:** [@othman](https://discuss.elastic.co/u/othman)\
**Replies:** 2\
**Last updated:** [August 19, 2022, 7:41am UTC](https://discuss.elastic.co/t/static-mappings-ignored-by-some-fields-while-others-work/312415 "2022-08-19T07:41:56Z")

</div>

I'm fairly new to ELK stack so most likely I'm just doing something dumb. I've failed to find suitable Google results hence this post. I have an Index Template configured with mappings, and I create a fresh index and st…

---

## [What are the Vulnerabilities of elk 7.17.3v?](https://discuss.elastic.co/t/what-are-the-vulnerabilities-of-elk-7-17-3v/312421)

<div class="topic-metadata">

**Author:** [@jisha](https://discuss.elastic.co/u/jisha)\
**Replies:** 4\
**Last updated:** [August 19, 2022, 7:39am UTC](https://discuss.elastic.co/t/what-are-the-vulnerabilities-of-elk-7-17-3v/312421 "2022-08-19T07:39:02Z")

</div>

what are the Vulnerabilities of elk 7.17.3v ? what are the Solutions to fix those vulnerabilities?

---

## [Logstash doesn't receive logs from kafka (filebeat transfer logs to kafka)](https://discuss.elastic.co/t/logstash-doesnt-receive-logs-from-kafka-filebeat-transfer-logs-to-kafka/311972)

<div class="topic-metadata">

**Author:** [@NAM\_VO](https://discuss.elastic.co/u/NAM_VO)\
**Replies:** 15\
**Last updated:** [August 19, 2022, 3:26am UTC](https://discuss.elastic.co/t/logstash-doesnt-receive-logs-from-kafka-filebeat-transfer-logs-to-kafka/311972 "2022-08-19T03:26:16Z")

</div>

Hi, I'm currently using: filebeat 8.3.3 (installed on Windows), Elasticsearch version 8.3.3 logstash 8.3.3 kafka 3.2.1 elk, kafka are on 1 server (192.168.9.70) the Windows IP which installing filebeat is 192.168.9.…

---

## [ElasticSearchRepository usage in java low level client](https://discuss.elastic.co/t/elasticsearchrepository-usage-in-java-low-level-client/312346)

<div class="topic-metadata">

**Author:** [@Gowri\_Shankkari](https://discuss.elastic.co/u/Gowri_Shankkari)\
**Replies:** 2\
**Last updated:** [August 19, 2022, 6:22am UTC](https://discuss.elastic.co/t/elasticsearchrepository-usage-in-java-low-level-client/312346 "2022-08-19T06:22:15Z")

</div>

I am using 'elasticsearch-rest-client:8.3.3' to connect elasticsearch using java low level rest client. Is there a way to use ElasticsearchRepository (@Document annotation) when using low level rest client. I know it is …

---

## [Regular Expression](https://discuss.elastic.co/t/regular-expression/312426)

<div class="topic-metadata">

**Author:** [@Pranjal\_Sett](https://discuss.elastic.co/u/Pranjal_Sett)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 5:31am UTC](https://discuss.elastic.co/t/regular-expression/312426 "2022-08-19T05:31:09Z")

</div>

Hi, Can anyone please help me with this regular expression!! So, this is my string 'timerange={timerange from=\\"now/d\\" to=\\"now/d\\"}' I want to findall and replace with 'timerange={timerange from=\\"2022-08-19T04:00:00…

---

## [Elastic Agent 8.3.3 - Endpoint Security Integration not found inside host](https://discuss.elastic.co/t/elastic-agent-8-3-3-endpoint-security-integration-not-found-inside-host/312419)

<div class="topic-metadata">

**Author:** [@ZiaulAfiq](https://discuss.elastic.co/u/ZiaulAfiq)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 2:16am UTC](https://discuss.elastic.co/t/elastic-agent-8-3-3-endpoint-security-integration-not-found-inside-host/312419 "2022-08-19T02:16:40Z")

</div>

Hi all! Need some clarification here. I have successfully installed elastic-agent version 8.3.3 into a host but it seems that only endpoint-security have error during running diagnostics test on host. For the host, I…

---

## [Circuit\_breaking\_exception for \[request\] Data too large, but index being queried is only 8.44mb](https://discuss.elastic.co/t/circuit-breaking-exception-for-request-data-too-large-but-index-being-queried-is-only-8-44mb/312418)

<div class="topic-metadata">

**Author:** [@Zelfapp](https://discuss.elastic.co/u/Zelfapp)\
**Replies:** 0\
**Last updated:** [August 19, 2022, 1:04am UTC](https://discuss.elastic.co/t/circuit-breaking-exception-for-request-data-too-large-but-index-being-queried-is-only-8-44mb/312418 "2022-08-19T01:04:00Z")

</div>

I'm getting this error when running the aggregation below. The index being queried is only 8.44mb. I was able to run these types of queries on a much smaller cluster, in terms of RAM, with ES v6 and never see these types…

---

## [Can we change SSL CA cert after adding license with old SSL](https://discuss.elastic.co/t/can-we-change-ssl-ca-cert-after-adding-license-with-old-ssl/312404)

<div class="topic-metadata">

**Author:** [@Dipesh](https://discuss.elastic.co/u/Dipesh)\
**Replies:** 1\
**Last updated:** [August 19, 2022, 12:13am UTC](https://discuss.elastic.co/t/can-we-change-ssl-ca-cert-after-adding-license-with-old-ssl/312404 "2022-08-19T00:13:04Z")

</div>

HI Team, Currently i am working on Elasticsearch 8.3 with self generated CA Cert and ssl's and i want to add license but have a doubt. can we change CA Certs after Adding License with old certs?

---

## [Add timezone local to all events with fleet-managed elastic agent](https://discuss.elastic.co/t/add-timezone-local-to-all-events-with-fleet-managed-elastic-agent/312408)

<div class="topic-metadata">

**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\
**Replies:** 0\
**Last updated:** [August 18, 2022, 7:55pm UTC](https://discuss.elastic.co/t/add-timezone-local-to-all-events-with-fleet-managed-elastic-agent/312408 "2022-08-18T19:55:04Z")

</div>

Is there a way to include an add\_locale.format: 'offset' processor by default for all events sent in by a fleet-managed elastic agent? I have a number of custom logs that don't have proper timezone indicators, so my inge…

---

## [Elastic Search 7 on Microsoft Azure Connection Failure](https://discuss.elastic.co/t/elastic-search-7-on-microsoft-azure-connection-failure/312407)

<div class="topic-metadata">

**Author:** [@JSK1304](https://discuss.elastic.co/u/JSK1304)\
**Replies:** 0\
**Last updated:** [August 18, 2022, 7:52pm UTC](https://discuss.elastic.co/t/elastic-search-7-on-microsoft-azure-connection-failure/312407 "2022-08-18T19:52:51Z")

</div>

I am new to Elasticsearch and I have created a 1 node Elasticsearch cluster in Microsoft Azure using the "Elastic Stack" template. But I am not able to connect to the cluster using connection pool or using a single node…

---

## [Migrating the index from 7.14 version to the new elasticsearch cluster with 8.0 version](https://discuss.elastic.co/t/migrating-the-index-from-7-14-version-to-the-new-elasticsearch-cluster-with-8-0-version/312400)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 1\
**Last updated:** [August 18, 2022, 7:33pm UTC](https://discuss.elastic.co/t/migrating-the-index-from-7-14-version-to-the-new-elasticsearch-cluster-with-8-0-version/312400 "2022-08-18T19:33:45Z")

</div>

Is it possible to migrate the data from elasticsearch cluster with 7.14 version to new cluster which is having 8.0 version? Is there any migration path has been defined for this activity? Any utilities available?

---

## [Trouble running the ELK-8.3.3 docker-compose instructions. failed to retrieve password hash](https://discuss.elastic.co/t/trouble-running-the-elk-8-3-3-docker-compose-instructions-failed-to-retrieve-password-hash/312403)

<div class="topic-metadata">

**Author:** [@Mike\_MacHenry](https://discuss.elastic.co/u/Mike_MacHenry)\
**Replies:** 0\
**Last updated:** [August 18, 2022, 6:26pm UTC](https://discuss.elastic.co/t/trouble-running-the-elk-8-3-3-docker-compose-instructions-failed-to-retrieve-password-hash/312403 "2022-08-18T18:26:41Z")

</div>

Hey folks, I have copied the tutorial from here and I have been unable to make the basic tutorial work. I have followed it by copying the docker-compose.yaml and .env file, updating my passwords in the .env, and also vp…

---

## [Filtering directly from data table - Kibana dashboard](https://discuss.elastic.co/t/filtering-directly-from-data-table-kibana-dashboard/312075)

<div class="topic-metadata">

**Author:** [@SaraAlshamsi](https://discuss.elastic.co/u/SaraAlshamsi)\
**Replies:** 3\
**Last updated:** [August 18, 2022, 6:03pm UTC](https://discuss.elastic.co/t/filtering-directly-from-data-table-kibana-dashboard/312075 "2022-08-18T18:03:57Z")

</div>

Hello, I have an issue in filtering directly from a data table in Kibana dashboard. Case 1: When I select an item, to filter it, from the first page of the table, I can filter without any problem and the filter is app…

---

## [Migrating from HLRC 7.17 to Java Client 8.13 - missing PercolateQueryBuilder](https://discuss.elastic.co/t/migrating-from-hlrc-7-17-to-java-client-8-13-missing-percolatequerybuilder/312300)

<div class="topic-metadata">

**Author:** [@javierco](https://discuss.elastic.co/u/javierco)\
**Replies:** 3\
**Last updated:** [August 18, 2022, 4:58pm UTC](https://discuss.elastic.co/t/migrating-from-hlrc-7-17-to-java-client-8-13-missing-percolatequerybuilder/312300 "2022-08-18T16:58:18Z")

</div>

I'm testing the migration of the Java api for High Level Rest Client version 7.17 into the new Java API Client 8.3 and I'm having problems finding the equivalent to: org.elasticsearch.percolator.PercolateQueryBuilder; L…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=823)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=825)
