# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=767 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 768 --- ## [Getting the same values multiple times while integrating Mysql with Logstash](https://discuss.elastic.co/t/getting-the-same-values-multiple-times-while-integrating-mysql-with-logstash/316277)
**Author:** [@Ritikapawar](https://discuss.elastic.co/u/Ritikapawar)\ **Replies:** 1\ **Last updated:** [October 11, 2022, 2:37pm UTC](https://discuss.elastic.co/t/getting-the-same-values-multiple-times-while-integrating-mysql-with-logstash/316277 "2022-10-11T14:37:22Z")
I've created a pipeline to get data directly from Mysql to kibana using logstash and Jdbc input plugin But when I do the actual execution on .conf file I'm getting the same values multiple time in the elastic index. he… --- ## [Elastic agent in k8s after several days stops sending same metrics](https://discuss.elastic.co/t/elastic-agent-in-k8s-after-several-days-stops-sending-same-metrics/316342)
**Author:** [@gabrielfsousa](https://discuss.elastic.co/u/gabrielfsousa)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 2:32pm UTC](https://discuss.elastic.co/t/elastic-agent-in-k8s-after-several-days-stops-sending-same-metrics/316342 "2022-10-11T14:32:16Z")
in 7.16.2 after installing elastic agent in k8s everything works. but after several days stops sending same metrics. if i restart the elastic agent pods, starts working good. there's NOTHING in the logs. ZERO errors … --- ## [Reindex specific documents](https://discuss.elastic.co/t/reindex-specific-documents/316333)
**Author:** [@spike83](https://discuss.elastic.co/u/spike83)\ **Replies:** 1\ **Last updated:** [October 11, 2022, 2:28pm UTC](https://discuss.elastic.co/t/reindex-specific-documents/316333 "2022-10-11T14:28:41Z")
Hi, I have accidentally mixed docs into an index (not going to go into how lets just call it a silly config mistake) I have luckily tagged the docs and would like to reindex all docs that meet a specific tag. Could an… --- ## [Deploy Logstash pipeline through Gitlab CI/CD](https://discuss.elastic.co/t/deploy-logstash-pipeline-through-gitlab-ci-cd/316257)
**Author:** [@kmz161](https://discuss.elastic.co/u/kmz161)\ **Replies:** 3\ **Last updated:** [October 11, 2022, 12:56pm UTC](https://discuss.elastic.co/t/deploy-logstash-pipeline-through-gitlab-ci-cd/316257 "2022-10-11T12:56:22Z")
Hi! I use Centralized Pipeline Management for creation and management pipeline. But I can’t saved changing of pipeline settings . Because of it I started use Gitlab to store pipelines config. And now I need perform tw… --- ## [Kibana (8.4.2) visualization does not show metadata fields](https://discuss.elastic.co/t/kibana-8-4-2-visualization-does-not-show-metadata-fields/316279)
**Author:** [@amirfarsi](https://discuss.elastic.co/u/amirfarsi)\ **Replies:** 3\ **Last updated:** [October 11, 2022, 12:32pm UTC](https://discuss.elastic.co/t/kibana-8-4-2-visualization-does-not-show-metadata-fields/316279 "2022-10-11T12:32:07Z")
Hello friends. We updated our ELK from 7.\* to 8.4.2, and we used from our backups to restoring visualization, dashboards, data views (index pattern) and ... We had problems that were fixed, except for the following : … --- ## [Issue in parsing JSON data](https://discuss.elastic.co/t/issue-in-parsing-json-data/316210)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 1\ **Last updated:** [October 11, 2022, 12:06pm UTC](https://discuss.elastic.co/t/issue-in-parsing-json-data/316210 "2022-10-11T12:06:10Z")
Sample Logs \[{ "Name":"abc", "Phone\_no":"9877231", "Gender":"M" } \] I am getting data from filebeat - paths: - /root/test.log fields: {log\_type: json-multiline} multiline.type: pattern multiline.pattern: '^\\… --- ## [Document level security not behaving as expected](https://discuss.elastic.co/t/document-level-security-not-behaving-as-expected/316320)
**Author:** [@iaata](https://discuss.elastic.co/u/iaata)\ **Replies:** 2\ **Last updated:** [October 11, 2022, 11:16am UTC](https://discuss.elastic.co/t/document-level-security-not-behaving-as-expected/316320 "2022-10-11T11:16:42Z")
Hello. I am trying to setup document level security for a single index. My goal is to restrict access to documents in a way, where users only have access to the documents where their username match a field in the docum… --- ## [🐌 Poor search performance when searching in data stream indexes](https://discuss.elastic.co/t/poor-search-performance-when-searching-in-data-stream-indexes/315531)
**Author:** [@Its\_Anton](https://discuss.elastic.co/u/Its_Anton)\ **Replies:** 4\ **Last updated:** [October 11, 2022, 10:48am UTC](https://discuss.elastic.co/t/poor-search-performance-when-searching-in-data-stream-indexes/315531 "2022-10-11T10:48:00Z")
Hi! :wave: I have a pretty small amount of documents from Metricbeat and I have loaded them into 2 ways into Elasticsearch: Using the default Metricbeat index template and datastream (created by Metricbeat), ILM poli… --- ## [LDAP User Authentication Multiple Users](https://discuss.elastic.co/t/ldap-user-authentication-multiple-users/316319)
**Author:** [@Tarah](https://discuss.elastic.co/u/Tarah)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 10:47am UTC](https://discuss.elastic.co/t/ldap-user-authentication-multiple-users/316319 "2022-10-11T10:47:29Z")
Hi Elastic Team, I'm still new on configuring LDAP User Auth. Just wanted to ask if it's possible to use the password value in LDAP directly as the bind password? Because what I have done today was only 1 user and just … --- ## [Salesforce integration with ELK](https://discuss.elastic.co/t/salesforce-integration-with-elk/316317)
**Author:** [@Ayaan\_Shaik](https://discuss.elastic.co/u/Ayaan_Shaik)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 10:40am UTC](https://discuss.elastic.co/t/salesforce-integration-with-elk/316317 "2022-10-11T10:40:45Z")
Hi team, I'm Using ELK version : 8.3.3 I am trying to ingest Salesforce data with the help of file beat module Salesforce through logstash , But I'm unable to get the data into kibana and elasticsearch . Suppose if I … --- ## [Field mapping: "ignore\_above" and "index" settings](https://discuss.elastic.co/t/field-mapping-ignore-above-and-index-settings/316235)
**Author:** [@gdd](https://discuss.elastic.co/u/gdd)\ **Replies:** 0\ **Last updated:** [October 10, 2022, 2:24pm UTC](https://discuss.elastic.co/t/field-mapping-ignore-above-and-index-settings/316235 "2022-10-10T14:24:36Z")
I experienced bulks by logstash returning some errors, The template contained this mapping for event.original field: {"index": false, "type": "keyword", "doc\_values": false } The unexpected solution has been the intro… --- ## [ES upgrade from 6 to 8 - How to?](https://discuss.elastic.co/t/es-upgrade-from-6-to-8-how-to/316290)
**Author:** [@Eduardo\_Montes](https://discuss.elastic.co/u/Eduardo_Montes)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 8:40am UTC](https://discuss.elastic.co/t/es-upgrade-from-6-to-8-how-to/316290 "2022-10-11T08:40:35Z")
Hi, I tried to make the ES upgrade from 6.2.4 to 8.4. I found out that there are many not supported features in 8 version. E.g. missing tree a precision attributes in geo\_shape data type, not supported possibility to d… --- ## [Logstash input configuration](https://discuss.elastic.co/t/logstash-input-configuration/316296)
**Author:** [@ttyser](https://discuss.elastic.co/u/ttyser)\ **Replies:** 2\ **Last updated:** [October 11, 2022, 10:09am UTC](https://discuss.elastic.co/t/logstash-input-configuration/316296 "2022-10-11T10:09:00Z")
Hello, I have a question how should Logstash input config look like in case I have Fleet server, multiple agents/endpoints, checkpoint firewall etc logging to Logstash. What I am trying to ask is, should every agent have… --- ## [Point In Time for multi threaded queries / slices](https://discuss.elastic.co/t/point-in-time-for-multi-threaded-queries-slices/316243)
**Author:** [@str8y](https://discuss.elastic.co/u/str8y)\ **Replies:** 0\ **Last updated:** [October 10, 2022, 3:51pm UTC](https://discuss.elastic.co/t/point-in-time-for-multi-threaded-queries-slices/316243 "2022-10-10T15:51:19Z")
Hi, I read in the documentation that every result could contain an updated id for the pit I created, which I have to use in subsequent search requests. How does that behave in scenarios where I'm using multiple searche… --- ## [Delete actual config of snapshot](https://discuss.elastic.co/t/delete-actual-config-of-snapshot/316295)
**Author:** [@abkrim](https://discuss.elastic.co/u/abkrim)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 9:05am UTC](https://discuss.elastic.co/t/delete-actual-config-of-snapshot/316295 "2022-10-11T09:05:35Z")
After working for a while in test mode, I wanted to start using NFS as a mount point for snapshots. I had a configuration in the elasticsearch.yml file \`path.repo:/snapshot\_elk I remember creating the snapshot with Kib… --- ## [Polygon storage failed](https://discuss.elastic.co/t/polygon-storage-failed/316162)
**Author:** [@baiwenbo1997](https://discuss.elastic.co/u/baiwenbo1997)\ **Replies:** 12\ **Last updated:** [October 11, 2022, 8:42am UTC](https://discuss.elastic.co/t/polygon-storage-failed/316162 "2022-10-11T08:42:40Z")
POLYGON((38591455.29279993 3341853.182999084,38591450.89579993 3341845.826799084,38591447.82339992 3341841.763499084,38591444.25549993 3341839.186599084,38591438.30899993 3341835.420499084,38591431.17329992 3341830.66319… --- ## [Logstash Pipeline getting Terminated due to avro format of kakfka topic](https://discuss.elastic.co/t/logstash-pipeline-getting-terminated-due-to-avro-format-of-kakfka-topic/316276)
**Author:** [@Akumar22](https://discuss.elastic.co/u/Akumar22)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 6:45am UTC](https://discuss.elastic.co/t/logstash-pipeline-getting-terminated-due-to-avro-format-of-kakfka-topic/316276 "2022-10-11T06:45:24Z")
Hi, I have a topic in kafka which has messages in avro format, pasting a part of message below .. We are using this avro schema format, pasting a part of schema { "type" : "record", "name" : "ProductDetailsSc… --- ## [Install Elastic Agent on Windows from a read-only smb share](https://discuss.elastic.co/t/install-elastic-agent-on-windows-from-a-read-only-smb-share/316287)
**Author:** [@moschur](https://discuss.elastic.co/u/moschur)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 8:35am UTC](https://discuss.elastic.co/t/install-elastic-agent-on-windows-from-a-read-only-smb-share/316287 "2022-10-11T08:35:34Z")
Hello! we are trying to install Elastic Agent (fleet-managed) on Windows using our software distribution tool. For this, we place the installation files on a read-only smb share. During installation, this share is mount… --- ## [CCS results sorting](https://discuss.elastic.co/t/ccs-results-sorting/316285)
**Author:** [@Ong](https://discuss.elastic.co/u/Ong)\ **Replies:** 0\ **Last updated:** [October 11, 2022, 8:29am UTC](https://discuss.elastic.co/t/ccs-results-sorting/316285 "2022-10-11T08:29:35Z")
I am setting up CCS with a remote cluster that contains 2 indexes using Kibana's data (kibana\_sample\_data\_ecommerce and kibana\_sample\_data\_flights). When performing a search across these 2 indexes, I noticed that the da… --- ## [Can Filebeat access certs within a docker container?](https://discuss.elastic.co/t/can-filebeat-access-certs-within-a-docker-container/316004)
**Author:** [@userR](https://discuss.elastic.co/u/userR)\ **Replies:** 3\ **Last updated:** [October 11, 2022, 8:09am UTC](https://discuss.elastic.co/t/can-filebeat-access-certs-within-a-docker-container/316004 "2022-10-11T08:09:42Z")
Hi, we are currently running an application on a server through Docker. Unfortunately, the certs and logs are within the container itself. When setting up Filebeat, I was wondering if there was a way to access those cer… --- ## [Scripted metric not working inside transform](https://discuss.elastic.co/t/scripted-metric-not-working-inside-transform/316061)
**Author:** [@Hemabh\_Ravee\_Fox](https://discuss.elastic.co/u/Hemabh_Ravee_Fox)\ **Replies:** 2\ **Last updated:** [October 11, 2022, 8:06am UTC](https://discuss.elastic.co/t/scripted-metric-not-working-inside-transform/316061 "2022-10-11T08:06:52Z")
Hi, I have an index which contains events as documents and I'm trying to aggregate them by sessionId. I created the following transform and so far I have been able to generate the startTime, endTime, and sessionDuration,… --- ## [Cannot connect to Elasticsearch cluster using cloud\_id](https://discuss.elastic.co/t/cannot-connect-to-elasticsearch-cluster-using-cloud-id/316203)
**Author:** [@h.allaoui](https://discuss.elastic.co/u/h.allaoui)\ **Replies:** 8\ **Last updated:** [October 11, 2022, 7:57am UTC](https://discuss.elastic.co/t/cannot-connect-to-elasticsearch-cluster-using-cloud-id/316203 "2022-10-11T07:57:00Z")
Hi All, I have an issue, I cannot to connect to my Elasticsearch cluster from python client using its cloud\_id. I am getting following error: File "D:\\Data\\Hamid\\Workspace\\Python\\MyTools\\venv\\lib\\site-packages\\elast… --- ## [Trying to build index template from dynamicly generated template](https://discuss.elastic.co/t/trying-to-build-index-template-from-dynamicly-generated-template/315943)
**Author:** [@fribse](https://discuss.elastic.co/u/fribse)\ **Replies:** 2\ **Last updated:** [October 11, 2022, 7:52am UTC](https://discuss.elastic.co/t/trying-to-build-index-template-from-dynamicly-generated-template/315943 "2022-10-11T07:52:15Z")
I want to apply lifecycle policy on some of the indexes. So I think I need to create an index template, otherwise I will have to contiunally apply the policy to newly created indexes. I pulled an index template from a … --- ## [Aggregate + sort + paginate on nested documents](https://discuss.elastic.co/t/aggregate-sort-paginate-on-nested-documents/314715)
**Author:** [@t0mer](https://discuss.elastic.co/u/t0mer)\ **Replies:** 1\ **Last updated:** [October 11, 2022, 7:44am UTC](https://discuss.elastic.co/t/aggregate-sort-paginate-on-nested-documents/314715 "2022-10-11T07:44:19Z")
Hi, I'm managing a product index, with product sales and other KPIs under a nested field. Trying to sort based on nested aggregation, and paginate - with no success. Below is a simplified version of my mapping, for th… --- ## [Elasticsearch 7.17.4 crashes without an error message, while indexing large chunks of data on Windows](https://discuss.elastic.co/t/elasticsearch-7-17-4-crashes-without-an-error-message-while-indexing-large-chunks-of-data-on-windows/314690)
**Author:** [@simon137](https://discuss.elastic.co/u/simon137)\ **Replies:** 7\ **Last updated:** [October 11, 2022, 7:38am UTC](https://discuss.elastic.co/t/elasticsearch-7-17-4-crashes-without-an-error-message-while-indexing-large-chunks-of-data-on-windows/314690 "2022-10-11T07:38:34Z")
Hello, I tried multiple java heap configurations for both logstash and elasticsearch, and also using a persisted queue (with space up to 40gb) instead of a memory queue, but it's always the same: If I take a large chun… --- ## [Duplicate : Scripted metric not working inside transform](https://discuss.elastic.co/t/duplicate-scripted-metric-not-working-inside-transform/316269)
**Author:** [@Hemabh\_Ravee](https://discuss.elastic.co/u/Hemabh_Ravee)\ **Replies:** 4\ **Last updated:** [October 11, 2022, 6:40am UTC](https://discuss.elastic.co/t/duplicate-scripted-metric-not-working-inside-transform/316269 "2022-10-11T06:40:23Z")
First of all, I'd like to clarify that the reason I'm posting this question because I am unable to add any replies or edits to the original one. I'm finding myself unable to post questions as well using that account(err… --- ## [Alert: Large shard size](https://discuss.elastic.co/t/alert-large-shard-size/316184)
**Author:** [@Michele\_De\_Benedet](https://discuss.elastic.co/u/Michele_De_Benedet)\ **Replies:** 3\ **Last updated:** [October 11, 2022, 6:18am UTC](https://discuss.elastic.co/t/alert-large-shard-size/316184 "2022-10-11T06:18:39Z")
Hi, I am using Logstash to feed an index. Current index size is 60GB and I'm expecting it to grow to at most 100GB, so I set it to use 6 shards. Elasticsearch is ran on a single node. The status of the index in Kibana … --- ## [Logstash was having pipeline error: event executor terminated. What would possibly be the problem?](https://discuss.elastic.co/t/logstash-was-having-pipeline-error-event-executor-terminated-what-would-possibly-be-the-problem/316212)
**Author:** [@prashanthk](https://discuss.elastic.co/u/prashanthk)\ **Replies:** 5\ **Last updated:** [October 11, 2022, 3:52am UTC](https://discuss.elastic.co/t/logstash-was-having-pipeline-error-event-executor-terminated-what-would-possibly-be-the-problem/316212 "2022-10-11T03:52:28Z")
input { http { host =\> "0.0.0.0" port =\> 8443 user =\> provider password =\> "c6N65uxZ$M5@" # ssl =\> true # keystore =\> "/etc/logstash/keystore.jks" # keystore\_password =\> "password" } } filter { mutate { add\_f… --- ## [Bootstrap check failure](https://discuss.elastic.co/t/bootstrap-check-failure/316025)
**Author:** [@rt\_888](https://discuss.elastic.co/u/rt_888)\ **Replies:** 4\ **Last updated:** [October 11, 2022, 3:46am UTC](https://discuss.elastic.co/t/bootstrap-check-failure/316025 "2022-10-11T03:46:54Z")
I tried using ES on AWS server of ubutu image, and modify the elasticsearch.yml file of node, discovery.seed\_hosts, master node . But got error with bootstrap node validation exception and it shows "at least one of \[dis… --- ## [Logstash auto reload the pipeline?](https://discuss.elastic.co/t/logstash-auto-reload-the-pipeline/316152)
**Author:** [@Nikolas1306](https://discuss.elastic.co/u/Nikolas1306)\ **Replies:** 1\ **Last updated:** [October 11, 2022, 1:38am UTC](https://discuss.elastic.co/t/logstash-auto-reload-the-pipeline/316152 "2022-10-11T01:38:02Z")
hello i've installed elk on cloud but the image have the original configuration pipeline if change the config and reload the image all file is reset with originals exist a method with modify pipeline and reload logstas… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=766) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=768)