# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=141 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 142 --- ## [Issue : Data in a elasticsearch index is randomly getting deleted and the primary shard is getting unassigned](https://discuss.elastic.co/t/issue-data-in-a-elasticsearch-index-is-randomly-getting-deleted-and-the-primary-shard-is-getting-unassigned/370154)
**Author:** [@hariv0](https://discuss.elastic.co/u/hariv0)\ **Replies:** 0\ **Last updated:** [November 7, 2024, 7:41am UTC](https://discuss.elastic.co/t/issue-data-in-a-elasticsearch-index-is-randomly-getting-deleted-and-the-primary-shard-is-getting-unassigned/370154 "2024-11-07T07:41:44Z")
I am using elasticsearch v8.13.2 with docker and single node. I have been facing loss of docs at random indices. this used to get resolved automatically earlier on increasing the ram size, but at current stage that is al… --- ## [Whether our SaaS product can use Elasticsearch 8.x for free under Elastic License](https://discuss.elastic.co/t/whether-our-saas-product-can-use-elasticsearch-8-x-for-free-under-elastic-license/370118)
**Author:** [@Nigel\_C](https://discuss.elastic.co/u/Nigel_C)\ **Replies:** 2\ **Last updated:** [November 7, 2024, 6:45am UTC](https://discuss.elastic.co/t/whether-our-saas-product-can-use-elasticsearch-8-x-for-free-under-elastic-license/370118 "2024-11-07T06:45:18Z")
Hi Elastic team, we are developing a SaaS application mainly used to provide users with collaboration functions. Currently, we plan to use Elasticsearch to provide the search function in our application. Our specific usa… --- ## [Enroll standalone elastic-agent to fleet](https://discuss.elastic.co/t/enroll-standalone-elastic-agent-to-fleet/370148)
**Author:** [@mike123](https://discuss.elastic.co/u/mike123)\ **Replies:** 0\ **Last updated:** [November 7, 2024, 4:54am UTC](https://discuss.elastic.co/t/enroll-standalone-elastic-agent-to-fleet/370148 "2024-11-07T04:54:13Z")
Is there any ways to enroll an elastic agent( that was installed as standalone agent) to fleet server? --- ## [Elastic License activation without internet (on prem)](https://discuss.elastic.co/t/elastic-license-activation-without-internet-on-prem/370110)
**Author:** [@TCT](https://discuss.elastic.co/u/TCT)\ **Replies:** 1\ **Last updated:** [November 7, 2024, 1:58am UTC](https://discuss.elastic.co/t/elastic-license-activation-without-internet-on-prem/370110 "2024-11-07T01:58:03Z")
I am using a self-managed Elastic Stack in a private network without internet access, and I want to know if it's possible to activate the Elastic License without an internet connection. In the License Management section… --- ## [Null\_pointer\_exception when using aggregation](https://discuss.elastic.co/t/null-pointer-exception-when-using-aggregation/370029)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 2\ **Last updated:** [November 6, 2024, 5:41pm UTC](https://discuss.elastic.co/t/null-pointer-exception-when-using-aggregation/370029 "2024-11-06T17:41:18Z")
Hi Community, I want to run this query GET employees/\_search { "aggs": { "Total Income": { "sum": { "field": "Package", "script": { "source": "if(params.\_source\['name.keyword'\]=='E… --- ## [Error enrolling agent](https://discuss.elastic.co/t/error-enrolling-agent/370135)
**Author:** [@juancamiloll](https://discuss.elastic.co/u/juancamiloll)\ **Replies:** 0\ **Last updated:** [November 6, 2024, 3:49pm UTC](https://discuss.elastic.co/t/error-enrolling-agent/370135 "2024-11-06T15:49:26Z")
Hello, me again hehehehe I have a new error when installing an agent, although I found related documentation I would like to please confirm me if I understood the solution if I simply run the following lines Solve the … --- ## [Elastic Agent TLS Metadata](https://discuss.elastic.co/t/elastic-agent-tls-metadata/370133)
**Author:** [@axvfvv79zcx57xv7k](https://discuss.elastic.co/u/axvfvv79zcx57xv7k)\ **Replies:** 0\ **Last updated:** [November 6, 2024, 3:17pm UTC](https://discuss.elastic.co/t/elastic-agent-tls-metadata/370133 "2024-11-06T15:17:14Z")
Hello Elastic Community, I'm currently transitioning from a Logstash-based pipeline to the Elastic Agent for managing our data collection and monitoring. However, I've run into an issue with capturing TLS metadata (such… --- ## [Rename fields in logstash](https://discuss.elastic.co/t/rename-fields-in-logstash/369812)
**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\ **Replies:** 6\ **Last updated:** [November 6, 2024, 1:50pm UTC](https://discuss.elastic.co/t/rename-fields-in-logstash/369812 "2024-11-06T13:50:44Z")
Hello team, from below log i am trying to remove below fields from logstash but it is not working as expected. Can you please help me on this: This is how field is coming in kibana: value.com.softwareag.um.server:… --- ## [Antivirus directory exclusions on separate Kibana, Logstash, and Elastic Servers - Linux](https://discuss.elastic.co/t/antivirus-directory-exclusions-on-separate-kibana-logstash-and-elastic-servers-linux/370095)
**Author:** [@mmletzko](https://discuss.elastic.co/u/mmletzko)\ **Replies:** 2\ **Last updated:** [November 6, 2024, 1:38pm UTC](https://discuss.elastic.co/t/antivirus-directory-exclusions-on-separate-kibana-logstash-and-elastic-servers-linux/370095 "2024-11-06T13:38:55Z")
Was wondering if anyone could tell me exactly what folders on each of these servers should be excluded from AntiVirus, or point me to the documentation that covers it: -Kibana: Linux -Logstash: Linux -Elastic: Linu… --- ## [Logstash pods not pushing logs to Elastic](https://discuss.elastic.co/t/logstash-pods-not-pushing-logs-to-elastic/370120)
**Author:** [@devops\_training](https://discuss.elastic.co/u/devops_training)\ **Replies:** 0\ **Last updated:** [November 6, 2024, 11:18am UTC](https://discuss.elastic.co/t/logstash-pods-not-pushing-logs-to-elastic/370120 "2024-11-06T11:18:50Z")
There is no error in log file (logstash-plain.log). Sincedb is zero in size and I restarted the logstash pods. Then the sincedb file is 81 bytes and later it resets to zero. I m using file input. This was working set an… --- ## [Kibana Embedded Dashboard](https://discuss.elastic.co/t/kibana-embedded-dashboard/370002)
**Author:** [@abdulrahman\_chamma](https://discuss.elastic.co/u/abdulrahman_chamma)\ **Replies:** 2\ **Last updated:** [November 6, 2024, 10:50am UTC](https://discuss.elastic.co/t/kibana-embedded-dashboard/370002 "2024-11-06T10:50:02Z")
I'm trying to embed my kibana dashboard in a simple HTML page, i'm getting the error 401 on the following link "localhost:5601/internal/security/user\_profile?dataPath=avatar%2CuserSettings" I tried to logon as anonymous… --- ## [Drop json array data and read first event only](https://discuss.elastic.co/t/drop-json-array-data-and-read-first-event-only/370106)
**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\ **Replies:** 0\ **Last updated:** [November 6, 2024, 7:14am UTC](https://discuss.elastic.co/t/drop-json-array-data-and-read-first-event-only/370106 "2024-11-06T07:14:27Z")
Hello team, Can we drop json array values and send data to elasticsearch only for latest values. Sample log line: { "@ad.context": "mydata", "value": \[ { "app\_name": "facebook", … --- ## [Elasticsearch BULK API with .NET for upsert](https://discuss.elastic.co/t/elasticsearch-bulk-api-with-net-for-upsert/370003)
**Author:** [@Moni\_Hazarika](https://discuss.elastic.co/u/Moni_Hazarika)\ **Replies:** 16\ **Last updated:** [November 6, 2024, 6:34am UTC](https://discuss.elastic.co/t/elasticsearch-bulk-api-with-net-for-upsert/370003 "2024-11-06T06:34:22Z")
Hi Team, I am using .NET 8 and ES Version="8.15.6". I an trying to use bulk api with a logic for upsert based on the document id. I tried the below index, update commands from Kibana as per documentation and they work f… --- ## [How to compare data on two different index bassed on common field and update into 3 index](https://discuss.elastic.co/t/how-to-compare-data-on-two-different-index-bassed-on-common-field-and-update-into-3-index/370080)
**Author:** [@surinder.singh2](https://discuss.elastic.co/u/surinder.singh2)\ **Replies:** 3\ **Last updated:** [November 6, 2024, 4:57am UTC](https://discuss.elastic.co/t/how-to-compare-data-on-two-different-index-bassed-on-common-field-and-update-into-3-index/370080 "2024-11-06T04:57:25Z")
I have 3 indexes at elastic. want to compare the 2 index bassed on the common fields and update the data on 3 index. index A { name field type keyword,phoneno}. index B { name field type keyword,address}. Index C has … --- ## [Elastic + Kibana URL](https://discuss.elastic.co/t/elastic-kibana-url/369877)
**Author:** [@dfir](https://discuss.elastic.co/u/dfir)\ **Replies:** 7\ **Last updated:** [November 6, 2024, 3:55am UTC](https://discuss.elastic.co/t/elastic-kibana-url/369877 "2024-11-06T03:55:23Z")
HI: I am trying to allow other users on my network the ability to login to my Elastic+Kibana instance. I have: Set the server host in kibana.yml to 0.0.0.0, port is 5601 What else do I need to do so others internall… --- ## [Logstash elastic\_app\_search output plugin returning 404 page](https://discuss.elastic.co/t/logstash-elastic-app-search-output-plugin-returning-404-page/370097)
**Author:** [@brad-g](https://discuss.elastic.co/u/brad-g)\ **Replies:** 0\ **Last updated:** [November 5, 2024, 10:44pm UTC](https://discuss.elastic.co/t/logstash-elastic-app-search-output-plugin-returning-404-page/370097 "2024-11-05T22:44:31Z")
I have used Logstash to pass documents to App Search since 2022, but after a recent Elasticsearch update (to 8.15) my systemctl logs are showing a 404 error, with the html for this page returned in the response: This… --- ## [Issue with Lens](https://discuss.elastic.co/t/issue-with-lens/369401)
**Author:** [@QwerFact](https://discuss.elastic.co/u/QwerFact)\ **Replies:** 5\ **Last updated:** [November 5, 2024, 6:40pm UTC](https://discuss.elastic.co/t/issue-with-lens/369401 "2024-11-05T18:40:17Z")
Dear community, After a migration from version 7.17 to 8.15.3, I have an issue with some visualization. For example in the discover, the chart is not working anymore: If I go on lens and display the result by table… --- ## [Azure Frontdoor integration](https://discuss.elastic.co/t/azure-frontdoor-integration/370075)
**Author:** [@juancamiloll](https://discuss.elastic.co/u/juancamiloll)\ **Replies:** 3\ **Last updated:** [November 5, 2024, 5:02pm UTC](https://discuss.elastic.co/t/azure-frontdoor-integration/370075 "2024-11-05T17:02:59Z")
Hello everyone, I need to receive logs “Azure Frontdoor” I see that there is an integration that allows to do this but I have no idea what are the values of the fields that are required as I am not the Azure administrat… --- ## [Logstash "block in start\_workers" on shutdown](https://discuss.elastic.co/t/logstash-block-in-start-workers-on-shutdown/370015)
**Author:** [@nilsen](https://discuss.elastic.co/u/nilsen)\ **Replies:** 15\ **Last updated:** [November 5, 2024, 3:55pm UTC](https://discuss.elastic.co/t/logstash-block-in-start-workers-on-shutdown/370015 "2024-11-05T15:55:05Z")
~All of our Logstash instances gets tons of warnings on shutdown. Warning seems to tell us that something is blocked: "block in start\_workers" Our Logstash applications run with pipeline.yml: pipeline.yml example- pip… --- ## [Create alert based on top expiery date of application](https://discuss.elastic.co/t/create-alert-based-on-top-expiery-date-of-application/370077)
**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\ **Replies:** 0\ **Last updated:** [November 5, 2024, 3:07pm UTC](https://discuss.elastic.co/t/create-alert-based-on-top-expiery-date-of-application/370077 "2024-11-05T15:07:52Z")
Hello team, I have requirement to create alert if latest application name expiry date is within 15 days . Challenges: I have Json array where this information is stored and we need to alert if application name expiry i… --- ## [Power BI + Elastic](https://discuss.elastic.co/t/power-bi-elastic/369919)
**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\ **Replies:** 4\ **Last updated:** [November 5, 2024, 2:54pm UTC](https://discuss.elastic.co/t/power-bi-elastic/369919 "2024-11-05T14:54:24Z")
Hello, I was wondering since there is a way to visualize data from Elastic into Power BI. How beneficial can it be for visualization ? I tend to find Elastic's reporting to very limited and wanted to know if pursuing P… --- ## [No access to Kibana WebUI via Nginx Proxy](https://discuss.elastic.co/t/no-access-to-kibana-webui-via-nginx-proxy/369989)
**Author:** [@sharbich](https://discuss.elastic.co/u/sharbich)\ **Replies:** 24\ **Last updated:** [November 5, 2024, 2:28pm UTC](https://discuss.elastic.co/t/no-access-to-kibana-webui-via-nginx-proxy/369989 "2024-11-05T14:28:52Z")
Hello, i just can't get my Kibana WebUI to load. After 5 seconds I get the following error message in the web browser: Kibana server is not ready yet. System Information: root@dsme01:~# lsb\_release -a No LSB modules … --- ## [Issue: Nodes Getting Deleted Suddenly in Elasticsearch](https://discuss.elastic.co/t/issue-nodes-getting-deleted-suddenly-in-elasticsearch/370073)
**Author:** [@hariv0](https://discuss.elastic.co/u/hariv0)\ **Replies:** 4\ **Last updated:** [November 5, 2024, 1:54pm UTC](https://discuss.elastic.co/t/issue-nodes-getting-deleted-suddenly-in-elasticsearch/370073 "2024-11-05T13:54:19Z")
I am experiencing an issue where nodes in our Elasticsearch cluster are getting deleted suddenly. This issue is causing shard allocation failures and recovery problems. Below are the anonymized logs related to the issue: … --- ## [How to filter movies by title and multiple genres, while aggregating genre counts in Elasticsearch?](https://discuss.elastic.co/t/how-to-filter-movies-by-title-and-multiple-genres-while-aggregating-genre-counts-in-elasticsearch/370039)
**Author:** [@Shell\_Dias](https://discuss.elastic.co/u/Shell_Dias)\ **Replies:** 4\ **Last updated:** [November 5, 2024, 1:46pm UTC](https://discuss.elastic.co/t/how-to-filter-movies-by-title-and-multiple-genres-while-aggregating-genre-counts-in-elasticsearch/370039 "2024-11-05T13:46:20Z")
Hi everyone! I'm working with a movie index in Elasticsearch and need help building a query. Here’s the requirement: I want to retrieve movies where the title contains a specific term, such as "car," and the genre ma… --- ## [Reading scroll request IDs leads to OOB access](https://discuss.elastic.co/t/reading-scroll-request-ids-leads-to-oob-access/370070)
**Author:** [@fetch](https://discuss.elastic.co/u/fetch)\ **Replies:** 2\ **Last updated:** [November 5, 2024, 1:14pm UTC](https://discuss.elastic.co/t/reading-scroll-request-ids-leads-to-oob-access/370070 "2024-11-05T13:14:16Z")
Hello, I'm using a cluster with 3 ELK nodes with 7.10.1 version installed in it. I know that it's a bit old, but any update usually brings much pain with my data, so I dont touch it while it works fine. Today I've noti… --- ## [seach higher than in a message field](https://discuss.elastic.co/t/seach-higher-than-in-a-message-field/370023)
**Author:** [@Joost2](https://discuss.elastic.co/u/Joost2)\ **Replies:** 1\ **Last updated:** [November 5, 2024, 12:56pm UTC](https://discuss.elastic.co/t/seach-higher-than-in-a-message-field/370023 "2024-11-05T12:56:36Z")
Message field , is SUCCES Sending eenheidUpdated to URL https://xx.local Time elapsed: 7xx milliseconds, ( 7xx different values) search with: message: "time elapsed" and https://xx.local/ and 700 The results are: SUC… --- ## [How to drop any fields containing the word "PublicKey" from logstash](https://discuss.elastic.co/t/how-to-drop-any-fields-containing-the-word-publickey-from-logstash/369809)
**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\ **Replies:** 4\ **Last updated:** [November 5, 2024, 12:27pm UTC](https://discuss.elastic.co/t/how-to-drop-any-fields-containing-the-word-publickey-from-logstash/369809 "2024-11-05T12:27:34Z")
Hello team, I wanted to drop all fields which containaing PublicKey word in the field name. date=2019-05-10 time=11:37:47 PublicKey="abc" type.PublicKey="xyz" PublicKey.subtype="pqr" level="notice" vd="vdom1" eventtime… --- ## [How can i count the entries of duplicate data when deduplicating in fingerprint and provide feedback in some form (such as in log form)?](https://discuss.elastic.co/t/how-can-i-count-the-entries-of-duplicate-data-when-deduplicating-in-fingerprint-and-provide-feedback-in-some-form-such-as-in-log-form/370058)
**Author:** [@WeirdorPersist](https://discuss.elastic.co/u/WeirdorPersist)\ **Replies:** 2\ **Last updated:** [November 5, 2024, 12:21pm UTC](https://discuss.elastic.co/t/how-can-i-count-the-entries-of-duplicate-data-when-deduplicating-in-fingerprint-and-provide-feedback-in-some-form-such-as-in-log-form/370058 "2024-11-05T12:21:00Z")
I am using the fingerprint plugin to deduplicate data. I hope to obtain the duplicate entries of each piece of data. What should I do?This is my configuration file. input { beats { port =\> 5044 } } filter{ g… --- ## [How Logstash sync work?](https://discuss.elastic.co/t/how-logstash-sync-work/369868)
**Author:** [@Coftbred](https://discuss.elastic.co/u/Coftbred)\ **Replies:** 1\ **Last updated:** [November 5, 2024, 12:09pm UTC](https://discuss.elastic.co/t/how-logstash-sync-work/369868 "2024-11-05T12:09:32Z")
I am new to Elasticsearch and Logstash, I want to know how Logstash can Sync data with Elasticsearch, for example, what mechanism does Logstash have to recognize a changed data field or just scan the entire database ever… --- ## [Indexing Rate graphic (/s)](https://discuss.elastic.co/t/indexing-rate-graphic-s/370066)
**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\ **Replies:** 0\ **Last updated:** [November 5, 2024, 11:09am UTC](https://discuss.elastic.co/t/indexing-rate-graphic-s/370066 "2024-11-05T11:09:29Z")
Is it normal for the graphic to look like this when selecting "last 15 minutes" timeframe? Or this indicates something more serious? When selecting 1 hour the graphic looks ok without breaks between the lines. Thank… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=140) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=142)