# Latest **URL:** https://discuss.elastic.co/latest.md?page=1100 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1101 --- ## [Stop logstash from automatically creating an index on elastic](https://discuss.elastic.co/t/stop-logstash-from-automatically-creating-an-index-on-elastic/306555)
**Author:** [@Elie\_Sbat](https://discuss.elastic.co/u/Elie_Sbat)\ **Replies:** 1\ **Last updated:** [June 7, 2022, 11:19am UTC](https://discuss.elastic.co/t/stop-logstash-from-automatically-creating-an-index-on-elastic/306555 "2022-06-07T11:19:56Z")
Hello, Is there a way to stop logstash from automatically creating an index in Elasticsearch. even if the conf file does not contain any configuration regarding the index. Logstash logs: logstash | \[WARN \] 2022-06-… --- ## [Revome over gsub()](https://discuss.elastic.co/t/revome-over-gsub/306460)
**Author:** [@Iss](https://discuss.elastic.co/u/Iss)\ **Replies:** 5\ **Last updated:** [June 7, 2022, 10:44am UTC](https://discuss.elastic.co/t/revome-over-gsub/306460 "2022-06-07T10:44:21Z")
Hi! I have nested field as : "statement" =\> { "cntxt" =\> { "extension" =\> { "https://ssss/xp/w/yy" =\> "xxxxxxx" } }, ... } the field "extension" is dynamic… --- ## [Get Aggregate results grouped by nested field value(s)](https://discuss.elastic.co/t/get-aggregate-results-grouped-by-nested-field-value-s/306554)
**Author:** [@Vignesh\_Theyagarajan](https://discuss.elastic.co/u/Vignesh_Theyagarajan)\ **Replies:** 0\ **Last updated:** [June 7, 2022, 10:47am UTC](https://discuss.elastic.co/t/get-aggregate-results-grouped-by-nested-field-value-s/306554 "2022-06-07T10:47:04Z")
Sample input json: Email1 - Paragraph1: { “ParagraphId”: “Para1", “EmailId”: “Email1", “Content”: “The city is Chennai”, “Tags”: \[ { “TagId”: “Tag1”, “Name: “City”, … --- ## [The problem that the query thrown into the elastic sometimes responds and sometimes does not](https://discuss.elastic.co/t/the-problem-that-the-query-thrown-into-the-elastic-sometimes-responds-and-sometimes-does-not/306463)
**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 6:02am UTC](https://discuss.elastic.co/t/the-problem-that-the-query-thrown-into-the-elastic-sometimes-responds-and-sometimes-does-not/306463 "2022-06-07T06:02:26Z")
Hello friends, I am facing a problem. I am throwing a query with no error in Elasticsearch. For example, I want it to fetch about 10 thousand or 20 thousand documents, sorted by date and fulfilling some conditions. I'm d… --- ## [Encountered a retryable error (will retry with exponential backoff) {:code=\>400, :url=\>"http://localhost:9200/\_bulk", :content\_length=\>187}](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400-url-http-localhost-9200-bulk-content-length-187/306547)
**Author:** [@akshay\_bhardwaj](https://discuss.elastic.co/u/akshay_bhardwaj)\ **Replies:** 0\ **Last updated:** [June 7, 2022, 9:24am UTC](https://discuss.elastic.co/t/encountered-a-retryable-error-will-retry-with-exponential-backoff-code-400-url-http-localhost-9200-bulk-content-length-187/306547 "2022-06-07T09:24:03Z")
Hi i want to config logstash with incremental pipeline but i am getting below error t\[2022-06-07T14:47:45,313\]\[ERROR\]\[logstash.outputs.Elasticsearch\]\[main\]\[d24e130edb19f1038da36ee73576edcc3bb8a8df6f0207c132792ec2475e92ec… --- ## [Painless script error](https://discuss.elastic.co/t/painless-script-error/306243)
**Author:** [@Surya\_Raviraj](https://discuss.elastic.co/u/Surya_Raviraj)\ **Replies:** 6\ **Last updated:** [June 7, 2022, 9:00am UTC](https://discuss.elastic.co/t/painless-script-error/306243 "2022-06-07T09:00:32Z")
Hi, I have a script below - if(doc\['not\_shipped\_shortfall'\].value \< 0) { return doc\['not\_shipped\_shortfall'\].value; }else{ return 0; } when I click 'preview results' I see my desired result and looks like the script is… --- ## [Problem to setup sub flieds](https://discuss.elastic.co/t/problem-to-setup-sub-flieds/306134)
**Author:** [@cRaZyT](https://discuss.elastic.co/u/cRaZyT)\ **Replies:** 5\ **Last updated:** [June 7, 2022, 8:39am UTC](https://discuss.elastic.co/t/problem-to-setup-sub-flieds/306134 "2022-06-07T08:39:17Z")
Hi, I have a problem to generate sub fileds from a json message . With the following filter I try to check if the field "details" exist and add the json fields to it. If it doesn't exist the field sould be created wit… --- ## [So many segments under 2mb](https://discuss.elastic.co/t/so-many-segments-under-2mb/306536)
**Author:** [@ericsoul](https://discuss.elastic.co/u/ericsoul)\ **Replies:** 6\ **Last updated:** [June 7, 2022, 8:26am UTC](https://discuss.elastic.co/t/so-many-segments-under-2mb/306536 "2022-06-07T08:26:31Z")
The default parameter index.merge.policy.floor\_segment is 2mb, but why there are still so many segments under 2mb, even through I send command POST indices\_name/\_forcemerge many times. --- ## [Exception occurred during upserting to Elasticsearch](https://discuss.elastic.co/t/exception-occurred-during-upserting-to-elasticsearch/306534)
**Author:** [@Clyton](https://discuss.elastic.co/u/Clyton)\ **Replies:** 0\ **Last updated:** [June 7, 2022, 7:22am UTC](https://discuss.elastic.co/t/exception-occurred-during-upserting-to-elasticsearch/306534 "2022-06-07T07:22:14Z")
Hi All, We are encountering the issue while we happened to push the bulk data into Elasticsearch. Error Details: "errorCode" : "UOP-OVI-E30102" , "errorMessage" : "Exception occurred during Upserting to Elasticsearch.… --- ## [I installed elastic search and trying to add weblogic server to APM](https://discuss.elastic.co/t/i-installed-elastic-search-and-trying-to-add-weblogic-server-to-apm/306352)
**Author:** [@Yaser\_Abu\_Shaip](https://discuss.elastic.co/u/Yaser_Abu_Shaip)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 7:17am UTC](https://discuss.elastic.co/t/i-installed-elastic-search-and-trying-to-add-weblogic-server-to-apm/306352 "2022-06-07T07:17:55Z")
already added agent configured everything without any errors but the APM not appear ( as if nothing has been configured) --- ## [Multiple cluster](https://discuss.elastic.co/t/multiple-cluster/306529)
**Author:** [@A\_j\_xx](https://discuss.elastic.co/u/A_j_xx)\ **Replies:** 3\ **Last updated:** [June 7, 2022, 7:14am UTC](https://discuss.elastic.co/t/multiple-cluster/306529 "2022-06-07T07:14:06Z")
Hi all , How do i setup a 2nd cluster on my local machine , assuming 1 cluster is already learning ? Is there any official documentation which i should refer as i was not able to find anything suitable on internet Tha… --- ## [Elastic rally-tracks stable branch](https://discuss.elastic.co/t/elastic-rally-tracks-stable-branch/306530)
**Author:** [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 7:09am UTC](https://discuss.elastic.co/t/elastic-rally-tracks-stable-branch/306530 "2022-06-07T07:09:26Z")
Hi All, I am looking to use the elastic rally tracks stable branch. I see there are list of branches but am not able to figure out the latest stable branch to use. kindly help me out. --- ## [Upgrade Elasticsearch from 7.4.1 to 7.93](https://discuss.elastic.co/t/upgrade-elasticsearch-from-7-4-1-to-7-93/306531)
**Author:** [@cosminh](https://discuss.elastic.co/u/cosminh)\ **Replies:** 1\ **Last updated:** [June 7, 2022, 7:03am UTC](https://discuss.elastic.co/t/upgrade-elasticsearch-from-7-4-1-to-7-93/306531 "2022-06-07T07:03:24Z")
Hello, Is there a procedure on how to upgrade step-by-step Elasticsearch from 7.4.1 to 7.9.3 and at the same keep all the existing settings? example: stop Elastisearch service do this 3 do that etc. Thank you, Cos… --- ## [Salesforce object NOT\_FOUND](https://discuss.elastic.co/t/salesforce-object-not-found/305937)
**Author:** [@Simone1](https://discuss.elastic.co/u/Simone1)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 6:42am UTC](https://discuss.elastic.co/t/salesforce-object-not-found/305937 "2022-06-07T06:42:47Z")
I want to send data from Salesforce to Elasticsearch with Logstash. I have a case.conf file that sends data of the Case object and it works fine. But i want to send other object (WorkOrder for example) but when i start… --- ## [Can you help me to push the json data to ELK?](https://discuss.elastic.co/t/can-you-help-me-to-push-the-json-data-to-elk/306525)
**Author:** [@dineshsekar](https://discuss.elastic.co/u/dineshsekar)\ **Replies:** 1\ **Last updated:** [June 7, 2022, 6:31am UTC](https://discuss.elastic.co/t/can-you-help-me-to-push-the-json-data-to-elk/306525 "2022-06-07T06:31:14Z")
Continuing the discussion from Push json key value with ELK: File name: data.json In below json, these are the content, can you help me to push the data to ELK ? { "\_source": { "model": "commit", "tool": "bitbucke… --- ## [Looking a proper way to send the queried data to an HTTP Endpoint](https://discuss.elastic.co/t/looking-a-proper-way-to-send-the-queried-data-to-an-http-endpoint/306333)
**Author:** [@Mohamed\_Naufal](https://discuss.elastic.co/u/Mohamed_Naufal)\ **Replies:** 3\ **Last updated:** [June 7, 2022, 6:26am UTC](https://discuss.elastic.co/t/looking-a-proper-way-to-send-the-queried-data-to-an-http-endpoint/306333 "2022-06-07T06:26:45Z")
Hi Community, So far, we've queried our logs, got the curl and shared it with our developers. So, they set the cron job on their jar to hit the curl for a given, specific amount of time. When the job stops, they won't r… --- ## [シャードのサイズ上限について](https://discuss.elastic.co/t/topic/306084)
**Author:** [@takumi.yoshikawa](https://discuss.elastic.co/u/takumi.yoshikawa)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 6:22am UTC](https://discuss.elastic.co/t/topic/306084 "2022-06-07T06:22:00Z")
シャードのサイズ上限についてご教授お願い致します。 インデックス毎のシャード数についてはヒープサイズが30GBの場合、最大600-750と認識しているのですが、シャード単体のサイズについては上限が存在するのでしょうか。 1シャードのサイズは大体30GBになるよう設計することが推奨されているのは承知ですが、送信されるログ量が急増することで1シャードに入っているデータがどのくらいまでなら耐えられるのか教えていただけますと幸いです。 --- ## [Ansible SLM](https://discuss.elastic.co/t/ansible-slm/306503)
**Author:** [@A\_j\_xx](https://discuss.elastic.co/u/A_j_xx)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 5:10am UTC](https://discuss.elastic.co/t/ansible-slm/306503 "2022-06-07T05:10:54Z")
Hi all, Can we configure SLM policies via Ansible as well ? If so , then can you suggest me the ways or maybe refer me to the correct documentation link. Thanks --- ## [Favour prefixes at query time for an analyzed index?](https://discuss.elastic.co/t/favour-prefixes-at-query-time-for-an-analyzed-index/306517)
**Author:** [@corndog](https://discuss.elastic.co/u/corndog)\ **Replies:** 1\ **Last updated:** [June 7, 2022, 5:00am UTC](https://discuss.elastic.co/t/favour-prefixes-at-query-time-for-an-analyzed-index/306517 "2022-06-07T05:00:43Z")
How can I get the desired output at query time for my edge-ngram autocomplete, given my mappings? Desired Output "Fish Lake, New Zealand" "Fife Rock, New Zealand" "Fish Rock, New Zealand" \>"Finger Rocks, New Zealand"\< \>… --- ## [Circuit breaker exception](https://discuss.elastic.co/t/circuit-breaker-exception/305599)
**Author:** [@charvi23](https://discuss.elastic.co/u/charvi23)\ **Replies:** 14\ **Last updated:** [June 7, 2022, 4:57am UTC](https://discuss.elastic.co/t/circuit-breaker-exception/305599 "2022-06-07T04:57:09Z")
I get the following exception while I am trying to insert data using ES-Hive Hadoop jar. I am currently inserting around 60 million data. Following is the error I get Caused by: org.elasticsearch.hadoop.rest.EsHadoopIn… --- ## [Anomali threat intel dashboard not populating](https://discuss.elastic.co/t/anomali-threat-intel-dashboard-not-populating/306496)
**Author:** [@Charles\_Allen](https://discuss.elastic.co/u/Charles_Allen)\ **Replies:** 3\ **Last updated:** [June 7, 2022, 2:40am UTC](https://discuss.elastic.co/t/anomali-threat-intel-dashboard-not-populating/306496 "2022-06-07T02:40:05Z")
Hello, I am trying to see Anomali threat intel data in kibana but the dashboard is just empty. I am running Elasticsearch 7.17.4 I have uncommented the anomali guest account and password. I am seeing results within … --- ## [Metricbeat aws module cant collect s3\_dailystorage metrics](https://discuss.elastic.co/t/metricbeat-aws-module-cant-collect-s3-dailystorage-metrics/306512)
**Author:** [@desluk](https://discuss.elastic.co/u/desluk)\ **Replies:** 0\ **Last updated:** [June 7, 2022, 2:16am UTC](https://discuss.elastic.co/t/metricbeat-aws-module-cant-collect-s3-dailystorage-metrics/306512 "2022-06-07T02:16:29Z")
Hi mate, I'm trying to collect the ec2, lambda, s3\_dailystorage via the aws module, ec2 and lambda are fine, but no s3 data can be collected. Below is my AWS module config: - module: aws period: 300s regions: … --- ## [Updating openjdk](https://discuss.elastic.co/t/updating-openjdk/306342)
**Author:** [@wazzu62](https://discuss.elastic.co/u/wazzu62)\ **Replies:** 2\ **Last updated:** [June 7, 2022, 12:01am UTC](https://discuss.elastic.co/t/updating-openjdk/306342 "2022-06-07T00:01:20Z")
Running a cluster with Elasticsearch 7.4.2 on Centos 7, ES was installed using RPMs There is a version of java (1.13.0.1.9) included in /usr/share/Elasticsearch that our Nessus scans are hitting on. Can I have ES use t… --- ## [Rabbitmq in azure](https://discuss.elastic.co/t/rabbitmq-in-azure/306413)
**Author:** [@Kirtash](https://discuss.elastic.co/u/Kirtash)\ **Replies:** 1\ **Last updated:** [June 6, 2022, 11:51pm UTC](https://discuss.elastic.co/t/rabbitmq-in-azure/306413 "2022-06-06T23:51:45Z")
Hiiii!! I have a question about rabbitmq and Elasticsearch. In this moment I have installed Elasticsearch in cloud enterprise and the rabbitmq in azure machines. My intention is connect the two machines but I can't add … --- ## [Monitoring .NET Core EventCounters with Metricbeat or Filebeat?](https://discuss.elastic.co/t/monitoring-net-core-eventcounters-with-metricbeat-or-filebeat/306414)
**Author:** [@Inammathe\_Inna](https://discuss.elastic.co/u/Inammathe_Inna)\ **Replies:** 0\ **Last updated:** [June 5, 2022, 10:19pm UTC](https://discuss.elastic.co/t/monitoring-net-core-eventcounters-with-metricbeat-or-filebeat/306414 "2022-06-05T22:19:48Z")
Hi guys, So apparently .NET Core on Windows no longer writes to the metricset perfmon. It instead uses EventCounters - EventCounters in .NET Core | Microsoft Docs Has anybody found an elegant way to send these metrics… --- ## [Performance impact](https://discuss.elastic.co/t/performance-impact/306433)
**Author:** [@A\_j\_xx](https://discuss.elastic.co/u/A_j_xx)\ **Replies:** 3\ **Last updated:** [June 6, 2022, 11:50pm UTC](https://discuss.elastic.co/t/performance-impact/306433 "2022-06-06T23:50:11Z")
Hi all , Some basic doubts which i have What is performance impact on cluster while snapshotting ? Is there any downtime while restoring snapshot in the same cluster Let us say i am a restoring an index "A" on my clus… --- ## [Security Events Filters vs. Ingest Node Pipelines](https://discuss.elastic.co/t/security-events-filters-vs-ingest-node-pipelines/306447)
**Author:** [@AndreiRD](https://discuss.elastic.co/u/AndreiRD)\ **Replies:** 0\ **Last updated:** [June 6, 2022, 12:33pm UTC](https://discuss.elastic.co/t/security-events-filters-vs-ingest-node-pipelines/306447 "2022-06-06T12:33:31Z")
Hi, What are the pros and cons of using Security Event Filters over the Ingest Node Pipelines for dropping unwanted log data? Ingest Pipelines seem to allow more granularity. --- ## [Unable to monitor URL in heartbeat](https://discuss.elastic.co/t/unable-to-monitor-url-in-heartbeat/306453)
**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\ **Replies:** 1\ **Last updated:** [June 6, 2022, 11:49pm UTC](https://discuss.elastic.co/t/unable-to-monitor-url-in-heartbeat/306453 "2022-06-06T23:49:28Z")
I am trying to add below URL in heartbeat but it is giving error like 401 Authentication requested or 403 Forbidden I am missing anything? - type: http urls: \["http://myurl.net:9000"\] username: abcd password: #ab… --- ## [Alerts for kubernetes](https://discuss.elastic.co/t/alerts-for-kubernetes/306469)
**Author:** [@gabrielfsousa](https://discuss.elastic.co/u/gabrielfsousa)\ **Replies:** 0\ **Last updated:** [June 6, 2022, 2:34pm UTC](https://discuss.elastic.co/t/alerts-for-kubernetes/306469 "2022-06-06T14:34:31Z")
I would like to use Elastic for K8s alerting. My question is, there are already same template rules of alerting ? Or do i have to create everything ? --- ## [How to remove inner list id from result in elastic search](https://discuss.elastic.co/t/how-to-remove-inner-list-id-from-result-in-elastic-search/305900)
**Author:** [@Sangeet\_Shah](https://discuss.elastic.co/u/Sangeet_Shah)\ **Replies:** 1\ **Last updated:** [June 6, 2022, 10:12pm UTC](https://discuss.elastic.co/t/how-to-remove-inner-list-id-from-result-in-elastic-search/305900 "2022-06-06T22:12:09Z")
I have product list into elastic. My product entity is as below Id,Name, AssociateProductIds Now I have to remove AssociateProductIds from result. What query I have to write? e.g. Id Name AssociateProductI… [Previous page](https://discuss.elastic.co/latest.md?page=1099) [Next page](https://discuss.elastic.co/latest.md?page=1101)