# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=969

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 970

---

## [Does the Logstash output plugin for RabbitMQ supports RabbitMQ support?](https://discuss.elastic.co/t/does-the-logstash-output-plugin-for-rabbitmq-supports-rabbitmq-support/302741)

<div class="topic-metadata">

**Author:** [@AMBUJ\_DUBEY](https://discuss.elastic.co/u/AMBUJ_DUBEY)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 6:20pm UTC](https://discuss.elastic.co/t/does-the-logstash-output-plugin-for-rabbitmq-supports-rabbitmq-support/302741 "2022-04-19T18:20:41Z")

</div>

Does the Logstash output plugin for RabbitMQ (Rabbitmq output plugin | Logstash Reference \[8.1\] | Elastic) have support for Streams — RabbitMQ

---

## [Need Clarification on How to Obtain ES SSL Certs for Fleet Server](https://discuss.elastic.co/t/need-clarification-on-how-to-obtain-es-ssl-certs-for-fleet-server/302738)

<div class="topic-metadata">

**Author:** [@CptElasticBand](https://discuss.elastic.co/u/CptElasticBand)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 5:36pm UTC](https://discuss.elastic.co/t/need-clarification-on-how-to-obtain-es-ssl-certs-for-fleet-server/302738 "2022-04-19T17:36:16Z")

</div>

Hello! I need clarification on the following prerequisite for setting up proper Fleet Server SSL/TLS certificates. Excerpt from Configure SSL/TLS for self-managed Fleet Servers: Elastic Agents require a PEM-format…

---

## [Kibana server is not ready yet RHEL 8](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-rhel-8/301455)

<div class="topic-metadata">

**Author:** [@ashisharyan](https://discuss.elastic.co/u/ashisharyan)\
**Replies:** 7\
**Last updated:** [April 19, 2022, 5:19pm UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-rhel-8/301455 "2022-04-19T17:19:33Z")

</div>

Hi , I am installing ELK stack (elasticsearch-7.10.2)on RHEL8 Elasticsearch and Kibana both installed Successfully but when we open Kibana web console it is showing kibana server is not ready yet. Below is Yml files. …

---

## [Error converting field type in a reindexing](https://discuss.elastic.co/t/error-converting-field-type-in-a-reindexing/302689)

<div class="topic-metadata">

**Author:** [@quim.gomez](https://discuss.elastic.co/u/quim.gomez)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 5:05pm UTC](https://discuss.elastic.co/t/error-converting-field-type-in-a-reindexing/302689 "2022-04-19T17:05:29Z")

</div>

Hello, I'm having some visualization problems inside Elastic due to I'm sending all the data Beats collect to Logstash instead of directly to Elastisearch. That made some fields change their type. For example, the fiel…

---

## [Solr's copyField equivalent in ElasticSearch](https://discuss.elastic.co/t/solrs-copyfield-equivalent-in-elasticsearch/302682)

<div class="topic-metadata">

**Author:** [@nn14](https://discuss.elastic.co/u/nn14)\
**Replies:** 5\
**Last updated:** [April 19, 2022, 4:59pm UTC](https://discuss.elastic.co/t/solrs-copyfield-equivalent-in-elasticsearch/302682 "2022-04-19T16:59:52Z")

</div>

Hello team, We are migrating from Solr to ES. Please let me know if there is an equivalent of copyField in ES. Basically for the below Solr code, this was done to enable date range searches on lastUpdateDate I need an…

---

## [Elastic ingest node load not balanced with pipeline](https://discuss.elastic.co/t/elastic-ingest-node-load-not-balanced-with-pipeline/301894)

<div class="topic-metadata">

**Author:** [@ss\_22](https://discuss.elastic.co/u/ss_22)\
**Replies:** 9\
**Last updated:** [April 19, 2022, 4:33pm UTC](https://discuss.elastic.co/t/elastic-ingest-node-load-not-balanced-with-pipeline/301894 "2022-04-19T16:33:41Z")

</div>

Hi, I have a ECK cluster with 6 data/ingest nodes. I also have an ingest node pipeline deployed and processing logs from Filebeat. While it is running I noticed only one node being utilized near 100% CPU where the other…

---

## [Warning and Error Messages - Kibana Dashboard](https://discuss.elastic.co/t/warning-and-error-messages-kibana-dashboard/301397)

<div class="topic-metadata">

**Author:** [@TS-021](https://discuss.elastic.co/u/TS-021)\
**Replies:** 2\
**Last updated:** [April 19, 2022, 3:40pm UTC](https://discuss.elastic.co/t/warning-and-error-messages-kibana-dashboard/301397 "2022-04-19T15:40:55Z")

</div>

Hi, I am running T-Pot via AWS and included with T-Pot is Kibana. Every time I launch the Kibana dashboard I get the following messages - Message 1: Configuration missing server.publicBaseUrl is missing and should b…

---

## [Heartbeat download for Windows is actually for Linux/Unix](https://discuss.elastic.co/t/heartbeat-download-for-windows-is-actually-for-linux-unix/302646)

<div class="topic-metadata">

**Author:** [@paolovalladolid](https://discuss.elastic.co/u/paolovalladolid)\
**Replies:** 3\
**Last updated:** [April 19, 2022, 2:20pm UTC](https://discuss.elastic.co/t/heartbeat-download-for-windows-is-actually-for-linux-unix/302646 "2022-04-19T14:20:08Z")

</div>

This page says to download the Windows zip file But the download page does not have a zip file. It defaults to RPM I downloaded the RPM file to the Windows server and used 7Zip to extract it. The extracted file is …

---

## [Transport\_address resolved as IP:PORT in docker](https://discuss.elastic.co/t/transport-address-resolved-as-ip-port-in-docker/302718)

<div class="topic-metadata">

**Author:** [@Jan\_Kucera](https://discuss.elastic.co/u/Jan_Kucera)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 1:21pm UTC](https://discuss.elastic.co/t/transport-address-resolved-as-ip-port-in-docker/302718 "2022-04-19T13:21:10Z")

</div>

Hello everyone, I am struggling with Docker and Elasticsearch. I am trying to setup my instance so it has published adddress in format HOSTNAME:PORT and not IP:PORT for both HTTP and transport. I am posting my docker-co…

---

## [Elasticsearch \[6.8.23\] does not return results when I query in a specific field](https://discuss.elastic.co/t/elasticsearch-6-8-23-does-not-return-results-when-i-query-in-a-specific-field/302704)

<div class="topic-metadata">

**Author:** [@joanjanku2000](https://discuss.elastic.co/u/joanjanku2000)\
**Replies:** 2\
**Last updated:** [April 19, 2022, 1:06pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-23-does-not-return-results-when-i-query-in-a-specific-field/302704 "2022-04-19T13:06:42Z")

</div>

Hi Everyone, I am running an issue after I upgraded my Elastic Cluster from 5.1.1 to 6.8.23. When I search everything in an index using this API: /index\_0003/\_search it returns all the result as expected. However…

---

## [How to access each value separately in ctx.payload.\_value](https://discuss.elastic.co/t/how-to-access-each-value-separately-in-ctx-payload-value/302450)

<div class="topic-metadata">

**Author:** [@700grm](https://discuss.elastic.co/u/700grm)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 11:18am UTC](https://discuss.elastic.co/t/how-to-access-each-value-separately-in-ctx-payload-value/302450 "2022-04-19T11:18:52Z")

</div>

Hi, I have two values in payload the host name and IP Address, which I need to access separately: "transform" : { "type" : "script", "status" : "success", "payload" : { "\_value" :…

---

## [Multi index search](https://discuss.elastic.co/t/multi-index-search/302711)

<div class="topic-metadata">

**Author:** [@anime\_lover](https://discuss.elastic.co/u/anime_lover)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 11:14am UTC](https://discuss.elastic.co/t/multi-index-search/302711 "2022-04-19T11:14:56Z")

</div>

Hi there , this query is interesting take a look and suggest me solution: suppose i have two indices . one is sales which contain cusId,productName,,,etc. another is custInfo which contain phonenumber,custId,...etc. …

---

## [Filtering duplicate fields in Error Watchers](https://discuss.elastic.co/t/filtering-duplicate-fields-in-error-watchers/302710)

<div class="topic-metadata">

**Author:** [@HughEvans](https://discuss.elastic.co/u/HughEvans)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 11:10am UTC](https://discuss.elastic.co/t/filtering-duplicate-fields-in-error-watchers/302710 "2022-04-19T11:10:35Z")

</div>

I'm trying to filter out duplicates hits in the following error watcher. Currently when there are multiple hits in the same namespace the output looks like this: "body": "{\\"link\_names\\": \\"1\\", \\"username\\": \\"Kibana …

---

## [How to use filebeat to process file that is not log file](https://discuss.elastic.co/t/how-to-use-filebeat-to-process-file-that-is-not-log-file/302706)

<div class="topic-metadata">

**Author:** [@blumre](https://discuss.elastic.co/u/blumre)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 11:07am UTC](https://discuss.elastic.co/t/how-to-use-filebeat-to-process-file-that-is-not-log-file/302706 "2022-04-19T11:07:03Z")

</div>

Hi, I want to collect by filebeat also specific configuration file structured as key=value lines so will be able to use it in Kibana dashboard. I managed to do it for the first time it reads the file but if the file cha…

---

## [Bulk index w/ new java-client](https://discuss.elastic.co/t/bulk-index-w-new-java-client/300111)

<div class="topic-metadata">

**Author:** [@divadpoc](https://discuss.elastic.co/u/divadpoc)\
**Replies:** 6\
**Last updated:** [April 19, 2022, 8:51am UTC](https://discuss.elastic.co/t/bulk-index-w-new-java-client/300111 "2022-04-19T08:51:51Z")

</div>

Hi, I'm looking for an example of how to do a bulk insert w/ the new java-client (8.1). Previously (w/ ES 7) I used the high level rest client and a BulkProcessor . Thanks

---

## [Create timestamp as index in Elasticsearch Kibana](https://discuss.elastic.co/t/create-timestamp-as-index-in-elasticsearch-kibana/302681)

<div class="topic-metadata">

**Author:** [@Manish.gupta](https://discuss.elastic.co/u/Manish.gupta)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 7:39am UTC](https://discuss.elastic.co/t/create-timestamp-as-index-in-elasticsearch-kibana/302681 "2022-04-19T07:39:29Z")

</div>

Hi, I am trying to change the default index in Elasticsearch with timestamp index. please let me know if there is a way for the same.

---

## [As the server hard disk no enough and I delete the file under /elasticsearch/nodes/0/indices](https://discuss.elastic.co/t/as-the-server-hard-disk-no-enough-and-i-delete-the-file-under-elasticsearch-nodes-0-indices/302605)

<div class="topic-metadata">

**Author:** [@Whybee](https://discuss.elastic.co/u/Whybee)\
**Replies:** 3\
**Last updated:** [April 19, 2022, 7:31am UTC](https://discuss.elastic.co/t/as-the-server-hard-disk-no-enough-and-i-delete-the-file-under-elasticsearch-nodes-0-indices/302605 "2022-04-19T07:31:54Z")

</div>

{"type": "server", "timestamp": "2022-04-18T16:40:26,280+08:00", "level": "WARN", "component": "o.e.c.s.MasterService", "cluster.name": "elasticsearch", "node.name": "jenkirsappu01", "message": "failing \[create-index \[it…

---

## [Cannot order by non-grouped column\[column name\]](https://discuss.elastic.co/t/cannot-order-by-non-grouped-column-column-name/302675)

<div class="topic-metadata">

**Author:** [@dido](https://discuss.elastic.co/u/dido)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 7:20am UTC](https://discuss.elastic.co/t/cannot-order-by-non-grouped-column-column-name/302675 "2022-04-19T07:20:05Z")

</div>

select \* from (select street, count(street) as counts, min(grocery) as grocery, min(school) as school, (min(grocery) + min(school)) as score from geo\_address group by 1) t order by grocery I have geo\_address index and…

---

## [Logstash Monitoring not available in Kibana](https://discuss.elastic.co/t/logstash-monitoring-not-available-in-kibana/302572)

<div class="topic-metadata">

**Author:** [@mazahir.nazmi](https://discuss.elastic.co/u/mazahir.nazmi)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 7:21am UTC](https://discuss.elastic.co/t/logstash-monitoring-not-available-in-kibana/302572 "2022-04-19T07:21:47Z")

</div>

Hi Guys! i have 2 logstash servers installed. i have enabled the xpack.monitoring for each one of the servers, when i use Kibana and go to "Monitoring" tab, i am not seeing any instance. Please advise Regards, Mazah…

---

## [Latency issue when cluster nodes are spread across data center](https://discuss.elastic.co/t/latency-issue-when-cluster-nodes-are-spread-across-data-center/302674)

<div class="topic-metadata">

**Author:** [@mSaify](https://discuss.elastic.co/u/mSaify)\
**Replies:** 0\
**Last updated:** [April 19, 2022, 7:18am UTC](https://discuss.elastic.co/t/latency-issue-when-cluster-nodes-are-spread-across-data-center/302674 "2022-04-19T07:18:09Z")

</div>

All, one of my clients has a cluster configuration where the 3 nodes are spread across 2 data centers. For a while, they have been noticing the latency on search queries. Based on network logs and cluster configuration…

---

## [MongoDB Metricbeat Module](https://discuss.elastic.co/t/mongodb-metricbeat-module/301098)

<div class="topic-metadata">

**Author:** [@maltewhiite](https://discuss.elastic.co/u/maltewhiite)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 6:29am UTC](https://discuss.elastic.co/t/mongodb-metricbeat-module/301098 "2022-04-19T06:29:26Z")

</div>

mongodb.collstats.insert.count How many X documents are we inserting per Y time in our MongoDB Cluster. And how do I visualize that? What does mongodb.collstats.insert.count show? The Documentation only says: Is i…

---

## [Getting All records with doc\_count \>= 2](https://discuss.elastic.co/t/getting-all-records-with-doc-count-2/302407)

<div class="topic-metadata">

**Author:** [@minhaj\_shakeel](https://discuss.elastic.co/u/minhaj_shakeel)\
**Replies:** 14\
**Last updated:** [April 19, 2022, 5:03am UTC](https://discuss.elastic.co/t/getting-all-records-with-doc-count-2/302407 "2022-04-19T05:03:55Z")

</div>

I have 2 es indices. There are some records common in both the indices, I want to fetch them. My preliminary query is :- GET index1,index2/\_search { "size": 0, "aggs": { "duplicate record": { "terms": { …

---

## [Prometheus to Elasticsearch using remote\_write - server returned HTTP status 405 method not allowed](https://discuss.elastic.co/t/prometheus-to-elasticsearch-using-remote-write-server-returned-http-status-405-method-not-allowed/302661)

<div class="topic-metadata">

**Author:** [@r.ganeshbabu](https://discuss.elastic.co/u/r.ganeshbabu)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 3:51am UTC](https://discuss.elastic.co/t/prometheus-to-elasticsearch-using-remote-write-server-returned-http-status-405-method-not-allowed/302661 "2022-04-19T03:51:30Z")

</div>

Hi All, I am working on sending data from prometheus to elasticsearch using remote\_write in k8s and I am using Prometheus 2.28 image. Below is the remote write configuration defined in configMap (k8s). --- kind: Confi…

---

## [Updating field that is an empty string](https://discuss.elastic.co/t/updating-field-that-is-an-empty-string/302649)

<div class="topic-metadata">

**Author:** [@es\_beginner](https://discuss.elastic.co/u/es_beginner)\
**Replies:** 5\
**Last updated:** [April 19, 2022, 1:59am UTC](https://discuss.elastic.co/t/updating-field-that-is-an-empty-string/302649 "2022-04-19T01:59:49Z")

</div>

I currently have an elastic document with a field called grade. This field is an empty string. In Kibana, its registered as grade: (empty). Now when I try to update grade via: POST index/\_update/\_id { "doc": { …

---

## [Can't get Filebeat and Metricbeat DashBoard Setup](https://discuss.elastic.co/t/cant-get-filebeat-and-metricbeat-dashboard-setup/302655)

<div class="topic-metadata">

**Author:** [@asher-lab](https://discuss.elastic.co/u/asher-lab)\
**Replies:** 1\
**Last updated:** [April 19, 2022, 12:54am UTC](https://discuss.elastic.co/t/cant-get-filebeat-and-metricbeat-dashboard-setup/302655 "2022-04-19T00:54:30Z")

</div>

Hi, I have a problem setting up the dashboards for metricbeat and filebeat on my Kibana dashboard. I am using the OSS Version of ELK, MetricBeat and Filebeat 7.10.2 Here are the specs of my ELK Stack, MetricBeat and F…

---

## [Data Size and Shard Limits](https://discuss.elastic.co/t/data-size-and-shard-limits/302643)

<div class="topic-metadata">

**Author:** [@geena.rollins](https://discuss.elastic.co/u/geena.rollins)\
**Replies:** 1\
**Last updated:** [April 18, 2022, 11:30pm UTC](https://discuss.elastic.co/t/data-size-and-shard-limits/302643 "2022-04-18T23:30:11Z")

</div>

What is the maxium recommended data size per shard? What is the maxium recommended number of shards per cluster?

---

## [Filebeat 8.1.2 @timestamp off](https://discuss.elastic.co/t/filebeat-8-1-2-timestamp-off/302653)

<div class="topic-metadata">

**Author:** [@afmiller1](https://discuss.elastic.co/u/afmiller1)\
**Replies:** 0\
**Last updated:** [April 18, 2022, 11:00pm UTC](https://discuss.elastic.co/t/filebeat-8-1-2-timestamp-off/302653 "2022-04-18T23:00:39Z")

</div>

Looking at the discovery tab for my filebeat netflow ingestion, it is showing that it’s almost 2:30h behind my current local time. Tried restarting the service with no luck. How do I get the time to update properly?

---

## [Collect logs from Amazon CloudWatch with Elastic Agent](https://discuss.elastic.co/t/collect-logs-from-amazon-cloudwatch-with-elastic-agent/302648)

<div class="topic-metadata">

**Author:** [@spo](https://discuss.elastic.co/u/spo)\
**Replies:** 2\
**Last updated:** [April 18, 2022, 9:59pm UTC](https://discuss.elastic.co/t/collect-logs-from-amazon-cloudwatch-with-elastic-agent/302648 "2022-04-18T21:59:39Z")

</div>

Hi I am trying to pull cloudwatch logs with elastic agent. I have elastic agent running on a windows server. It has the default policy attached to it. To the default policy I have added AWS integration , iis-logs integ…

---

## [Ingest Pipeline Grok filter ignores first pattern and matches second pattern when second pattern exists](https://discuss.elastic.co/t/ingest-pipeline-grok-filter-ignores-first-pattern-and-matches-second-pattern-when-second-pattern-exists/302645)

<div class="topic-metadata">

**Author:** [@kossde](https://discuss.elastic.co/u/kossde)\
**Replies:** 0\
**Last updated:** [April 18, 2022, 9:03pm UTC](https://discuss.elastic.co/t/ingest-pipeline-grok-filter-ignores-first-pattern-and-matches-second-pattern-when-second-pattern-exists/302645 "2022-04-18T21:03:45Z")

</div>

Ingest Pipeline GROK filter: { "grok": { "field": "message", "patterns": \[ "\\\\s\*Workstation Name:(?!\\\\t-)\\\\s\*%{DATA:winlog.event\_data.WorkstationName}\\\\n\\\\t.\*", "%{GREEDYDATA:message}" …

---

## [Scroll context exceeding 500](https://discuss.elastic.co/t/scroll-context-exceeding-500/302641)

<div class="topic-metadata">

**Author:** [@Abi\_Blista](https://discuss.elastic.co/u/Abi_Blista)\
**Replies:** 1\
**Last updated:** [April 18, 2022, 8:01pm UTC](https://discuss.elastic.co/t/scroll-context-exceeding-500/302641 "2022-04-18T20:01:33Z")

</div>

Im using python to pull large data from ES. When I tried to pull the data, Im getting this partucular issue scroll context exceeding 500. is there way to resolve this issue

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=968)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=970)
