# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1574

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1575

---

## [Synonyms multi word search issue](https://discuss.elastic.co/t/synonyms-multi-word-search-issue/263110)

<div class="topic-metadata">

**Author:** [@smshabab11](https://discuss.elastic.co/u/smshabab11)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 11:09am UTC](https://discuss.elastic.co/t/synonyms-multi-word-search-issue/263110 "2021-02-03T11:09:47Z")

</div>

I have created an index with synonyms.txt file in which there is a word GDM and corresponding synonym is General Data Manager and the expectation is If I want to search "GDM" it should show results which has "GDM" or "Ge…

---

## [Integrating Ingest Pipeline with the Indicies](https://discuss.elastic.co/t/integrating-ingest-pipeline-with-the-indicies/263106)

<div class="topic-metadata">

**Author:** [@shiv97](https://discuss.elastic.co/u/shiv97)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 10:43am UTC](https://discuss.elastic.co/t/integrating-ingest-pipeline-with-the-indicies/263106 "2021-02-03T10:43:34Z")

</div>

Hi Everyone, I have created one ingest pipeline now I want to attach this pipeline with the index having the format "cwl-2021.02.02 " where indices from every date are created like "cwl-2021.02.03" and so on... So I tr…

---

## [Circuit\_breaking\_exception](https://discuss.elastic.co/t/circuit-breaking-exception/261503)

<div class="topic-metadata">

**Author:** [@zen.xen](https://discuss.elastic.co/u/zen.xen)\
**Replies:** 12\
**Last updated:** [February 3, 2021, 10:37am UTC](https://discuss.elastic.co/t/circuit-breaking-exception/261503 "2021-02-03T10:37:24Z")

</div>

@Marta\_Bondyra Hello, I need some help { "error": { "root\_cause": \[ { "type": "circuit\_breaking\_exception", "reason": "\[parent\] Data too large, data for \[\<transport\_r…

---

## [Syslog pipeline =\> \[host\] error in ElasticSearch](https://discuss.elastic.co/t/syslog-pipeline-host-error-in-elasticsearch/262657)

<div class="topic-metadata">

**Author:** [@expressionlibre](https://discuss.elastic.co/u/expressionlibre)\
**Replies:** 11\
**Last updated:** [February 3, 2021, 10:32am UTC](https://discuss.elastic.co/t/syslog-pipeline-host-error-in-elasticsearch/262657 "2021-02-03T10:32:07Z")

</div>

Hi, Sorry may be a newbie question but, I read lots of treads and examples on the net to setup syslog pipeline but I still cannot make my logstash pipeline to function in ES. platform : CentOS 8.3. Epel versions for …

---

## [Packetbeat handle error when exec show databases](https://discuss.elastic.co/t/packetbeat-handle-error-when-exec-show-databases/262469)

<div class="topic-metadata">

**Author:** [@282857484](https://discuss.elastic.co/u/282857484)\
**Replies:** 3\
**Last updated:** [February 3, 2021, 10:28am UTC](https://discuss.elastic.co/t/packetbeat-handle-error-when-exec-show-databases/262469 "2021-02-03T10:28:22Z")

</div>

Version: master(newest) Operating System: macos 11.1 Steps to Reproduce: env:mysql5.7,mysql8.0 packetbeat when exec "show databases" then the program will never recovery. because the var complete return false,and…

---

## [Rest API for last 30 days data from elasticsearch](https://discuss.elastic.co/t/rest-api-for-last-30-days-data-from-elasticsearch/262877)

<div class="topic-metadata">

**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\
**Replies:** 5\
**Last updated:** [February 3, 2021, 10:10am UTC](https://discuss.elastic.co/t/rest-api-for-last-30-days-data-from-elasticsearch/262877 "2021-02-03T10:10:17Z")

</div>

Hi All, I am trying to export data from elasticsearch using rest api below is an example which got succeeded, but this will give complete data present in index URL : http://dashboard.iff.com:9200/inctable/\_search/ H…

---

## [MetricBeat error](https://discuss.elastic.co/t/metricbeat-error/262153)

<div class="topic-metadata">

**Author:** [@cloudenv](https://discuss.elastic.co/u/cloudenv)\
**Replies:** 7\
**Last updated:** [January 28, 2021, 3:52pm UTC](https://discuss.elastic.co/t/metricbeat-error/262153 "2021-01-28T15:52:46Z")

</div>

Ok will try to be civil here, but 'd be hard as Im furious. Have spent all f\* day tryting to setup Kibana ( cloud / self ) Am trying to configure metricbeat using this. Im getting Anyone? PS: why all texts here are…

---

## [Using esrally to measure painless script partial update performance](https://discuss.elastic.co/t/using-esrally-to-measure-painless-script-partial-update-performance/262263)

<div class="topic-metadata">

**Author:** [@dineshabbi](https://discuss.elastic.co/u/dineshabbi)\
**Replies:** 6\
**Last updated:** [February 3, 2021, 9:42am UTC](https://discuss.elastic.co/t/using-esrally-to-measure-painless-script-partial-update-performance/262263 "2021-02-03T09:42:02Z")

</div>

Hi team, I am trying to measure bulk partial update performance. I am wondering if its possible to do this via esrally at all. For eg, our application uses painless scripts for partial update and the target for these u…

---

## [Metricbeat dosen't collect CPU and Memory if Load is enabled in windows machines](https://discuss.elastic.co/t/metricbeat-dosent-collect-cpu-and-memory-if-load-is-enabled-in-windows-machines/262802)

<div class="topic-metadata">

**Author:** [@Sathish22](https://discuss.elastic.co/u/Sathish22)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 8:58am UTC](https://discuss.elastic.co/t/metricbeat-dosent-collect-cpu-and-memory-if-load-is-enabled-in-windows-machines/262802 "2021-02-03T08:58:14Z")

</div>

Hi Team, I have installed metricbeat in windows machine If we disable Load from the system.yml file we can able to capture CPU and Memory metrics but after enabling load we didn't get data for CPU, Memory, and Load Bu…

---

## [7.10 RestHighLevelClient - Composable Index Template and Component Template APIs difficult to use](https://discuss.elastic.co/t/7-10-resthighlevelclient-composable-index-template-and-component-template-apis-difficult-to-use/263097)

<div class="topic-metadata">

**Author:** [@Rajath\_H\_G](https://discuss.elastic.co/u/Rajath_H_G)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 8:41am UTC](https://discuss.elastic.co/t/7-10-resthighlevelclient-composable-index-template-and-component-template-apis-difficult-to-use/263097 "2021-02-03T08:41:47Z")

</div>

I am planning to migrate from legacy templates to Composable Templates introduced in 7.x. But with Composable Templates we don't have APIs to feed complete template request string directly or build one using XContentBui…

---

## [An we add log retentions for elasticsearch, logstash, kibana and metric beat](https://discuss.elastic.co/t/an-we-add-log-retentions-for-elasticsearch-logstash-kibana-and-metric-beat/263096)

<div class="topic-metadata">

**Author:** [@Somesh\_ng](https://discuss.elastic.co/u/Somesh_ng)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 8:37am UTC](https://discuss.elastic.co/t/an-we-add-log-retentions-for-elasticsearch-logstash-kibana-and-metric-beat/263096 "2021-02-03T08:37:59Z")

</div>

Can we add log retentions for elasticsearch, logstash, kibana and metric beat like below in .yml file logging.level: debug logging.to\_files: true logging.to\_syslog: false logging.files: path: /log…

---

## [Error while indexing data to App Search using Logstash](https://discuss.elastic.co/t/error-while-indexing-data-to-app-search-using-logstash/263094)

<div class="topic-metadata">

**Author:** [@sanju1323](https://discuss.elastic.co/u/sanju1323)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 8:34am UTC](https://discuss.elastic.co/t/error-while-indexing-data-to-app-search-using-logstash/263094 "2021-02-03T08:34:19Z")

</div>

Hi Team, I have been trying to index the data from local Elasticsearch cluster to App Search engine using logstash. But I'm getting the below error. Copy to clipboard \[2021-02-01T13:45:30,097\]\[DEBUG\]\[logstash.javapipe…

---

## [Connection refused logstash to elasticsearch](https://discuss.elastic.co/t/connection-refused-logstash-to-elasticsearch/262970)

<div class="topic-metadata">

**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\
**Replies:** 8\
**Last updated:** [February 3, 2021, 8:17am UTC](https://discuss.elastic.co/t/connection-refused-logstash-to-elasticsearch/262970 "2021-02-03T08:17:20Z")

</div>

Hi, I enable trial licence for my 3 node elasticsearch cluster, on docker. And now elasticsearch and kibana is running on https but logstash start giving problem. Earlier ELK was running on http correctly. My all setup …

---

## [Header in csv while exporting](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958)

<div class="topic-metadata">

**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\
**Replies:** 2\
**Last updated:** [February 3, 2021, 8:06am UTC](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958 "2021-02-03T08:06:41Z")

</div>

Hi, I want to know that is there any way through which we can add header in csv file while exporting from elasticsearch via logstash? Here is the flow: Elasticsearch -\> logstash -\> csv file

---

## [Draw Pie Chart in Kibana based on field values](https://discuss.elastic.co/t/draw-pie-chart-in-kibana-based-on-field-values/262077)

<div class="topic-metadata">

**Author:** [@Sudarshan\_Reddy](https://discuss.elastic.co/u/Sudarshan_Reddy)\
**Replies:** 2\
**Last updated:** [February 3, 2021, 7:09am UTC](https://discuss.elastic.co/t/draw-pie-chart-in-kibana-based-on-field-values/262077 "2021-02-03T07:09:26Z")

</div>

Hi , we have a requirement to some of our test results in kibana pie chart . e.g we have the index pattern as following with the fields and i want to plot passedCount, failedCount values in kibana Pie Chart with each …

---

## [Filebeat not starting](https://discuss.elastic.co/t/filebeat-not-starting/263076)

<div class="topic-metadata">

**Author:** [@Kaushal\_Kishore1](https://discuss.elastic.co/u/Kaushal_Kishore1)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 6:45am UTC](https://discuss.elastic.co/t/filebeat-not-starting/263076 "2021-02-03T06:45:20Z")

</div>

my filebeat.yaml filebeat.inputs: - type: log paths: - /var/log/apache2/whatfix\_access.log tags: \["apache"\] - type: log paths: - /usr/lib/quickonutch/logs/quickoapi.20\* tags: \["api"\] multiline.pattern: '^…

---

## [Help in securing communications between client and elasticsearch](https://discuss.elastic.co/t/help-in-securing-communications-between-client-and-elasticsearch/262955)

<div class="topic-metadata">

**Author:** [@Priya\_Vijay](https://discuss.elastic.co/u/Priya_Vijay)\
**Replies:** 3\
**Last updated:** [February 3, 2021, 5:41am UTC](https://discuss.elastic.co/t/help-in-securing-communications-between-client-and-elasticsearch/262955 "2021-02-03T05:41:11Z")

</div>

I have a question and appreciate any guidance. I have an elasticsearch instance without x-pack enabled but it is secure, mTLS is enabled. How can I connect to this elastic from another client like elastalert? How can I g…

---

## [Estimate RAM consumption per index](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947)

<div class="topic-metadata">

**Author:** [@gorek](https://discuss.elastic.co/u/gorek)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 4:00am UTC](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947 "2021-02-03T04:00:44Z")

</div>

I would like to estimate RAM requirements for new node. I plan keep on this node about 88 indices with 2 shards every. Currently one index have about 63GB on disk and 240 millions documents. I know Elasticsearch relies …

---

## [Reindex issue](https://discuss.elastic.co/t/reindex-issue/263013)

<div class="topic-metadata">

**Author:** [@Yogesh\_Chandra](https://discuss.elastic.co/u/Yogesh_Chandra)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 3:57am UTC](https://discuss.elastic.co/t/reindex-issue/263013 "2021-02-03T03:57:07Z")

</div>

Hi Team, We are getting the below error during reindexing. Document contains at least one immense term in field="ddm\_\_keyword\_\_28372\_\_body\_of\_text\_en\_US" (whose UTF8 encoding is longer than the max length 32766), all o…

---

## [Remove ^M from message](https://discuss.elastic.co/t/remove-m-from-message/263058)

<div class="topic-metadata">

**Author:** [@daemon](https://discuss.elastic.co/u/daemon)\
**Replies:** 2\
**Last updated:** [February 3, 2021, 3:56am UTC](https://discuss.elastic.co/t/remove-m-from-message/263058 "2021-02-03T03:56:46Z")

</div>

Hi, I am trying to ingest Java exceptions into Elasticsearch via logstash. In Kibana, they show up like this, \[2021-01-29 16:00:36.875\] \[139642182200000\] \[INF\] : \[58.122.202.198:57076\] ==\> RTSP OPTIONS Resp: RTSP/1.0…

---

## [Filebeat hint based autodiscover on Openshift/Kubernetes](https://discuss.elastic.co/t/filebeat-hint-based-autodiscover-on-openshift-kubernetes/263019)

<div class="topic-metadata">

**Author:** [@Kosodrom](https://discuss.elastic.co/u/Kosodrom)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 5:50pm UTC](https://discuss.elastic.co/t/filebeat-hint-based-autodiscover-on-openshift-kubernetes/263019 "2021-02-02T17:50:03Z")

</div>

Hi folks, I am using following filebeat configuration (7.10). Filebeat is running on openshift: filebeat.autodiscover: providers: - type: kubernetes node: ${NODE\_NAME} hints.enabled: true hints.…

---

## [Create multiple Index for different steams of data](https://discuss.elastic.co/t/create-multiple-index-for-different-steams-of-data/261203)

<div class="topic-metadata">

**Author:** [@leinad](https://discuss.elastic.co/u/leinad)\
**Replies:** 9\
**Last updated:** [February 3, 2021, 3:45am UTC](https://discuss.elastic.co/t/create-multiple-index-for-different-steams-of-data/261203 "2021-02-03T03:45:05Z")

</div>

Hi , I am very new on setting up log stash, but have been using Kibana on user level of createing dashboard and analysis using basic templates My input logs are all JSON types, this is the logstash config which works p…

---

## [Logstash kafka output plugin - What happens if Kafka goes down](https://discuss.elastic.co/t/logstash-kafka-output-plugin-what-happens-if-kafka-goes-down/263012)

<div class="topic-metadata">

**Author:** [@vigneshr35](https://discuss.elastic.co/u/vigneshr35)\
**Replies:** 4\
**Last updated:** [February 3, 2021, 3:28am UTC](https://discuss.elastic.co/t/logstash-kafka-output-plugin-what-happens-if-kafka-goes-down/263012 "2021-02-03T03:28:30Z")

</div>

Hi All, I am looking to use the Logstash Kafka output plugin to post events to a Kafka topic. While logstash is pushing logs what happens if Kafka server goes down suddenly for some reason? By the time we bring back Ka…

---

## [Fail to install logstash plugin, version 7.6.2](https://discuss.elastic.co/t/fail-to-install-logstash-plugin-version-7-6-2/262443)

<div class="topic-metadata">

**Author:** [@wink](https://discuss.elastic.co/u/wink)\
**Replies:** 7\
**Last updated:** [February 3, 2021, 2:59am UTC](https://discuss.elastic.co/t/fail-to-install-logstash-plugin-version-7-6-2/262443 "2021-02-03T02:59:01Z")

</div>

Hi, I just do everything like on https://www.elastic.co/guide/en/logstash/current/java-filter-plugin.html#\_copy\_the\_example\_repo\_3. I did not change any code. But It comes out some error when I try to install the plug…

---

## [Elasticsearch remote cluster authentication mapping](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication-mapping/263057)

<div class="topic-metadata">

**Author:** [@xxlaila](https://discuss.elastic.co/u/xxlaila)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 2:21am UTC](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication-mapping/263057 "2021-02-03T02:21:08Z")

</div>

Elasticsearch did a cross-cluster mapping There is no problem in creating a new user to get cross-cluster data, but it prompts 404 when getting mapping Execute statement: curl -H "Content-Type: application/json" -XGET -…

---

## [Monitor state transistion of ongoing application](https://discuss.elastic.co/t/monitor-state-transistion-of-ongoing-application/263027)

<div class="topic-metadata">

**Author:** [@schuessa](https://discuss.elastic.co/u/schuessa)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 2:20am UTC](https://discuss.elastic.co/t/monitor-state-transistion-of-ongoing-application/263027 "2021-02-03T02:20:13Z")

</div>

I'm trying to set up the ability have some application log jobs such as 2021-02-02T12:55:51-0500 \[JOB:444\] \[START\] My external job has started 2021-02-02T12:55:51-0500 \[JOB:444\] \[MY\_EVENT\] Some update to the job…

---

## [Parsing Mapping and finding the right ECS fields for logs in general](https://discuss.elastic.co/t/parsing-mapping-and-finding-the-right-ecs-fields-for-logs-in-general/262451)

<div class="topic-metadata">

**Author:** [@cgekoski](https://discuss.elastic.co/u/cgekoski)\
**Replies:** 1\
**Last updated:** [February 2, 2021, 11:43pm UTC](https://discuss.elastic.co/t/parsing-mapping-and-finding-the-right-ecs-fields-for-logs-in-general/262451 "2021-02-02T23:43:52Z")

</div>

Hello everyone. I'm going to start with saying sorry TLDR but hope someone can shine the light in the right direction. Pretty new to logstash/elastic and trying to come to grasp with the ECS field guide and want to teach…

---

## [Pipeline UI viewer shows zero events everywhere](https://discuss.elastic.co/t/pipeline-ui-viewer-shows-zero-events-everywhere/262367)

<div class="topic-metadata">

**Author:** [@holobolo0815](https://discuss.elastic.co/u/holobolo0815)\
**Replies:** 2\
**Last updated:** [February 2, 2021, 10:36pm UTC](https://discuss.elastic.co/t/pipeline-ui-viewer-shows-zero-events-everywhere/262367 "2021-02-02T22:36:49Z")

</div>

At first I thought it was due to legacy monitoring still active, I switched to metricbeats in any case, but it still does not show the events in the processing pipeline. The overview screen shows received and emitted …

---

## [Filter on a field containing multiple values](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044)

<div class="topic-metadata">

**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 8:59pm UTC](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044 "2021-02-02T20:59:46Z")

</div>

{ customer: A, products: \[B, C\], price: \[123, 456\] } { customer: B, products: \[C, D, E\], price: \[123, 789, 987\] } In this example, how do i filter on product field with one value .... basically in the above exa…

---

## [Create a url field pyelasticsearch python](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047)

<div class="topic-metadata">

**Author:** [@Tlm\_Konstantinos](https://discuss.elastic.co/u/Tlm_Konstantinos)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 9:37pm UTC](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047 "2021-02-02T21:37:45Z")

</div>

I am using in python the module pyelasticsearch v7.10.1 and I am trying to update a document in one index in the elasticsearch server. What should I do if I want to create a hyperlink field during the update? source\_to\_…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1573)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1575)
