# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1161

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1162

---

## [Call recursively an API](https://discuss.elastic.co/t/call-recursively-an-api/289284)

<div class="topic-metadata">

**Author:** [@Mihai\_Stuparu](https://discuss.elastic.co/u/Mihai_Stuparu)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 7:47am UTC](https://discuss.elastic.co/t/call-recursively-an-api/289284 "2021-11-17T07:47:30Z")

</div>

Hello, Using below basic http\_poller request I will obtain a .json file that contains an attribute called "id". For each "id" I need to call other APIs, having the "id" value in the url: https://..../id. How can I ach…

---

## [Windows NPS Logs](https://discuss.elastic.co/t/windows-nps-logs/289115)

<div class="topic-metadata">

**Author:** [@VamPikmin](https://discuss.elastic.co/u/VamPikmin)\
**Replies:** 10\
**Last updated:** [November 17, 2021, 7:18am UTC](https://discuss.elastic.co/t/windows-nps-logs/289115 "2021-11-17T07:18:57Z")

</div>

Hello everyone, I've been looking for a filebeat module for NPS Logs but there doesn't appear to be one available. What are my options here? I have winlogbeat which can get stuff from event log but in C:\\Windows\\Logs …

---

## [Elastic Search does not get logs from fluentbit](https://discuss.elastic.co/t/elastic-search-does-not-get-logs-from-fluentbit/289276)

<div class="topic-metadata">

**Author:** [@merveyil](https://discuss.elastic.co/u/merveyil)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 7:11am UTC](https://discuss.elastic.co/t/elastic-search-does-not-get-logs-from-fluentbit/289276 "2021-11-17T07:11:58Z")

</div>

Hi, i am newbie on Elasticsearch. I installed Elasticsearch and tried to send logs from fluentbit to elastic. I have script that generates 60 mb logs per minute. I read these logs with fluentbit and try to send them to e…

---

## [Restore cold indices on new cluster](https://discuss.elastic.co/t/restore-cold-indices-on-new-cluster/289315)

<div class="topic-metadata">

**Author:** [@maj7](https://discuss.elastic.co/u/maj7)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 7:00am UTC](https://discuss.elastic.co/t/restore-cold-indices-on-new-cluster/289315 "2021-11-17T07:00:56Z")

</div>

Hello everyone, I have a cluster which has a big amount of data and I wanted to move my data to a new cluster. The problem is my new cluster will not have a cold node. I took a snapshot of my old cluster and when I tr…

---

## [Wordnet Korean Dictionary for synonym](https://discuss.elastic.co/t/wordnet-korean-dictionary-for-synonym/289397)

<div class="topic-metadata">

**Author:** [@user\_el](https://discuss.elastic.co/u/user_el)\
**Replies:** 0\
**Last updated:** [November 17, 2021, 6:59am UTC](https://discuss.elastic.co/t/wordnet-korean-dictionary-for-synonym/289397 "2021-11-17T06:59:10Z")

</div>

Hi I want to use synonyms for the Korean language in wordnet format. I am not able to find any dictionary. If anyone knows where can I get one. Please help.

---

## [Exiting: error loading config file: yaml: line 189: did not find expected key](https://discuss.elastic.co/t/exiting-error-loading-config-file-yaml-line-189-did-not-find-expected-key/289317)

<div class="topic-metadata">

**Author:** [@armughan](https://discuss.elastic.co/u/armughan)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 6:37am UTC](https://discuss.elastic.co/t/exiting-error-loading-config-file-yaml-line-189-did-not-find-expected-key/289317 "2021-11-17T06:37:30Z")

</div>

Hi All, I'm trying to connect Filebeat with Elasticsearch After the configuration of filebeat.yml I'm having "Exiting: error loading config file: yaml: line 189: did not find expected key" filebeat.inputs: - type: log…

---

## [How to set a condition in set processor (ingest node pipeline) to check if log.level= error](https://discuss.elastic.co/t/how-to-set-a-condition-in-set-processor-ingest-node-pipeline-to-check-if-log-level-error/289347)

<div class="topic-metadata">

**Author:** [@sidharth\_vijayakumar](https://discuss.elastic.co/u/sidharth_vijayakumar)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 4:28am UTC](https://discuss.elastic.co/t/how-to-set-a-condition-in-set-processor-ingest-node-pipeline-to-check-if-log-level-error/289347 "2021-11-17T04:28:20Z")

</div>

Hi, my doc looks like this and I need to access log.level which is a nested field. can someone help me as I need a condition to set a new field called statuscode if log.level=error. tried ctx.messageinfo.log.level=="e…

---

## [Install watcher plugin](https://discuss.elastic.co/t/install-watcher-plugin/289320)

<div class="topic-metadata">

**Author:** [@Rizky\_Hudha](https://discuss.elastic.co/u/Rizky_Hudha)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 3:46am UTC](https://discuss.elastic.co/t/install-watcher-plugin/289320 "2021-11-17T03:46:38Z")

</div>

Hello, hello I tried to install the watcher plugin on my centos server, but the package was not found, is there another way to install it. And this report error No package license available. Error: Nothing to do No …

---

## [Monitoring does not work (Metricbeat)](https://discuss.elastic.co/t/monitoring-does-not-work-metricbeat/289380)

<div class="topic-metadata">

**Author:** [@VellayLoket](https://discuss.elastic.co/u/VellayLoket)\
**Replies:** 1\
**Last updated:** [November 17, 2021, 2:26am UTC](https://discuss.elastic.co/t/monitoring-does-not-work-metricbeat/289380 "2021-11-17T02:26:17Z")

</div>

I'm trying to setup metricbeat, the service on Elasticsearch node started successfully, sending data, no problem. Kibana shows that metrics index was created and there are some information saved but when i try to migrate…

---

## [Doesn't a field support multiple types?](https://discuss.elastic.co/t/doesnt-a-field-support-multiple-types/289271)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 4\
**Last updated:** [November 17, 2021, 2:23am UTC](https://discuss.elastic.co/t/doesnt-a-field-support-multiple-types/289271 "2021-11-17T02:23:52Z")

</div>

org.elasticsearch.index.mapper.MapperParsingException: object mapping for \[http.request.body.original\] tried to parse field \[original\] as object, but found a concrete value I plan to convert the http.request.body.orig…

---

## [Add buttons at Kibana Dashboard](https://discuss.elastic.co/t/add-buttons-at-kibana-dashboard/289154)

<div class="topic-metadata">

**Author:** [@111505](https://discuss.elastic.co/u/111505)\
**Replies:** 2\
**Last updated:** [November 17, 2021, 12:17am UTC](https://discuss.elastic.co/t/add-buttons-at-kibana-dashboard/289154 "2021-11-17T00:17:08Z")

</div>

Hello. I would like to add buttons to Kibana Dashboard. This button is to request an API to the server that I developed. Is this possible?

---

## [Node roles distribution](https://discuss.elastic.co/t/node-roles-distribution/289373)

<div class="topic-metadata">

**Author:** [@gutierrezfj](https://discuss.elastic.co/u/gutierrezfj)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 11:47pm UTC](https://discuss.elastic.co/t/node-roles-distribution/289373 "2021-11-16T23:47:27Z")

</div>

Hi community, I have 4 hosts to dedicate to Elasticsearch, what is the best distribution of master and data nodes as well as primary shards and replicas? thanks

---

## [Unable to restore snapshots](https://discuss.elastic.co/t/unable-to-restore-snapshots/289242)

<div class="topic-metadata">

**Author:** [@Prabakar](https://discuss.elastic.co/u/Prabakar)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 11:27pm UTC](https://discuss.elastic.co/t/unable-to-restore-snapshots/289242 "2021-11-16T23:27:58Z")

</div>

Unable to restore snapshots and got below error. I have closed the indexes whatever we created. But still system asks us to close system indexes as well. But if we try to close the system indexes then I am getting warnin…

---

## [Elasticsearch per request circuit breakers and real memory](https://discuss.elastic.co/t/elasticsearch-per-request-circuit-breakers-and-real-memory/289295)

<div class="topic-metadata">

**Author:** [@zvonimir](https://discuss.elastic.co/u/zvonimir)\
**Replies:** 2\
**Last updated:** [November 16, 2021, 10:59pm UTC](https://discuss.elastic.co/t/elasticsearch-per-request-circuit-breakers-and-real-memory/289295 "2021-11-16T22:59:41Z")

</div>

Hi. After upgrading to version 7.13.1 with new circuit breakers that use real memory we are having issues with heavy aggregates on Elasticsearch cluster. Per request circuit breakers are not being tripped and nodes (58GB…

---

## [Cannot Load MaxMind GeoIP2-ISP.mmdb](https://discuss.elastic.co/t/cannot-load-maxmind-geoip2-isp-mmdb/289027)

<div class="topic-metadata">

**Author:** [@reyjrar](https://discuss.elastic.co/u/reyjrar)\
**Replies:** 6\
**Last updated:** [November 16, 2021, 10:45pm UTC](https://discuss.elastic.co/t/cannot-load-maxmind-geoip2-isp-mmdb/289027 "2021-11-16T22:45:25Z")

</div>

Hello, We use multiple GeoIP databases. We're using GeoIP2-City to get location information, and GeoIP-ISP to get as.number and as.organization.name. However, I cannot load the provided MaxMind GeoIP2-ISP.mmdb. { "d…

---

## [How do I setup different retentions](https://discuss.elastic.co/t/how-do-i-setup-different-retentions/289359)

<div class="topic-metadata">

**Author:** [@jnpetty](https://discuss.elastic.co/u/jnpetty)\
**Replies:** 3\
**Last updated:** [November 16, 2021, 10:36pm UTC](https://discuss.elastic.co/t/how-do-i-setup-different-retentions/289359 "2021-11-16T22:36:24Z")

</div>

We are currently using Curator to delete specific indicies at 30, 60 and 90 days. We have added 2 warm and 2 cold nodes to our cluster and still want to be able to do the same retention with ILM. Right now we just have a…

---

## [Using Elasticsearch for storing logs in microservice-based architecture](https://discuss.elastic.co/t/using-elasticsearch-for-storing-logs-in-microservice-based-architecture/289288)

<div class="topic-metadata">

**Author:** [@Oleksii88](https://discuss.elastic.co/u/Oleksii88)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 10:30pm UTC](https://discuss.elastic.co/t/using-elasticsearch-for-storing-logs-in-microservice-based-architecture/289288 "2021-11-16T22:30:48Z")

</div>

Hi, I am writing a new microservice-based system and considering Elasticsearch for logging data storage. What are the best practices of using ElastiSearch for logging? For now, I have 2 questions? but if anybody has id…

---

## [Elastic agent on the cluster side?](https://discuss.elastic.co/t/elastic-agent-on-the-cluster-side/289272)

<div class="topic-metadata">

**Author:** [@marti1](https://discuss.elastic.co/u/marti1)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 10:29pm UTC](https://discuss.elastic.co/t/elastic-agent-on-the-cluster-side/289272 "2021-11-16T22:29:56Z")

</div>

Hi, I'm setting up a cluster with three nodes OnPremise. Until now, I used metricbeat and filebeat to get metrics and logs about the nodes. Should I use Elastic Agents on the nodes instead? What do you recomend? Thank…

---

## [ConnectionError: connect ECONNREFUSED](https://discuss.elastic.co/t/connectionerror-connect-econnrefused/289287)

<div class="topic-metadata">

**Author:** [@Maks\_7v](https://discuss.elastic.co/u/Maks_7v)\
**Replies:** 0\
**Last updated:** [November 16, 2021, 9:28am UTC](https://discuss.elastic.co/t/connectionerror-connect-econnrefused/289287 "2021-11-16T09:28:01Z")

</div>

I've configured Elasticsearch in k8s with a separate master, data, and ingest nodes. xpack.security.enabled is set to true I'm trying to connect a Node.js application to Elasticsearch using Elasticsearch-js client but …

---

## [Elastic gives error when I enable SSL](https://discuss.elastic.co/t/elastic-gives-error-when-i-enable-ssl/289349)

<div class="topic-metadata">

**Author:** [@Jorge\_Dionisio](https://discuss.elastic.co/u/Jorge_Dionisio)\
**Replies:** 0\
**Last updated:** [November 16, 2021, 4:25pm UTC](https://discuss.elastic.co/t/elastic-gives-error-when-i-enable-ssl/289349 "2021-11-16T16:25:35Z")

</div>

Hi everyone, I'm trying to enable SSL on the transport and ssl layer in Elasticsearch. My configuration is: cluster.name: elasticsearch node.name: jd-elk-01 path.data: "/var/lib/elasticsearch" path.logs: "/var/log/ela…

---

## [User authentication problem](https://discuss.elastic.co/t/user-authentication-problem/289202)

<div class="topic-metadata">

**Author:** [@McElroy](https://discuss.elastic.co/u/McElroy)\
**Replies:** 6\
**Last updated:** [November 16, 2021, 9:53pm UTC](https://discuss.elastic.co/t/user-authentication-problem/289202 "2021-11-16T21:53:51Z")

</div>

Hi, we have a problem with Kibana and XPack. We send out a URL to a specific dashboard to one of our users. When he authenticate with his credentials, he gets a server error. After refreshing the page, he gets onto the …

---

## [Convert my sql to elasticsearch without logstash](https://discuss.elastic.co/t/convert-my-sql-to-elasticsearch-without-logstash/289291)

<div class="topic-metadata">

**Author:** [@Rizky\_Hudha](https://discuss.elastic.co/u/Rizky_Hudha)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 7:45pm UTC](https://discuss.elastic.co/t/convert-my-sql-to-elasticsearch-without-logstash/289291 "2021-11-16T19:45:03Z")

</div>

is there a way other than using logstash to convert mysql to Elasticsearch. I just got a new task, to create a generic processor to convert mysql to Elasticsearch

---

## [Logstash - XML parsing including nested objects](https://discuss.elastic.co/t/logstash-xml-parsing-including-nested-objects/289323)

<div class="topic-metadata">

**Author:** [@anandd4](https://discuss.elastic.co/u/anandd4)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 6:10pm UTC](https://discuss.elastic.co/t/logstash-xml-parsing-including-nested-objects/289323 "2021-11-16T18:10:46Z")

</div>

Problem - Unable to convert object fields to flat fields upon parsing the XML Input - Dynamic Soap xml Example - \<SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/" xmlns:SOAP-ENC="http://sch…

---

## [Using mutate rename Source and destination? JSON plugin question for filter](https://discuss.elastic.co/t/using-mutate-rename-source-and-destination-json-plugin-question-for-filter/289337)

<div class="topic-metadata">

**Author:** [@kyats5000](https://discuss.elastic.co/u/kyats5000)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 6:02pm UTC](https://discuss.elastic.co/t/using-mutate-rename-source-and-destination-json-plugin-question-for-filter/289337 "2021-11-16T18:02:21Z")

</div>

HI there I am trying to find out what the syntax is for renaming fields from an incoming json message. We dropped the message at first to remove metadata but it is unclear to me in subsequent segments of the pipeline co…

---

## [Log parsing issue](https://discuss.elastic.co/t/log-parsing-issue/289306)

<div class="topic-metadata">

**Author:** [@Divya\_Bansal](https://discuss.elastic.co/u/Divya_Bansal)\
**Replies:** 5\
**Last updated:** [November 16, 2021, 6:00pm UTC](https://discuss.elastic.co/t/log-parsing-issue/289306 "2021-11-16T18:00:33Z")

</div>

I am having a log in the following format:- {"@timestamp":"2021-08-04T09:57:25.141Z","@metadata":{"beat":"filebeat","type":"\_doc","version":"7.6.3"},"log":{"offset":10413931,"file":{"path":"api/api.log"}},"message":"\[ER…

---

## [Logstahs Filter](https://discuss.elastic.co/t/logstahs-filter/289078)

<div class="topic-metadata">

**Author:** [@John\_snow](https://discuss.elastic.co/u/John_snow)\
**Replies:** 9\
**Last updated:** [November 16, 2021, 5:57pm UTC](https://discuss.elastic.co/t/logstahs-filter/289078 "2021-11-16T17:57:46Z")

</div>

Can we apply 2 filter in 1 logstash conf file. I wanted to parse 1 log twice and send the message to multiple outputs. e-g 1 filter to remove some fields and send the message to output 2nd filter doing another check an…

---

## [CSV quote char inside data](https://discuss.elastic.co/t/csv-quote-char-inside-data/289290)

<div class="topic-metadata">

**Author:** [@nosql\_injection](https://discuss.elastic.co/u/nosql_injection)\
**Replies:** 1\
**Last updated:** [November 16, 2021, 5:44pm UTC](https://discuss.elastic.co/t/csv-quote-char-inside-data/289290 "2021-11-16T17:44:38Z")

</div>

Hi there, I'm trying to ingest syslog data with the CSV filter. I guess the issue is related to the " inside the URL part (acme.org&iid={"-123456\*\*"\*\*:4}&sid=123458&tid=123) of the log, which is the same char as the "…

---

## [Does ES2 Support scroll and search\_after for Retrieving \>10K Data](https://discuss.elastic.co/t/does-es2-support-scroll-and-search-after-for-retrieving-10k-data/289104)

<div class="topic-metadata">

**Author:** [@theodoreandrew](https://discuss.elastic.co/u/theodoreandrew)\
**Replies:** 5\
**Last updated:** [November 16, 2021, 5:27pm UTC](https://discuss.elastic.co/t/does-es2-support-scroll-and-search-after-for-retrieving-10k-data/289104 "2021-11-16T17:27:17Z")

</div>

Hey guys, I have a question about ES version 2. Does ES2 support scroll and search\_after for retrieving \>10K data? If ES2 doesn't support scroll and search\_after, how can I retrieve \>10K data on ES2? Thanks …

---

## [Creating pipeline Using beats in Windows and sending logs to logstash in linux](https://discuss.elastic.co/t/creating-pipeline-using-beats-in-windows-and-sending-logs-to-logstash-in-linux/289191)

<div class="topic-metadata">

**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\
**Replies:** 4\
**Last updated:** [November 16, 2021, 4:30pm UTC](https://discuss.elastic.co/t/creating-pipeline-using-beats-in-windows-and-sending-logs-to-logstash-in-linux/289191 "2021-11-16T16:30:09Z")

</div>

Hi, I am creating a pipeline using beats in windows to extract logs in form of txt file in multiple directories and send it to the Linux(server) to logstash to es/kibana. While running logstash conf pipeline I am getti…

---

## [Dropdown select filter not working](https://discuss.elastic.co/t/dropdown-select-filter-not-working/288518)

<div class="topic-metadata">

**Author:** [@karwei](https://discuss.elastic.co/u/karwei)\
**Replies:** 4\
**Last updated:** [November 16, 2021, 4:41pm UTC](https://discuss.elastic.co/t/dropdown-select-filter-not-working/288518 "2021-11-16T16:41:21Z")

</div>

Working with v7.14.1. I'm trying to add a dropdown select filter to my workpad in Canvas, but it is not giving me the list of items in the dropdown. The preview data shows the list. essql query="SELECT appId FROM \\"oe.…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1160)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1162)
