# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1290

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1291

---

## [When ES updated from 7.3.1 to 7.10.2, search slow 2x in fetch phase](https://discuss.elastic.co/t/when-es-updated-from-7-3-1-to-7-10-2-search-slow-2x-in-fetch-phase/280765)

<div class="topic-metadata">

**Author:** [@jiangnanxue21](https://discuss.elastic.co/u/jiangnanxue21)\
**Replies:** 0\
**Last updated:** [August 9, 2021, 6:46am UTC](https://discuss.elastic.co/t/when-es-updated-from-7-3-1-to-7-10-2-search-slow-2x-in-fetch-phase/280765 "2021-08-09T06:46:30Z")

</div>

Our product environment had updated es from 7.3.1 to 7.10.2, the index mapping and search sentence has not changed anymore. We specify include and exclude fileds by using that sourceBuilder.fetchSource(getIncludeFe…

---

## [Elasticsearch search\_phase\_execution\_exception in Python](https://discuss.elastic.co/t/elasticsearch-search-phase-execution-exception-in-python/280763)

<div class="topic-metadata">

**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\
**Replies:** 0\
**Last updated:** [August 9, 2021, 6:35am UTC](https://discuss.elastic.co/t/elasticsearch-search-phase-execution-exception-in-python/280763 "2021-08-09T06:35:42Z")

</div>

I fetch all my Elasticsearch documents via using scroll api with below code in Python. size = 100 data = es.search( index=index, scroll='25m', size=size, body=body …

---

## [Ibm mq module issue in metricbeat](https://discuss.elastic.co/t/ibm-mq-module-issue-in-metricbeat/280761)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 1\
**Last updated:** [August 9, 2021, 6:14am UTC](https://discuss.elastic.co/t/ibm-mq-module-issue-in-metricbeat/280761 "2021-08-09T06:14:52Z")

</div>

Hi all, I am trying to monitor my IBM WebSphere MQ using ibmmq module of metricbeat version 7.13.1. the metricbeat.yml setting is as following: # =========================== Modules configuration =====================…

---

## [Discover: Request Timeout after 30000ms](https://discuss.elastic.co/t/discover-request-timeout-after-30000ms/280593)

<div class="topic-metadata">

**Author:** [@sha\_man](https://discuss.elastic.co/u/sha_man)\
**Replies:** 2\
**Last updated:** [August 9, 2021, 5:48am UTC](https://discuss.elastic.co/t/discover-request-timeout-after-30000ms/280593 "2021-08-09T05:48:13Z")

</div>

Hi, we are using Kibana 6.7.1 and Elasticsearch version 6.7 in our org. when I run a query to get the data i get timeout error as "Discover: Request Timeout after 30000ms". We have deployed kibana using helm charts in …

---

## [Find Correlation between fields in different indices](https://discuss.elastic.co/t/find-correlation-between-fields-in-different-indices/280498)

<div class="topic-metadata">

**Author:** [@WJ\_Y](https://discuss.elastic.co/u/WJ_Y)\
**Replies:** 1\
**Last updated:** [August 9, 2021, 5:24am UTC](https://discuss.elastic.co/t/find-correlation-between-fields-in-different-indices/280498 "2021-08-09T05:24:45Z")

</div>

Using Elasticsearch version 7.14.0, I want to find correlations betweet fields in different indices. An index named "A" has "name", "a-1", "a-2" fields. An index named "B" has "name", "b-1", "b-2" fields. The "name" f…

---

## [/\_security/api\_key - disable / enable](https://discuss.elastic.co/t/security-api-key-disable-enable/280755)

<div class="topic-metadata">

**Author:** [@byteandbit](https://discuss.elastic.co/u/byteandbit)\
**Replies:** 4\
**Last updated:** [August 9, 2021, 5:22am UTC](https://discuss.elastic.co/t/security-api-key-disable-enable/280755 "2021-08-09T05:22:17Z")

</div>

Hey, Just wondering if after creating API Key (/\_security/api\_key) there is a way to disable/enable it without invalidation?

---

## [Strange behaviour Index Pattern](https://discuss.elastic.co/t/strange-behaviour-index-pattern/280532)

<div class="topic-metadata">

**Author:** [@Jose\_Manuel\_Tirado](https://discuss.elastic.co/u/Jose_Manuel_Tirado)\
**Replies:** 1\
**Last updated:** [August 9, 2021, 5:03am UTC](https://discuss.elastic.co/t/strange-behaviour-index-pattern/280532 "2021-08-09T05:03:42Z")

</div>

HI! when I access index pattern I see these strange fields and I can't do anything with them What are they and how can I eliminate them? Are they occupying my memory? Thank you

---

## [Logstash not listening on beats input port](https://discuss.elastic.co/t/logstash-not-listening-on-beats-input-port/280559)

<div class="topic-metadata">

**Author:** [@r.saigiridhar](https://discuss.elastic.co/u/r.saigiridhar)\
**Replies:** 1\
**Last updated:** [August 9, 2021, 5:02am UTC](https://discuss.elastic.co/t/logstash-not-listening-on-beats-input-port/280559 "2021-08-09T05:02:27Z")

</div>

Logstash server is not listening on the beats input port specified. I have installed beats input plugin in logstash server, created a conf file with input port specified and pipelines file that has an entry for the conf. …

---

## [Handle Multiline logs, where number of lines are not sure?](https://discuss.elastic.co/t/handle-multiline-logs-where-number-of-lines-are-not-sure/280757)

<div class="topic-metadata">

**Author:** [@bpandit](https://discuss.elastic.co/u/bpandit)\
**Replies:** 0\
**Last updated:** [August 9, 2021, 3:47am UTC](https://discuss.elastic.co/t/handle-multiline-logs-where-number-of-lines-are-not-sure/280757 "2021-08-09T03:47:57Z")

</div>

I need a way to handle multi line logs, where number of lines are not sure, below is the log data, where start \[29-Apr-2018 16:46:32\] \[pool int-mobileapp\] pid 30064 script\_filename = /var/www/html/int-mobileapp/index.p…

---

## [Remove index mappings in version 7.4](https://discuss.elastic.co/t/remove-index-mappings-in-version-7-4/280636)

<div class="topic-metadata">

**Author:** [@aldm](https://discuss.elastic.co/u/aldm)\
**Replies:** 3\
**Last updated:** [August 8, 2021, 11:26pm UTC](https://discuss.elastic.co/t/remove-index-mappings-in-version-7-4/280636 "2021-08-08T23:26:40Z")

</div>

Hi, We made a mistake to store details\_per\_category in this way { cat1: object, cat2: object, . .. } Now there are thousands of categories, which generated thousands of new fields in out index. We corrected it b…

---

## [FATAL UnableToReadKeystore: unable to read keystore](https://discuss.elastic.co/t/fatal-unabletoreadkeystore-unable-to-read-keystore/280710)

<div class="topic-metadata">

**Author:** [@AmirHossein\_Sohrabi](https://discuss.elastic.co/u/AmirHossein_Sohrabi)\
**Replies:** 2\
**Last updated:** [August 8, 2021, 11:25pm UTC](https://discuss.elastic.co/t/fatal-unabletoreadkeystore-unable-to-read-keystore/280710 "2021-08-08T23:25:54Z")

</div>

I'm using an ubuntu 16.04 server on a VM. and installed elasticsearch and kibana both version 7.14. elasticsearch works properly. but when I start the kibana service first it logs running on "systemctl status kibana" …

---

## [Unable to upload json file to elastic search](https://discuss.elastic.co/t/unable-to-upload-json-file-to-elastic-search/280712)

<div class="topic-metadata">

**Author:** [@cmunka](https://discuss.elastic.co/u/cmunka)\
**Replies:** 2\
**Last updated:** [August 8, 2021, 11:19pm UTC](https://discuss.elastic.co/t/unable-to-upload-json-file-to-elastic-search/280712 "2021-08-08T23:19:27Z")

</div>

I am trying to upload a jsonl file to elastic search via \_bulk api using Python. Below is my code.! Error: Data is having multiple json object: ##code## # -\*- coding: utf-8 -\*- import requests import json url …

---

## [Serilog and Filebeat Compatibility](https://discuss.elastic.co/t/serilog-and-filebeat-compatibility/280678)

<div class="topic-metadata">

**Author:** [@christamlyn](https://discuss.elastic.co/u/christamlyn)\
**Replies:** 1\
**Last updated:** [August 8, 2021, 11:14pm UTC](https://discuss.elastic.co/t/serilog-and-filebeat-compatibility/280678 "2021-08-08T23:14:48Z")

</div>

Quite specific to our setup but: we are currently using Filebeat to ship logs to Elasticsearch we want to slowly migrate to using Serilog sinks to ship to Elasticsearch we have a number of dashboards setup for the exis…

---

## [Parse a CSV file with grok logstash](https://discuss.elastic.co/t/parse-a-csv-file-with-grok-logstash/280726)

<div class="topic-metadata">

**Author:** [@Hind](https://discuss.elastic.co/u/Hind)\
**Replies:** 3\
**Last updated:** [August 8, 2021, 10:32pm UTC](https://discuss.elastic.co/t/parse-a-csv-file-with-grok-logstash/280726 "2021-08-08T22:32:19Z")

</div>

Hello! How could I parse a string that is between double quotes with grok logstash. "Kaathadimattam, Balacola Post, NEAR Siva Tea Factory, Ooty, 643203 Ooty, India – Great location -",ooty,India,..... thank you.

---

## [Array of objects - LogStash Conf](https://discuss.elastic.co/t/array-of-objects-logstash-conf/280750)

<div class="topic-metadata">

**Author:** [@me.mohammed](https://discuss.elastic.co/u/me.mohammed)\
**Replies:** 1\
**Last updated:** [August 8, 2021, 10:08pm UTC](https://discuss.elastic.co/t/array-of-objects-logstash-conf/280750 "2021-08-08T22:08:31Z")

</div>

I'm currently working on fetching my data from MySQL and pushing it to ElasticSearch through LogStash, although I'm kind of having an issue with the logstash configuration I basically have Products and each of those pro…

---

## [Issues with builtin network ML job high\_count\_network\_denies](https://discuss.elastic.co/t/issues-with-builtin-network-ml-job-high-count-network-denies/280635)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 1\
**Last updated:** [August 8, 2021, 8:12pm UTC](https://discuss.elastic.co/t/issues-with-builtin-network-ml-job-high-count-network-denies/280635 "2021-08-08T20:12:09Z")

</div>

Hello, Just tried the new builtin network ML jobs.. First of all, our Elastic stack crashed after adding the ML jobs through the wizard. After recovering one of the four jobs, high\_count\_network\_denies, seemed to not pr…

---

## [Parsing a Raw JSON file "Invalid Setting for json filter"](https://discuss.elastic.co/t/parsing-a-raw-json-file-invalid-setting-for-json-filter/280735)

<div class="topic-metadata">

**Author:** [@Wilks](https://discuss.elastic.co/u/Wilks)\
**Replies:** 4\
**Last updated:** [August 8, 2021, 7:38pm UTC](https://discuss.elastic.co/t/parsing-a-raw-json-file-invalid-setting-for-json-filter/280735 "2021-08-08T19:38:58Z")

</div>

Hi, I am trying to parse a simple raw JSON file but I am getting an error about invalid setting for JSON filter. I am wondering if its the way my filter is setup and the fact that its nested json? \[ERROR\] 2021-08-08 1…

---

## [Http\_poller skip SSL validation](https://discuss.elastic.co/t/http-poller-skip-ssl-validation/280713)

<div class="topic-metadata">

**Author:** [@panagiss](https://discuss.elastic.co/u/panagiss)\
**Replies:** 3\
**Last updated:** [August 8, 2021, 6:41pm UTC](https://discuss.elastic.co/t/http-poller-skip-ssl-validation/280713 "2021-08-08T18:41:22Z")

</div>

Is there a way to skip SSL server certificate validation? I'm trying to hit a local server with a self-signed cert but i get errors of course. I saw for other plugins that this was added as an option but nothing for ht…

---

## [How can we populate from different index using reference id stored in main index as in Mongodb](https://discuss.elastic.co/t/how-can-we-populate-from-different-index-using-reference-id-stored-in-main-index-as-in-mongodb/279724)

<div class="topic-metadata">

**Author:** [@singhrohitdangi](https://discuss.elastic.co/u/singhrohitdangi)\
**Replies:** 5\
**Last updated:** [August 8, 2021, 6:30pm UTC](https://discuss.elastic.co/t/how-can-we-populate-from-different-index-using-reference-id-stored-in-main-index-as-in-mongodb/279724 "2021-08-08T18:30:32Z")

</div>

Hi, Actually, I am a beginner at elastic. I want to use elastic for a music app so we can assume all the possible entities of a music app i.e Spotify. I have a doubt that can we populate from the second index (assume=\> …

---

## [Logstash crashes when I run .bat file from powershell](https://discuss.elastic.co/t/logstash-crashes-when-i-run-bat-file-from-powershell/280245)

<div class="topic-metadata">

**Author:** [@realj4ke](https://discuss.elastic.co/u/realj4ke)\
**Replies:** 4\
**Last updated:** [August 8, 2021, 4:59pm UTC](https://discuss.elastic.co/t/logstash-crashes-when-i-run-bat-file-from-powershell/280245 "2021-08-08T16:59:05Z")

</div>

Below is the error that I get when I try to run logstash after downloading the .zip file from the official website. .\\logstash.bat -f logstash.conf Using JAVA\_HOME defined java: C:\\P…

---

## [Tokenizer works after Synonym (graph) token filter too?](https://discuss.elastic.co/t/tokenizer-works-after-synonym-graph-token-filter-too/280297)

<div class="topic-metadata">

**Author:** [@taichi](https://discuss.elastic.co/u/taichi)\
**Replies:** 2\
**Last updated:** [August 8, 2021, 4:21pm UTC](https://discuss.elastic.co/t/tokenizer-works-after-synonym-graph-token-filter-too/280297 "2021-08-08T16:21:36Z")

</div>

I'm using Elasticsearch 7.7 on AWS Elasticsearch Service. I thought token filters works after tokenizers and tokenizers do nothing after token filters. (like Tokenizers = \> Token filters =\> END) But it seems tokenizer…

---

## [Can I install ELastic Search twice as a windows service?](https://discuss.elastic.co/t/can-i-install-elastic-search-twice-as-a-windows-service/280022)

<div class="topic-metadata">

**Author:** [@mhare](https://discuss.elastic.co/u/mhare)\
**Replies:** 10\
**Last updated:** [August 8, 2021, 3:22pm UTC](https://discuss.elastic.co/t/can-i-install-elastic-search-twice-as-a-windows-service/280022 "2021-08-08T15:22:00Z")

</div>

For reasons that may be uninteresting to many, I find myself needing to run two instances of ElasticSearch on the same Windows machine. I have unzipped the 7.13.4 archive into two separate directories and set them up and…

---

## [Data nodes left cluster](https://discuss.elastic.co/t/data-nodes-left-cluster/280725)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 1\
**Last updated:** [August 8, 2021, 3:01pm UTC](https://discuss.elastic.co/t/data-nodes-left-cluster/280725 "2021-08-08T15:01:38Z")

</div>

Today i noticed that two data nodes left the cluster although disk ,cpu,ram was fine but i can't find the reason in log Currently i am using latest version ELK 7.13.2.I am running 3 master nodes plus 6 data nodes and 2 …

---

## [Correct way of configuring metricbeat](https://discuss.elastic.co/t/correct-way-of-configuring-metricbeat/279929)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 2\
**Last updated:** [August 8, 2021, 10:40am UTC](https://discuss.elastic.co/t/correct-way-of-configuring-metricbeat/279929 "2021-08-08T10:40:46Z")

</div>

I am running 11 nodes of elasticsearch cluster which include the following Three master nodes Six data nodes 2 coordinate nodes Earlier i installed and setup metricbeat in all nodes but it leads to consumption of high…

---

## [Logstash not seeing updates in logs by spring boot](https://discuss.elastic.co/t/logstash-not-seeing-updates-in-logs-by-spring-boot/280717)

<div class="topic-metadata">

**Author:** [@Kapil\_Soni](https://discuss.elastic.co/u/Kapil_Soni)\
**Replies:** 0\
**Last updated:** [August 7, 2021, 8:58pm UTC](https://discuss.elastic.co/t/logstash-not-seeing-updates-in-logs-by-spring-boot/280717 "2021-08-07T20:58:33Z")

</div>

New Logs generated by Spring Boot is not updating in Kibana. Logstash =\> ES =\> Kibana I'm using spring logback.xml with RollingFileAppender & SizeAndTimeBasedRollingPolicy to generate log file. Here is my logstash.con…

---

## [Regexp containing double quotes](https://discuss.elastic.co/t/regexp-containing-double-quotes/280662)

<div class="topic-metadata">

**Author:** [@Olaph](https://discuss.elastic.co/u/Olaph)\
**Replies:** 2\
**Last updated:** [August 7, 2021, 7:12pm UTC](https://discuss.elastic.co/t/regexp-containing-double-quotes/280662 "2021-08-07T19:12:49Z")

</div>

Hello, I am trying to search values that contains numbers or numbers in a quotes (no other character types except whitespaces). I was not able to use double-quotes character in character class. I have tried both \\" and…

---

## [Snapshot watcher - when there are more multiple repositories to be watched](https://discuss.elastic.co/t/snapshot-watcher-when-there-are-more-multiple-repositories-to-be-watched/280246)

<div class="topic-metadata">

**Author:** [@achybala](https://discuss.elastic.co/u/achybala)\
**Replies:** 7\
**Last updated:** [August 7, 2021, 1:39pm UTC](https://discuss.elastic.co/t/snapshot-watcher-when-there-are-more-multiple-repositories-to-be-watched/280246 "2021-08-07T13:39:38Z")

</div>

Hi, With the help from multiple discussions in this forum, I'm able to create a watcher to look for any snapshots in 'failed' state in a given snapshot repository. { "trigger": { "schedule": { "interval": "60s" …

---

## [Elasticsearch 7.14 fails to start on Ubuntu 20.04](https://discuss.elastic.co/t/elasticsearch-7-14-fails-to-start-on-ubuntu-20-04/280705)

<div class="topic-metadata">

**Author:** [@theonlycharithperera](https://discuss.elastic.co/u/theonlycharithperera)\
**Replies:** 2\
**Last updated:** [August 7, 2021, 11:56am UTC](https://discuss.elastic.co/t/elasticsearch-7-14-fails-to-start-on-ubuntu-20-04/280705 "2021-08-07T11:56:53Z")

</div>

When I first installed it using apt-get everything went smoothly and I was able to start it as a service and verified it was working by using curl: Later I noticed that it was using a lot of memory (2GB), so I stopped t…

---

## [Deleted ingest pipeline, doh! - Can't get it Back](https://discuss.elastic.co/t/deleted-ingest-pipeline-doh-cant-get-it-back/280687)

<div class="topic-metadata">

**Author:** [@ajhstn](https://discuss.elastic.co/u/ajhstn)\
**Replies:** 11\
**Last updated:** [August 7, 2021, 8:27am UTC](https://discuss.elastic.co/t/deleted-ingest-pipeline-doh-cant-get-it-back/280687 "2021-08-07T08:27:52Z")

</div>

Hey there, I configured Fleet in the console, installed/enrolled an agent down on my server and configured an integration.. Moments later i got logs and kibana was happy. I'm an idiot and accidently deleted the ingest …

---

## [Kibana startup Fatal error](https://discuss.elastic.co/t/kibana-startup-fatal-error/280669)

<div class="topic-metadata">

**Author:** [@AmirHossein\_Sohrabi](https://discuss.elastic.co/u/AmirHossein_Sohrabi)\
**Replies:** 3\
**Last updated:** [August 7, 2021, 4:40am UTC](https://discuss.elastic.co/t/kibana-startup-fatal-error/280669 "2021-08-07T04:40:37Z")

</div>

I'm using an ubuntu 16.04 server on a VM. and installed elasticsearch and kibana both version 7.14. elasticsearch works properly. but when I start the kibana service first it logs running on "systemctl status kibana" …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1289)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1291)
