# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=587

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 588

---

## [Python - How to upload jsonl file to Elasticsearch](https://discuss.elastic.co/t/python-how-to-upload-jsonl-file-to-elasticsearch/282408)

<div class="topic-metadata">

**Author:** [@Talents](https://discuss.elastic.co/u/Talents)\
**Replies:** 1\
**Last updated:** [August 25, 2021, 12:53am UTC](https://discuss.elastic.co/t/python-how-to-upload-jsonl-file-to-elasticsearch/282408 "2021-08-25T00:53:22Z")

</div>

So I'm trying to learn how to use Elasticsearch but I'm really struggling. I've tried looking at the official documentation but it's really not helping me. Basically what I'm trying to do is upload a jsonl file that has…

---

## [Why elasticsearch Downs After Reboot](https://discuss.elastic.co/t/why-elasticsearch-downs-after-reboot/281678)

<div class="topic-metadata">

**Author:** [@mertkaant](https://discuss.elastic.co/u/mertkaant)\
**Replies:** 5\
**Last updated:** [August 24, 2021, 10:15pm UTC](https://discuss.elastic.co/t/why-elasticsearch-downs-after-reboot/281678 "2021-08-24T22:15:02Z")

</div>

Hello, dear community, Recently we faced some critical errors in elasticsearch. The errors down below occurred after we rebooted the machines. #Issue: Failed to Read keystore Password on Console The problem was Elasti…

---

## [Syslog data from external device into ELK Stack](https://discuss.elastic.co/t/syslog-data-from-external-device-into-elk-stack/282287)

<div class="topic-metadata">

**Author:** [@pooch](https://discuss.elastic.co/u/pooch)\
**Replies:** 3\
**Last updated:** [August 24, 2021, 10:03pm UTC](https://discuss.elastic.co/t/syslog-data-from-external-device-into-elk-stack/282287 "2021-08-24T22:03:49Z")

</div>

I have ELK collecting logs from all of my pods within my Kubernetes cluster. I would also like to collect logs from an external PA firewall (syslog) and have them processed into Elasticsearch. I am a bit confused on how …

---

## [How to do parallel filter search of 1M queries in minimal time?](https://discuss.elastic.co/t/how-to-do-parallel-filter-search-of-1m-queries-in-minimal-time/282023)

<div class="topic-metadata">

**Author:** [@elastic\_yogi](https://discuss.elastic.co/u/elastic_yogi)\
**Replies:** 5\
**Last updated:** [August 24, 2021, 8:43pm UTC](https://discuss.elastic.co/t/how-to-do-parallel-filter-search-of-1m-queries-in-minimal-time/282023 "2021-08-24T20:43:25Z")

</div>

Hi, I would like to search 1M filter queries in parallel in order to reduce the search time. This means a boolean query with 1M filter values, an no ordering is necessary. My index size is about 1GB, and I've stored ever…

---

## [Issues with certbot certificates and kibana](https://discuss.elastic.co/t/issues-with-certbot-certificates-and-kibana/282270)

<div class="topic-metadata">

**Author:** [@noobthenoob](https://discuss.elastic.co/u/noobthenoob)\
**Replies:** 3\
**Last updated:** [August 24, 2021, 7:09pm UTC](https://discuss.elastic.co/t/issues-with-certbot-certificates-and-kibana/282270 "2021-08-24T19:09:43Z")

</div>

\[MY\_DOMAIN\] = My externally accessable url such as "asdf.dk" \[MY\_LOCAL\_SERVER\_IP\] = My servers local IP address such as 192.168.1.2 Hello everyone, I have some issues with kibana & certbot certificates. Let me elabor…

---

## [Can Elasticsearch aggregate logs in a "live" manner and meet our needs at scale?](https://discuss.elastic.co/t/can-elasticsearch-aggregate-logs-in-a-live-manner-and-meet-our-needs-at-scale/282352)

<div class="topic-metadata">

**Author:** [@nsouth](https://discuss.elastic.co/u/nsouth)\
**Replies:** 4\
**Last updated:** [August 24, 2021, 4:52pm UTC](https://discuss.elastic.co/t/can-elasticsearch-aggregate-logs-in-a-live-manner-and-meet-our-needs-at-scale/282352 "2021-08-24T16:52:50Z")

</div>

My team is new to Elasticsearch and is considering it for log analysis. I need to be able to tell my manager whether the technology can scale to meet our needs. So that's my question: Can Elasticsearch meet our goals at …

---

## [How to make sure that whitelisted plugin for painless is working?](https://discuss.elastic.co/t/how-to-make-sure-that-whitelisted-plugin-for-painless-is-working/282216)

<div class="topic-metadata">

**Author:** [@gowthamkaruturi](https://discuss.elastic.co/u/gowthamkaruturi)\
**Replies:** 2\
**Last updated:** [August 24, 2021, 2:52pm UTC](https://discuss.elastic.co/t/how-to-make-sure-that-whitelisted-plugin-for-painless-is-working/282216 "2021-08-24T14:52:14Z")

</div>

Hi I have created a sample whitelist plugin for painless, so that i can use the whitelisted methods in my painless script. i used the following guide to have custom hexdigest methods compiled in to plugin Aim of the…

---

## [Failed to execute progress listener on query failure](https://discuss.elastic.co/t/failed-to-execute-progress-listener-on-query-failure/281852)

<div class="topic-metadata">

**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\
**Replies:** 15\
**Last updated:** [August 24, 2021, 2:31pm UTC](https://discuss.elastic.co/t/failed-to-execute-progress-listener-on-query-failure/281852 "2021-08-24T14:31:16Z")

</div>

Although my Elasticsearch SEEMS to be working correctly, Im getting this error in the logs Failed to execute progress listener on query failure Basically I go to Discover, pick any index and this gets logged. I try to …

---

## [Elasticsearch response order consistency issues](https://discuss.elastic.co/t/elasticsearch-response-order-consistency-issues/281767)

<div class="topic-metadata">

**Author:** [@govind\_kr](https://discuss.elastic.co/u/govind_kr)\
**Replies:** 15\
**Last updated:** [August 24, 2021, 9:36am UTC](https://discuss.elastic.co/t/elasticsearch-response-order-consistency-issues/281767 "2021-08-24T09:36:55Z")

</div>

I have been facing issues related to es response order which is getting reshuffled even though I am not querying on the fields (I have made them non-indexed so as to ignore them in scoring) and performing dfs\_query\_then\_…

---

## [Too many scroll contexts with \_update\_by\_query and/or \_delete\_by\_query](https://discuss.elastic.co/t/too-many-scroll-contexts-with-update-by-query-and-or-delete-by-query/282325)

<div class="topic-metadata">

**Author:** [@tomkirk](https://discuss.elastic.co/u/tomkirk)\
**Replies:** 0\
**Last updated:** [August 24, 2021, 9:34am UTC](https://discuss.elastic.co/t/too-many-scroll-contexts-with-update-by-query-and-or-delete-by-query/282325 "2021-08-24T09:34:24Z")

</div>

Hello, I've had an issue recently in my Elasticsearch cluster of getting this error: Trying to create too many scroll contexts. Must be less than or equal to: \[500\] None of our \_search queries use that feature, but I …

---

## [Change log4j2.properties logging location?](https://discuss.elastic.co/t/change-log4j2-properties-logging-location/282319)

<div class="topic-metadata">

**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\
**Replies:** 0\
**Last updated:** [August 24, 2021, 8:53am UTC](https://discuss.elastic.co/t/change-log4j2-properties-logging-location/282319 "2021-08-24T08:53:35Z")

</div>

Hello This really doesnt fit anywhere I think I want to configure log4j2.properties for both elastic and Logstash to write logs in a daily format (2021.08.24-log-name) and to another location. I know log4j2 uses varia…

---

## [Can't connect to elastic cloud instance - NEST Client](https://discuss.elastic.co/t/cant-connect-to-elastic-cloud-instance-nest-client/282117)

<div class="topic-metadata">

**Author:** [@knile](https://discuss.elastic.co/u/knile)\
**Replies:** 1\
**Last updated:** [August 24, 2021, 8:53am UTC](https://discuss.elastic.co/t/cant-connect-to-elastic-cloud-instance-nest-client/282117 "2021-08-24T08:53:03Z")

</div>

Hello, I wanted to try out elastic cloud (free trial) today but I'm having issues connecting to it. I set up simple console application in c# net 5 and latest NEST client var cloudId = "cloudid:xxxxxxxx"…

---

## [How to check what compression codec some of document use](https://discuss.elastic.co/t/how-to-check-what-compression-codec-some-of-document-use/282302)

<div class="topic-metadata">

**Author:** [@solarcore](https://discuss.elastic.co/u/solarcore)\
**Replies:** 3\
**Last updated:** [August 24, 2021, 8:59am UTC](https://discuss.elastic.co/t/how-to-check-what-compression-codec-some-of-document-use/282302 "2021-08-24T08:59:49Z")

</div>

If i have some index, and i had default value of the codec in settings, then i change this setting to best\_compression, so my question is: How to check one document in an index, to know what codec this document use, defa…

---

## [Is my delete phase correctly configured in ILM?](https://discuss.elastic.co/t/is-my-delete-phase-correctly-configured-in-ilm/282209)

<div class="topic-metadata">

**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\
**Replies:** 6\
**Last updated:** [August 24, 2021, 8:49am UTC](https://discuss.elastic.co/t/is-my-delete-phase-correctly-configured-in-ilm/282209 "2021-08-24T08:49:48Z")

</div>

Just in case, I wanted to confirm that my delete phase was correctly configured: \[root@server log\]# curl -u user:password -X GET 'http://localhost:9200/\_ilm/policy/ilp-for-logs' {"ilp-for-logs":{"version":2,"modified\_da…

---

## [X-opaque-id not displayed in search slow log](https://discuss.elastic.co/t/x-opaque-id-not-displayed-in-search-slow-log/282067)

<div class="topic-metadata">

**Author:** [@asgs](https://discuss.elastic.co/u/asgs)\
**Replies:** 6\
**Last updated:** [August 24, 2021, 8:19am UTC](https://discuss.elastic.co/t/x-opaque-id-not-displayed-in-search-slow-log/282067 "2021-08-24T08:19:19Z")

</div>

Hello. First of all, I want to mention that I have read the similar posts Cannot see user "id" in slowlogs (X-Opaque-ID) and Elasticsearch X-Opaque-Id Not in application.log Exception but there are no responses there, so…

---

## [Synesis Lite Suricata + ELK](https://discuss.elastic.co/t/synesis-lite-suricata-elk/282300)

<div class="topic-metadata">

**Author:** [@Yves\_Silvere\_Randria](https://discuss.elastic.co/u/Yves_Silvere_Randria)\
**Replies:** 0\
**Last updated:** [August 24, 2021, 6:17am UTC](https://discuss.elastic.co/t/synesis-lite-suricata-elk/282300 "2021-08-24T06:17:48Z")

</div>

I am following this tutorial GitHub - robcowart/synesis\_lite\_suricata: Suricata IDS/IPS log analytics using the Elastic Stack. And I have this problem , please help me

---

## [Combining results from 2 elastic queries](https://discuss.elastic.co/t/combining-results-from-2-elastic-queries/282252)

<div class="topic-metadata">

**Author:** [@blackberrySherbet](https://discuss.elastic.co/u/blackberrySherbet)\
**Replies:** 1\
**Last updated:** [August 24, 2021, 5:22am UTC](https://discuss.elastic.co/t/combining-results-from-2-elastic-queries/282252 "2021-08-24T05:22:05Z")

</div>

In one index I have {city: \_\_\_\_, serial\_no: 999}. In another index, I have {language: \_\_\_\_ serial\_no:999} I need to write an elasticsearch query to print {city, language}. How do I do that? Any help is appreciated, th…

---

## [Synchronize index with sql table](https://discuss.elastic.co/t/synchronize-index-with-sql-table/282239)

<div class="topic-metadata">

**Author:** [@franckfct](https://discuss.elastic.co/u/franckfct)\
**Replies:** 1\
**Last updated:** [August 24, 2021, 5:17am UTC](https://discuss.elastic.co/t/synchronize-index-with-sql-table/282239 "2021-08-24T05:17:02Z")

</div>

Hello, I have a table on a database (SAP HANA), I can request it with sql without any problems. This table can be modified at any time by drop/update or insert. Is there a way to keep the index up to date natively, wit…

---

## [Why the number of closed index affects write performance?](https://discuss.elastic.co/t/why-the-number-of-closed-index-affects-write-performance/282219)

<div class="topic-metadata">

**Author:** [@wulixuan](https://discuss.elastic.co/u/wulixuan)\
**Replies:** 10\
**Last updated:** [August 24, 2021, 4:21am UTC](https://discuss.elastic.co/t/why-the-number-of-closed-index-affects-write-performance/282219 "2021-08-24T04:21:48Z")

</div>

Hello: I am now testing the write performance of ES(v7.13.4), the number of shards written is constant, I added many empty indexes(shard number is 3). Then I find that the write performance is degraded even if the index…

---

## [Does Elastic Search support Mobile Number variation (ex: US Format that has special character)](https://discuss.elastic.co/t/does-elastic-search-support-mobile-number-variation-ex-us-format-that-has-special-character/282245)

<div class="topic-metadata">

**Author:** [@Pathak18](https://discuss.elastic.co/u/Pathak18)\
**Replies:** 2\
**Last updated:** [August 24, 2021, 3:43am UTC](https://discuss.elastic.co/t/does-elastic-search-support-mobile-number-variation-ex-us-format-that-has-special-character/282245 "2021-08-24T03:43:39Z")

</div>

Hi, US mobile phone number data can be saved in multiple formats like (XXX) XXX-XXXX OR +1 (XXX) XXX-XXXX OR XXX-XXX-XXXX OR +1 XXX-XXX-XXXX OR XXXXXXXXXX. How to ensure which DataType(OOB) would be ideal to be used o…

---

## [Potential Elasticsearch bug: Index yellow but one or more primary shards unassigned](https://discuss.elastic.co/t/potential-elasticsearch-bug-index-yellow-but-one-or-more-primary-shards-unassigned/282231)

<div class="topic-metadata">

**Author:** [@elastic-learner](https://discuss.elastic.co/u/elastic-learner)\
**Replies:** 3\
**Last updated:** [August 24, 2021, 3:41am UTC](https://discuss.elastic.co/t/potential-elasticsearch-bug-index-yellow-but-one-or-more-primary-shards-unassigned/282231 "2021-08-24T03:41:48Z")

</div>

I'm testing es snapshot restoration on opendistro 7.1.1. Immediately after snapshot restore api call(POST /\_snapshot/my\_backup/snapshot\_1/\_restore) returns, all the indices are in yellow state. In most of them there are …

---

## [Deprecation warning re. granting alias permissions to a role](https://discuss.elastic.co/t/deprecation-warning-re-granting-alias-permissions-to-a-role/281896)

<div class="topic-metadata">

**Author:** [@ceekay](https://discuss.elastic.co/u/ceekay)\
**Replies:** 3\
**Last updated:** [August 24, 2021, 1:45am UTC](https://discuss.elastic.co/t/deprecation-warning-re-granting-alias-permissions-to-a-role/281896 "2021-08-24T01:45:11Z")

</div>

Hi there. I've noticed a bunch of messages in my deprecation logs that go like this: Role \[some-dept\] contains index privileges covering the \[some-dept-alias\] alias but which do not cover some of the indices that it po…

---

## [How do I create a boolean "OR" filter?](https://discuss.elastic.co/t/how-do-i-create-a-boolean-or-filter/282281)

<div class="topic-metadata">

**Author:** [@elastic\_yogi](https://discuss.elastic.co/u/elastic_yogi)\
**Replies:** 6\
**Last updated:** [August 24, 2021, 1:16am UTC](https://discuss.elastic.co/t/how-do-i-create-a-boolean-or-filter/282281 "2021-08-24T01:16:40Z")

</div>

I'd like to filter for EITHER (OR) of two values, but a filter appears to require (AND) a document to contain EACH value. I'm using a bool query currently, and should appears to be the only way to do an OR expression. Ho…

---

## [Magento 2 Connection Failure](https://discuss.elastic.co/t/magento-2-connection-failure/282250)

<div class="topic-metadata">

**Author:** [@steved1982](https://discuss.elastic.co/u/steved1982)\
**Replies:** 1\
**Last updated:** [August 23, 2021, 10:51pm UTC](https://discuss.elastic.co/t/magento-2-connection-failure/282250 "2021-08-23T22:51:37Z")

</div>

Trying to connect from Magento 2 to the https://\*\*\*\*\*.elastic-cloud.com deployment of ElasticSearch but I get the No nodes alive message. I am running Magento 2.4.2 and I have checked the username and password are correc…

---

## [ESSingleNodeTestCase - Java 11 - Does not start Elastic](https://discuss.elastic.co/t/essinglenodetestcase-java-11-does-not-start-elastic/282279)

<div class="topic-metadata">

**Author:** [@Liyaqat\_M](https://discuss.elastic.co/u/Liyaqat_M)\
**Replies:** 0\
**Last updated:** [August 23, 2021, 10:09pm UTC](https://discuss.elastic.co/t/essinglenodetestcase-java-11-does-not-start-elastic/282279 "2021-08-23T22:09:53Z")

</div>

Hi, I am trying to test the messages that I would post to our Elastic Search server and decided to use: ESSingleNodeTestCase. After sorting out the dependencies I was able to compile and start the test. As far as I un…

---

## [Elasticsearch6 on MAC - Bootstrap failed: 5: Input/output error](https://discuss.elastic.co/t/elasticsearch6-on-mac-bootstrap-failed-5-input-output-error/282263)

<div class="topic-metadata">

**Author:** [@Mike\_Fritzsche](https://discuss.elastic.co/u/Mike_Fritzsche)\
**Replies:** 1\
**Last updated:** [August 23, 2021, 5:20pm UTC](https://discuss.elastic.co/t/elasticsearch6-on-mac-bootstrap-failed-5-input-output-error/282263 "2021-08-23T17:20:00Z")

</div>

Hi all, I can not get run Elasticsearch 6 on my MAC Big Sure. I installed with Brew and all the time when brew services start elasticsearch@6 I get the following error: Bootstrap failed: 5: Input/output error Error:…

---

## [Search\_as\_you\_type not working, help](https://discuss.elastic.co/t/search-as-you-type-not-working-help/282111)

<div class="topic-metadata">

**Author:** [@michel.st-louis](https://discuss.elastic.co/u/michel.st-louis)\
**Replies:** 3\
**Last updated:** [August 23, 2021, 5:06pm UTC](https://discuss.elastic.co/t/search-as-you-type-not-working-help/282111 "2021-08-23T17:06:02Z")

</div>

I was trying the new feature Search\_as\_you\_type but I don't know if if it my lack of knowledge but it is not working. I installed the verion 7.14. this is my kibana queries. this query yeld nothing no hits. DELETE test …

---

## [ERROR: this cluster currently has \[x\]/\[x\] maximum normal shards open](https://discuss.elastic.co/t/error-this-cluster-currently-has-x-x-maximum-normal-shards-open/282254)

<div class="topic-metadata">

**Author:** [@Stef\_Nestor](https://discuss.elastic.co/u/Stef_Nestor)\
**Replies:** 1\
**Last updated:** [August 23, 2021, 4:01pm UTC](https://discuss.elastic.co/t/error-this-cluster-currently-has-x-x-maximum-normal-shards-open/282254 "2021-08-23T16:01:14Z")

</div>

This example error may return from Elasticsearch to any ingestor (e.g. Logstash, Bulk, API, Beats, etc): \[{TIMESTAMP}\]\[WARN\]\[logstash.outputs.elasticsearch\]\[x\]\[y\] Could not index event to Elasticsearch. { :status=\> 400…

---

## [One alert for all unique event.action from all events in last 30mins](https://discuss.elastic.co/t/one-alert-for-all-unique-event-action-from-all-events-in-last-30mins/280313)

<div class="topic-metadata">

**Author:** [@jancodenew](https://discuss.elastic.co/u/jancodenew)\
**Replies:** 1\
**Last updated:** [August 23, 2021, 3:49pm UTC](https://discuss.elastic.co/t/one-alert-for-all-unique-event-action-from-all-events-in-last-30mins/280313 "2021-08-23T15:49:43Z")

</div>

Hi, Version: ELK 7.13 Need to generate a single alert for all events with unique event.action feild values in last 30minute. Can someone please let me know which rule type I can use here? Also please share if you have…

---

## [Single index or multiple index](https://discuss.elastic.co/t/single-index-or-multiple-index/282139)

<div class="topic-metadata">

**Author:** [@selin](https://discuss.elastic.co/u/selin)\
**Replies:** 3\
**Last updated:** [August 23, 2021, 2:09pm UTC](https://discuss.elastic.co/t/single-index-or-multiple-index/282139 "2021-08-23T14:09:41Z")

</div>

My environment architecture is I have 15 server. The details as below Group 1 (Standalone) server 1 (2 app) server 2 3 app) server 3 (2 app) server 4 (3 app) Group 2 (master and slave) server 5 master (2 app) serve…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=586)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=588)
