# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=519 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 520 --- ## [Why is search\_after preferred over Scroll API?](https://discuss.elastic.co/t/why-is-search-after-preferred-over-scroll-api/292989)
**Author:** [@dandago](https://discuss.elastic.co/u/dandago)\ **Replies:** 1\ **Last updated:** [December 28, 2021, 11:13am UTC](https://discuss.elastic.co/t/why-is-search-after-preferred-over-scroll-api/292989 "2021-12-28T11:13:26Z")
I've read that "We no longer recommend using the scroll API for deep pagination. If you need to preserve the index state while paging through more than 10,000 hits, use the search\_after parameter with a point in time (… --- ## [While compile my application using gradle, it gives error 'package org.elasticsearch.common.io.stream does not exist'](https://discuss.elastic.co/t/while-compile-my-application-using-gradle-it-gives-error-package-org-elasticsearch-common-io-stream-does-not-exist/293020)
**Author:** [@Arqam](https://discuss.elastic.co/u/Arqam)\ **Replies:** 0\ **Last updated:** [December 28, 2021, 7:19am UTC](https://discuss.elastic.co/t/while-compile-my-application-using-gradle-it-gives-error-package-org-elasticsearch-common-io-stream-does-not-exist/293020 "2021-12-28T07:19:36Z")
Hi all, I'm new to java/gradle/Elasticsearch/application(crate-db). I am trying to create a development setup of CRATE-DB application. But when I am compiling the application by ./gradlew compilejava command it is return… --- ## [Failing shard with illegal\_argument\_exception](https://discuss.elastic.co/t/failing-shard-with-illegal-argument-exception/292977)
**Author:** [@obol89](https://discuss.elastic.co/u/obol89)\ **Replies:** 1\ **Last updated:** [December 27, 2021, 2:53pm UTC](https://discuss.elastic.co/t/failing-shard-with-illegal-argument-exception/292977 "2021-12-27T14:53:59Z")
Hi Everyone, When I'm trying to filter some data in Kibana I'm getting this message "1 of 716 shards failed" with this explanation: illegal\_argument\_exception at shard 0 index metricbeat-7.15.0-2021.12.27 node bfnMWOK… --- ## [Scripted fields on large number of data](https://discuss.elastic.co/t/scripted-fields-on-large-number-of-data/292983)
**Author:** [@bazingaa](https://discuss.elastic.co/u/bazingaa)\ **Replies:** 0\ **Last updated:** [December 27, 2021, 2:31pm UTC](https://discuss.elastic.co/t/scripted-fields-on-large-number-of-data/292983 "2021-12-27T14:31:34Z")
I have a ES index with millions of records. Currently records are fetched using scroll api and are paginated. Also all fields are sortable. I have request for new additional fields (dependent on already existing fields)… --- ## [Question about Upgrading a cluster](https://discuss.elastic.co/t/question-about-upgrading-a-cluster/292964)
**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\ **Replies:** 2\ **Last updated:** [December 27, 2021, 2:06pm UTC](https://discuss.elastic.co/t/question-about-upgrading-a-cluster/292964 "2021-12-27T14:06:05Z")
Hi dears I have a question about upgrading process. I have already upgraded a dev environment cluster but the concern is about (maybe) some system index of production cluster. I want to know what will happen to my sav… --- ## [Missing url](https://discuss.elastic.co/t/missing-url/292125)
**Author:** [@Nidhal\_Harrathi](https://discuss.elastic.co/u/Nidhal_Harrathi)\ **Replies:** 2\ **Last updated:** [December 27, 2021, 1:46pm UTC](https://discuss.elastic.co/t/missing-url/292125 "2021-12-27T13:46:13Z")
I have a particular http request logged in my access.log. The request is found using the http.referrer, but the corresponding url object is missing. I have the following configuration: Elasticsearch 7.16.1 Filebeat 7… --- ## [Trying to deploy elk as a docker service with certificate](https://discuss.elastic.co/t/trying-to-deploy-elk-as-a-docker-service-with-certificate/292961)
**Author:** [@Spyros\_Agriopoulos](https://discuss.elastic.co/u/Spyros_Agriopoulos)\ **Replies:** 0\ **Last updated:** [December 27, 2021, 8:49am UTC](https://discuss.elastic.co/t/trying-to-deploy-elk-as-a-docker-service-with-certificate/292961 "2021-12-27T08:49:27Z")
Hello all. Here is the problem: I have deployed an elk stack using docker compose, which worked fine up until recently. Now after a while one or more of the containers go down for some reason, and I am guessing it may b… --- ## [Query multiple indices with different fields to sort](https://discuss.elastic.co/t/query-multiple-indices-with-different-fields-to-sort/292969)
**Author:** [@jlp1](https://discuss.elastic.co/u/jlp1)\ **Replies:** 0\ **Last updated:** [December 27, 2021, 12:07pm UTC](https://discuss.elastic.co/t/query-multiple-indices-with-different-fields-to-sort/292969 "2021-12-27T12:07:26Z")
Hello I am using Elasticsearch 7.10.0 and trying to solve following problem: I have several indices and need to get documents from all of them matching different queries (5-15 queries against each index). However, depen… --- ## [Url kibana still charging](https://discuss.elastic.co/t/url-kibana-still-charging/292966)
**Author:** [@Aouatif\_Bouka](https://discuss.elastic.co/u/Aouatif_Bouka)\ **Replies:** 0\ **Last updated:** [December 27, 2021, 10:54am UTC](https://discuss.elastic.co/t/url-kibana-still-charging/292966 "2021-12-27T10:54:39Z")
hi, i have setup Elasticsearch, kibana and logstash version 7.16.2 and the UrL kibana works fine the firts day. second day, when i need to access to my kibana URL it still serach without any result. in the console of … --- ## [UiPath older robot logs/indices not appearing after upgrade](https://discuss.elastic.co/t/uipath-older-robot-logs-indices-not-appearing-after-upgrade/292968)
**Author:** [@Aakash\_Sinha](https://discuss.elastic.co/u/Aakash_Sinha)\ **Replies:** 0\ **Last updated:** [December 27, 2021, 11:46am UTC](https://discuss.elastic.co/t/uipath-older-robot-logs-indices-not-appearing-after-upgrade/292968 "2021-12-27T11:46:48Z")
Due to the unavoidable vulnerability on log4j, we upgraded our Elasticsearch to 7.16.x. After the upgrade, the old uipath robot logs were not visible. Only the current executions of the robot logs were visible. Can someo… --- ## [Elasticsearch using eland for python fails to write when having nan in the dataset](https://discuss.elastic.co/t/elasticsearch-using-eland-for-python-fails-to-write-when-having-nan-in-the-dataset/292958)
**Author:** [@Jaykant\_Prajapati](https://discuss.elastic.co/u/Jaykant_Prajapati)\ **Replies:** 0\ **Last updated:** [December 27, 2021, 8:33am UTC](https://discuss.elastic.co/t/elasticsearch-using-eland-for-python-fails-to-write-when-having-nan-in-the-dataset/292958 "2021-12-27T08:33:41Z")
0 I am creating pandas dataset with such that 'num\_specimen\_seen' is having one value null. I am defining nan using the math.nan. The dataset df is saved in haze.csv file. df = pd.DataFrame({'num\_legs': \[2, 4, 8, 0\], … --- ## [Failed to establish a new connection: \[Errno 111\] Connection refused')))](https://discuss.elastic.co/t/failed-to-establish-a-new-connection-errno-111-connection-refused/292919)
**Author:** [@DoDuyen162000](https://discuss.elastic.co/u/DoDuyen162000)\ **Replies:** 2\ **Last updated:** [December 27, 2021, 7:27am UTC](https://discuss.elastic.co/t/failed-to-establish-a-new-connection-errno-111-connection-refused/292919 "2021-12-27T07:27:15Z")
Hi. I am having problems creating elastalert in Elasticsearch. When I use the elastalert-create-index command it gives me the error: help me please!!! --- ## [Curly ’ or straight ' quote inside text affect the search result](https://discuss.elastic.co/t/curly-or-straight-quote-inside-text-affect-the-search-result/292926)
**Author:** [@eliezra236](https://discuss.elastic.co/u/eliezra236)\ **Replies:** 1\ **Last updated:** [December 26, 2021, 3:40pm UTC](https://discuss.elastic.co/t/curly-or-straight-quote-inside-text-affect-the-search-result/292926 "2021-12-26T15:40:57Z")
Hi, I have records that use either ’ or ' or \` And they can't find eachother. For example if I have: name: A Bastard's Tale And I will try to search for "A Bastard’s Tale" it wouldn't find it. How can I make it s… --- ## [How to find text contains special chars in a in a field?](https://discuss.elastic.co/t/how-to-find-text-contains-special-chars-in-a-in-a-field/292932)
**Author:** [@ShayWeizman](https://discuss.elastic.co/u/ShayWeizman)\ **Replies:** 5\ **Last updated:** [December 26, 2021, 2:06pm UTC](https://discuss.elastic.co/t/how-to-find-text-contains-special-chars-in-a-in-a-field/292932 "2021-12-26T14:06:28Z")
Hi All, I'm using 7.16.1 I have a log field that contains a lot of text, I want to find this log by looking part of his long text... For example, this is the field content: strong texttestcaseFailedReason" : """Test … --- ## [What is the maximum text size that can be indexed as a single term?](https://discuss.elastic.co/t/what-is-the-maximum-text-size-that-can-be-indexed-as-a-single-term/292697)
**Author:** [@ShayWeizman](https://discuss.elastic.co/u/ShayWeizman)\ **Replies:** 9\ **Last updated:** [December 26, 2021, 11:32am UTC](https://discuss.elastic.co/t/what-is-the-maximum-text-size-that-can-be-indexed-as-a-single-term/292697 "2021-12-26T11:32:54Z")
Hi, I'm using 7.16.1, When I save to elastic field with large amount of text it is not indexed as a single term. What is the maximum text size for indexing field as a single term? Thanks, Shay --- ## [Elasticsearch sub agregation](https://discuss.elastic.co/t/elasticsearch-sub-agregation/292920)
**Author:** [@Time\_cool](https://discuss.elastic.co/u/Time_cool)\ **Replies:** 0\ **Last updated:** [December 25, 2021, 6:18pm UTC](https://discuss.elastic.co/t/elasticsearch-sub-agregation/292920 "2021-12-25T18:18:12Z")
With the following query, I get the minimum value in each chunk of 15 minutes. I use the moving\_fn function. Now I need to get the maximum value in each chunk in 1 hour from the previous request. As I understand it canno… --- ## [Elasticsearch indexing with bulkprocessor, got broken pipeline](https://discuss.elastic.co/t/elasticsearch-indexing-with-bulkprocessor-got-broken-pipeline/292918)
**Author:** [@Derrick](https://discuss.elastic.co/u/Derrick)\ **Replies:** 0\ **Last updated:** [December 25, 2021, 5:41pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-with-bulkprocessor-got-broken-pipeline/292918 "2021-12-25T17:41:46Z")
anyone can tell me why I am getting this error when I index 140K data to Elasticsearch, our document is very huge, maybe 10M/doc, and each document has a few hundres fields. INFO \[12:32:59.351\] \[\]\[User:none\] \[pool-14… --- ## [Increment date](https://discuss.elastic.co/t/increment-date/292911)
**Author:** [@Time\_cool](https://discuss.elastic.co/u/Time_cool)\ **Replies:** 5\ **Last updated:** [December 25, 2021, 5:36pm UTC](https://discuss.elastic.co/t/increment-date/292911 "2021-12-25T17:36:26Z")
How can you make it so that you can move in the time period. For example, there is a segment 00:00 - 00:15 and find a minimum in this segment. The next step is to take the segment 00:01 - 00:16, find the minimum in it, a… --- ## [Elastic authentication error](https://discuss.elastic.co/t/elastic-authentication-error/292830)
**Author:** [@Atul\_Chadha](https://discuss.elastic.co/u/Atul_Chadha)\ **Replies:** 6\ **Last updated:** [December 25, 2021, 3:16pm UTC](https://discuss.elastic.co/t/elastic-authentication-error/292830 "2021-12-25T15:16:31Z")
We are trying to remove Readonly Rest from authentication equation and setup x-pack on ( ES 7.15 ) \[2021-12-23T11:08:27,433\]\[INFO \]\[o.e.x.s.a.AuthenticationService\] \[XXXX\] Authentication of \[elastic\] was terminated by r… --- ## [Backup and restore a elasticsearch cluster](https://discuss.elastic.co/t/backup-and-restore-a-elasticsearch-cluster/292740)
**Author:** [@David\_Copperfield](https://discuss.elastic.co/u/David_Copperfield)\ **Replies:** 2\ **Last updated:** [December 25, 2021, 6:21am UTC](https://discuss.elastic.co/t/backup-and-restore-a-elasticsearch-cluster/292740 "2021-12-25T06:21:27Z")
I have a local Elasticsearch cluster consisting of 3 master nodes and 3 data nodes, all the 6 servers are VMs inside Google Cloud. I create a snapshot repository to google GCS bucket, and save snapshots there. The instr… --- ## [Mapping null values](https://discuss.elastic.co/t/mapping-null-values/292900)
**Author:** [@Emile\_Plas](https://discuss.elastic.co/u/Emile_Plas)\ **Replies:** 1\ **Last updated:** [December 24, 2021, 4:02pm UTC](https://discuss.elastic.co/t/mapping-null-values/292900 "2021-12-24T16:02:17Z")
Hey everyone! I am quite new to Elasticsearch so feel free to criticize my work method. I am currently working on a project in which multiple pdf documents (a series of court decisions) need to be searched. The PDF docu… --- ## [Elastic Search 1.7.1 Log4j2 Vulnerability Fix](https://discuss.elastic.co/t/elastic-search-1-7-1-log4j2-vulnerability-fix/292899)
**Author:** [@denizzengin](https://discuss.elastic.co/u/denizzengin)\ **Replies:** 0\ **Last updated:** [December 24, 2021, 1:29pm UTC](https://discuss.elastic.co/t/elastic-search-1-7-1-log4j2-vulnerability-fix/292899 "2021-12-24T13:29:07Z")
Hi, How to fix security problem for 1.7.1 version without upgrade our Elasticsearch version ? --- ## [Parse json data](https://discuss.elastic.co/t/parse-json-data/292893)
**Author:** [@royalE](https://discuss.elastic.co/u/royalE)\ **Replies:** 0\ **Last updated:** [December 24, 2021, 12:57pm UTC](https://discuss.elastic.co/t/parse-json-data/292893 "2021-12-24T12:57:21Z")
Parsing nested json in Logstash below is a sample of my file , I am not able to read the json files in logstash since it has nested json field inside the message.I need to know what is the best way to read file in logst… --- ## [How to sort on second same (field) value](https://discuss.elastic.co/t/how-to-sort-on-second-same-field-value/292888)
**Author:** [@Wilco\_R](https://discuss.elastic.co/u/Wilco_R)\ **Replies:** 0\ **Last updated:** [December 24, 2021, 11:57am UTC](https://discuss.elastic.co/t/how-to-sort-on-second-same-field-value/292888 "2021-12-24T11:57:50Z")
Hi people, I ran into an sorting problem, which is very hard for me to find out how to do it. What i want to achieve is to query the data to sort it in a way that the second(or higher) of the same configuration\_id is a… --- ## [How to use painless BigDecimal in java code?](https://discuss.elastic.co/t/how-to-use-painless-bigdecimal-in-java-code/292780)
**Author:** [@xiaozhiliaoo](https://discuss.elastic.co/u/xiaozhiliaoo)\ **Replies:** 1\ **Last updated:** [December 24, 2021, 6:20am UTC](https://discuss.elastic.co/t/how-to-use-painless-bigdecimal-in-java-code/292780 "2021-12-24T06:20:58Z")
I use painless to update doc. how to use BigDecimal to finish it ? Using Elasticsearch 6.8.1. Script JavaDoc Script construtor is: public Script (ScriptType type, java.lang.String lang, ja… --- ## [Some vulnerabilities in Elasticsearch v7.10.0 x-pack, Elasticsearch sql cli 7.10.0, plugin cli, security cli](https://discuss.elastic.co/t/some-vulnerabilities-in-elasticsearch-v7-10-0-x-pack-elasticsearch-sql-cli-7-10-0-plugin-cli-security-cli/292745)
**Author:** [@Sagarika\_Mahalik](https://discuss.elastic.co/u/Sagarika_Mahalik)\ **Replies:** 1\ **Last updated:** [December 24, 2021, 5:30am UTC](https://discuss.elastic.co/t/some-vulnerabilities-in-elasticsearch-v7-10-0-x-pack-elasticsearch-sql-cli-7-10-0-plugin-cli-security-cli/292745 "2021-12-24T05:30:22Z")
Hi, There are some Vulnerabilities in Elasticsearch 7.10.0 version. Some vulnerabilities in Elasticsearch v7.10.0 x-pack, Elasticsearch sql cli 7.10.0, plugin cli, security cli. While installing Elasticsearch all of t… --- ## [7.16.2 triggering Google Cloud security alert](https://discuss.elastic.co/t/7-16-2-triggering-google-cloud-security-alert/292618)
**Author:** [@gehgerds](https://discuss.elastic.co/u/gehgerds)\ **Replies:** 7\ **Last updated:** [December 23, 2021, 11:16pm UTC](https://discuss.elastic.co/t/7-16-2-triggering-google-cloud-security-alert/292618 "2021-12-23T23:16:53Z")
After bumping the docker image version to elasticsearch:7.16.2 in GKE, whenever I start elasticsearch pod, it immediately triggers a security alert Added Library Loaded Added\_Library\_Fullpath: /tmp/twIW2T (deleted) de… --- ## [Backup to s3 repo from elasticsearch 6.8.22](https://discuss.elastic.co/t/backup-to-s3-repo-from-elasticsearch-6-8-22/292836)
**Author:** [@zorruch](https://discuss.elastic.co/u/zorruch)\ **Replies:** 2\ **Last updated:** [December 23, 2021, 9:33pm UTC](https://discuss.elastic.co/t/backup-to-s3-repo-from-elasticsearch-6-8-22/292836 "2021-12-23T21:33:05Z")
hi I am using elasticsearch 6.8.22 with plugin repository-s3 I also use ceph s3 storage running on rook(k8s) I'm trying to set up a snapshot backup for it: I create a repository command: curl -sk -X PUT "https://lo… --- ## [Index alias](https://discuss.elastic.co/t/index-alias/292829)
**Author:** [@iamtheschmitzer](https://discuss.elastic.co/u/iamtheschmitzer)\ **Replies:** 1\ **Last updated:** [December 23, 2021, 4:13pm UTC](https://discuss.elastic.co/t/index-alias/292829 "2021-12-23T16:13:03Z")
If I have a rollover index foo-000001, which rolls over to foo-N and alias index foo for them, is foo equivalent to the "latest" of those rollovers or the "union" of them? Thanks --- ## [Multiple Conditions in Elastic Watcher](https://discuss.elastic.co/t/multiple-conditions-in-elastic-watcher/292716)
**Author:** [@ishyherts](https://discuss.elastic.co/u/ishyherts)\ **Replies:** 3\ **Last updated:** [December 23, 2021, 4:11pm UTC](https://discuss.elastic.co/t/multiple-conditions-in-elastic-watcher/292716 "2021-12-23T16:11:42Z")
Hi, I am using a watcher to alert via email if "tracking.softQuota.percentageUsed" \> 50(%) - this record (hit) also comes with a field meta.application which identifies a certain client or customer. This watcher runs m… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=518) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=520)