# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=933 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 934 --- ## [Specifying size in Scroll API](https://discuss.elastic.co/t/specifying-size-in-scroll-api/231109)
**Author:** [@guruprasadkk](https://discuss.elastic.co/u/guruprasadkk)\ **Replies:** 4\ **Last updated:** [May 5, 2020, 10:48am UTC](https://discuss.elastic.co/t/specifying-size-in-scroll-api/231109 "2020-05-05T10:48:20Z")
I want to use scroll for my pagination. I know that in the initial search request I can specify the "size", Is it possible to specify the size in the subsequent scroll requests. My use case is like this In first batch… --- ## [I have got replica for each indice and i am getting Red cluster in stack monitoring Please Help](https://discuss.elastic.co/t/i-have-got-replica-for-each-indice-and-i-am-getting-red-cluster-in-stack-monitoring-please-help/231101)
**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\ **Replies:** 10\ **Last updated:** [May 5, 2020, 10:35am UTC](https://discuss.elastic.co/t/i-have-got-replica-for-each-indice-and-i-am-getting-red-cluster-in-stack-monitoring-please-help/231101 "2020-05-05T10:35:13Z")
Its giving me High Security Alert and "Elasticsearch cluster status is red. Allocate missing primary shards and replica shards." this message --- ## [Unable to search string from multiline exceptions](https://discuss.elastic.co/t/unable-to-search-string-from-multiline-exceptions/231127)
**Author:** [@dhimanv86](https://discuss.elastic.co/u/dhimanv86)\ **Replies:** 0\ **Last updated:** [May 5, 2020, 10:26am UTC](https://discuss.elastic.co/t/unable-to-search-string-from-multiline-exceptions/231127 "2020-05-05T10:26:44Z")
Hello, I have setup logs managemnt system as Filebeat -\> Logstash-\> Elasticsearch -\> Kibana. I am able to send logs and also able to see the logs in kibana but I am not able to see any result if there is exception (jav… --- ## [MultiMatchQuery for Nested Json object search](https://discuss.elastic.co/t/multimatchquery-for-nested-json-object-search/231088)
**Author:** [@Ridma\_Gamage](https://discuss.elastic.co/u/Ridma_Gamage)\ **Replies:** 1\ **Last updated:** [May 5, 2020, 9:50am UTC](https://discuss.elastic.co/t/multimatchquery-for-nested-json-object-search/231088 "2020-05-05T09:50:09Z")
I'm trying to search Address object with nested attribute using MultiMatchQuery. But I'm getting following error. Great if some one can help on it. Document in ES index \`\`\` { "\_index": "admin-order-v1-test4", "\_type… --- ## [Elasticsearch SQL - Error when using CASE WHEN with SUM aggregate](https://discuss.elastic.co/t/elasticsearch-sql-error-when-using-case-when-with-sum-aggregate/231000)
**Author:** [@Pramod\_Kumar1](https://discuss.elastic.co/u/Pramod_Kumar1)\ **Replies:** 3\ **Last updated:** [May 5, 2020, 9:08am UTC](https://discuss.elastic.co/t/elasticsearch-sql-error-when-using-case-when-with-sum-aggregate/231000 "2020-05-05T09:08:44Z")
Hi Team, I am getting an error in elasticsearch sql(in-built elasticsql within x-pack) query when using CASE WHEN with SUM aggregate function. { "type": "sql\_illegal\_argument\_exception", "reason": "Does not know how to… --- ## [How to get ingestion pipeline to work for elasticsearch python script](https://discuss.elastic.co/t/how-to-get-ingestion-pipeline-to-work-for-elasticsearch-python-script/231103)
**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\ **Replies:** 0\ **Last updated:** [May 5, 2020, 8:42am UTC](https://discuss.elastic.co/t/how-to-get-ingestion-pipeline-to-work-for-elasticsearch-python-script/231103 "2020-05-05T08:42:49Z")
Hi all, I am currently trying to ingest a csv file with latitude and longitude data, and while i used the csv importer on Kibana, there was this section for me to edit the geo\_point data when i am trying to code out … --- ## [Specific timeout for forcemerge request](https://discuss.elastic.co/t/specific-timeout-for-forcemerge-request/231089)
**Author:** [@tombee74](https://discuss.elastic.co/u/tombee74)\ **Replies:** 1\ **Last updated:** [May 5, 2020, 8:30am UTC](https://discuss.elastic.co/t/specific-timeout-for-forcemerge-request/231089 "2020-05-05T08:30:59Z")
Hello, I'm using 'sync' force-merge request after bulk-indexing of large data set (230 millions documents). The client timeouts after 10 mins: java.net.SocketTimeoutException: 600,000 milliseconds timeout on connectio… --- ## [After setup password other nodes not authenticating](https://discuss.elastic.co/t/after-setup-password-other-nodes-not-authenticating/231068)
**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\ **Replies:** 1\ **Last updated:** [May 5, 2020, 5:02am UTC](https://discuss.elastic.co/t/after-setup-password-other-nodes-not-authenticating/231068 "2020-05-05T05:02:13Z")
i have elk cluster recently upgraded to 7 from 6.5. for enabling security i did set following and restart all nodes xpack.security.enabled: true xpack.security.transport.ssl.enabled: true generated interactive… --- ## [How to set alerts looking for multiple response codes on multiple applications in a single watcher?](https://discuss.elastic.co/t/how-to-set-alerts-looking-for-multiple-response-codes-on-multiple-applications-in-a-single-watcher/231067)
**Author:** [@RahulN](https://discuss.elastic.co/u/RahulN)\ **Replies:** 0\ **Last updated:** [May 5, 2020, 3:15am UTC](https://discuss.elastic.co/t/how-to-set-alerts-looking-for-multiple-response-codes-on-multiple-applications-in-a-single-watcher/231067 "2020-05-05T03:15:37Z")
Hi, I am trying to set up a watcher, which can trigger an email every hour giving the names of the applications and the number of times they have hit a particular response code - consider 404 response code in that 1 hou… --- ## [Question on classifying data in an index](https://discuss.elastic.co/t/question-on-classifying-data-in-an-index/231063)
**Author:** [@syost](https://discuss.elastic.co/u/syost)\ **Replies:** 3\ **Last updated:** [May 5, 2020, 1:47am UTC](https://discuss.elastic.co/t/question-on-classifying-data-in-an-index/231063 "2020-05-05T01:47:49Z")
I have data getting logged into the "functionbeat-\*" index. This is great but there are multiple classifications of data getting put into this index (e.g. gold data, silver data, bronze data). I essentially have to cont… --- ## [Elasticsearch watch cannot push alarm emails](https://discuss.elastic.co/t/elasticsearch-watch-cannot-push-alarm-emails/231064)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 1\ **Last updated:** [May 5, 2020, 1:36am UTC](https://discuss.elastic.co/t/elasticsearch-watch-cannot-push-alarm-emails/231064 "2020-05-05T01:36:06Z")
\> { \> "trigger": { \> "schedule": { \> "interval": "30m" \> } \> }, \> "input": { \> "search": { \> "request": { \> "search\_type": "query\_then\_fetch", \> "indices": \[ \> "… --- ## [ILM;Repositories and Snapshots Best Practices](https://discuss.elastic.co/t/ilm-repositories-and-snapshots-best-practices/231058)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 0\ **Last updated:** [May 5, 2020, 12:13am UTC](https://discuss.elastic.co/t/ilm-repositories-and-snapshots-best-practices/231058 "2020-05-05T00:13:49Z")
Hey All, Generally asking, I would like to know what are your ways to manage indices? Specifically, what kind of repositories do you create? What kind of snapshots? For example, do you split by index type? By date? By… --- ## [New to Elastic Search - General question searching through a tagged text file](https://discuss.elastic.co/t/new-to-elastic-search-general-question-searching-through-a-tagged-text-file/231052)
**Author:** [@cloudace](https://discuss.elastic.co/u/cloudace)\ **Replies:** 3\ **Last updated:** [May 4, 2020, 11:47pm UTC](https://discuss.elastic.co/t/new-to-elastic-search-general-question-searching-through-a-tagged-text-file/231052 "2020-05-04T23:47:43Z")
I have a general question about Elasticsearch / Kibana and if it is the right tool for the job I am trying to do. Apologies in advance if this is the wrong place for this or if the post is too long. I have a file that c… --- ## [Cannot connect node to cluster](https://discuss.elastic.co/t/cannot-connect-node-to-cluster/230924)
**Author:** [@yummycake](https://discuss.elastic.co/u/yummycake)\ **Replies:** 3\ **Last updated:** [May 4, 2020, 11:00pm UTC](https://discuss.elastic.co/t/cannot-connect-node-to-cluster/230924 "2020-05-04T23:00:00Z")
I have set up 2 nodes. Both are in the same machine (VM). The first node is in my host os (windows server 2016) and the second node is in the docker container. The nodes work well individually, but, failed to be in the … --- ## [Ingest processor to set array of geo\_points](https://discuss.elastic.co/t/ingest-processor-to-set-array-of-geo-points/231047)
**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 9:59pm UTC](https://discuss.elastic.co/t/ingest-processor-to-set-array-of-geo-points/231047 "2020-05-04T21:59:03Z")
I'm trying to create an array of geo\_points from a document that has 2 different sets of geo\_points. I want to combine these two fields into one field that I can visualize on a map. My locations in dest/source\_lookup.Loc… --- ## [High level rest client composite aggregation ordering](https://discuss.elastic.co/t/high-level-rest-client-composite-aggregation-ordering/231049)
**Author:** [@plm](https://discuss.elastic.co/u/plm)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 10:13pm UTC](https://discuss.elastic.co/t/high-level-rest-client-composite-aggregation-ordering/231049 "2020-05-04T22:13:07Z")
Hi, I am trying to write the following composite aggregation query using the High Level Rest Client, but cannot figure out how to specify the bucket sort part on the last\_execution field: curl -u elastic:pwd -v -H "Con… --- ## [Dockerized oss version of ELK stack](https://discuss.elastic.co/t/dockerized-oss-version-of-elk-stack/231041)
**Author:** [@BigAl](https://discuss.elastic.co/u/BigAl)\ **Replies:** 3\ **Last updated:** [May 4, 2020, 10:05pm UTC](https://discuss.elastic.co/t/dockerized-oss-version-of-elk-stack/231041 "2020-05-04T22:05:35Z")
Hi, Where could I find a dockerized oss versions of the ELK stack? Seems like it used to be available on docker.elastic.co but it isn't anymore? Is there a reason? From what I understand, one can't distribute a modif… --- ## [How to use Derivative Aggs result to calculate percentage change?](https://discuss.elastic.co/t/how-to-use-derivative-aggs-result-to-calculate-percentage-change/230989)
**Author:** [@vdalvi](https://discuss.elastic.co/u/vdalvi)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 3:13pm UTC](https://discuss.elastic.co/t/how-to-use-derivative-aggs-result-to-calculate-percentage-change/230989 "2020-05-04T15:13:44Z")
Hi All, I have the below query. How can I use the result/value of derivative aggs to calculate percentage change in each time interval? Basically I would love to divide the value of derivative aggs in each interval with… --- ## [Elastic data nodes not sharing load equally](https://discuss.elastic.co/t/elastic-data-nodes-not-sharing-load-equally/230979)
**Author:** [@Ilayda\_Akinalan](https://discuss.elastic.co/u/Ilayda_Akinalan)\ **Replies:** 1\ **Last updated:** [May 4, 2020, 9:37pm UTC](https://discuss.elastic.co/t/elastic-data-nodes-not-sharing-load-equally/230979 "2020-05-04T21:37:29Z")
hi, I have 3 master and 4 data nodes as part of my elk setup. We have a load balancer infront of the data nodes as well and it seems that the load is still not being divided evenly. One of the data nodes would have 80%… --- ## [Elasticsearch 7.6.2 won't run on windows 10](https://discuss.elastic.co/t/elasticsearch-7-6-2-wont-run-on-windows-10/231038)
**Author:** [@Robert\_Logan](https://discuss.elastic.co/u/Robert_Logan)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 9:04pm UTC](https://discuss.elastic.co/t/elasticsearch-7-6-2-wont-run-on-windows-10/231038 "2020-05-04T21:04:16Z")
Please help! On Windows 10 I have 7.5.2 running OK, but a new installation of 7.6.2 fails with the abbreviated stack trace below windows 10 elasticsearch 7.5.2 RUNNING on windows 10 on the same machine windows 10 ela… --- ## [Beats Data not enriching when using Logstash + Elastic output plugin](https://discuss.elastic.co/t/beats-data-not-enriching-when-using-logstash-elastic-output-plugin/229283)
**Author:** [@mgevans](https://discuss.elastic.co/u/mgevans)\ **Replies:** 2\ **Last updated:** [May 4, 2020, 8:22pm UTC](https://discuss.elastic.co/t/beats-data-not-enriching-when-using-logstash-elastic-output-plugin/229283 "2020-05-04T20:22:36Z")
Hi Folks, This is a fairly basic question so i'm sure i'm missing something straightforward. We are using out of the box everything in a brand new POC environment. I have created an enrichment policy and associated pi… --- ## [Java REST client: gzip/compress request](https://discuss.elastic.co/t/java-rest-client-gzip-compress-request/231031)
**Author:** [@karussell](https://discuss.elastic.co/u/karussell)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 8:17pm UTC](https://discuss.elastic.co/t/java-rest-client-gzip-compress-request/231031 "2020-05-04T20:17:11Z")
There is not much documentation about how to compress a request - only this unanswered topic: https://discuss.elastic.co/t/java-rest-client-gzip-compressed-request/98350 On the issue tracker there are several recent iss… --- ## [Elasticsearch mapping date format](https://discuss.elastic.co/t/elasticsearch-mapping-date-format/231026)
**Author:** [@uk300](https://discuss.elastic.co/u/uk300)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 7:50pm UTC](https://discuss.elastic.co/t/elasticsearch-mapping-date-format/231026 "2020-05-04T19:50:47Z")
Hi, I have a date field and I use painless language to update the date field. Since ES7, I have to pass string rather than LocalDateTime because RestHighLevelClient doesn't take the format specified in the mapping into … --- ## [How to use aggregation with query?](https://discuss.elastic.co/t/how-to-use-aggregation-with-query/230691)
**Author:** [@maryam\_abdullah](https://discuss.elastic.co/u/maryam_abdullah)\ **Replies:** 3\ **Last updated:** [May 4, 2020, 7:26pm UTC](https://discuss.elastic.co/t/how-to-use-aggregation-with-query/230691 "2020-05-04T19:26:15Z")
Hello, I hope someone can help me. How do I use aggregation (date range) with query? I want to be able to add date range to my query with the option of missing value and a condition (greater than). Thank you in advan… --- ## [Is having laodbalancer better than sniffing cluster through client](https://discuss.elastic.co/t/is-having-laodbalancer-better-than-sniffing-cluster-through-client/231013)
**Author:** [@hac](https://discuss.elastic.co/u/hac)\ **Replies:** 1\ **Last updated:** [May 4, 2020, 7:22pm UTC](https://discuss.elastic.co/t/is-having-laodbalancer-better-than-sniffing-cluster-through-client/231013 "2020-05-04T19:22:47Z")
Is having loadbalancer better than sniffing cluster through client? What is the recommended way to connect to es cluster from applications? Elasticsearch2.2 --- ## [Reindexing not copying all data](https://discuss.elastic.co/t/reindexing-not-copying-all-data/230837)
**Author:** [@alajangi](https://discuss.elastic.co/u/alajangi)\ **Replies:** 3\ **Last updated:** [May 4, 2020, 5:52pm UTC](https://discuss.elastic.co/t/reindexing-not-copying-all-data/230837 "2020-05-04T17:52:39Z")
Hi, my elasticsearch version is 6.5.1 I want to clone an index, I am doing it in kibana devtools console, POST \_reindex { "source": { "index": "source" }, "dest": { "index": "dest" } } I am unable… --- ## [Backup of time-based indices & cluster upgrade](https://discuss.elastic.co/t/backup-of-time-based-indices-cluster-upgrade/231015)
**Author:** [@Paul-Matthieu](https://discuss.elastic.co/u/Paul-Matthieu)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 5:49pm UTC](https://discuss.elastic.co/t/backup-of-time-based-indices-cluster-upgrade/231015 "2020-05-04T17:49:06Z")
Hi What would be the correct way to handle backups of a cluster that is used for time-based indexing, as you update the cluster to new versions of Elasticsearch ? Basically, what we do now is we backup older indices on… --- ## [Invalid date format for ingest timestamp](https://discuss.elastic.co/t/invalid-date-format-for-ingest-timestamp/228272)
**Author:** [@Adam\_Szaraniec](https://discuss.elastic.co/u/Adam_Szaraniec)\ **Replies:** 2\ **Last updated:** [May 4, 2020, 4:02pm UTC](https://discuss.elastic.co/t/invalid-date-format-for-ingest-timestamp/228272 "2020-05-04T16:02:10Z")
I need some help with pipeline (set ingest.timestamp) { "set": { "field": "meta.timestamp", "value": "{{\_ingest.timestamp}}" } } I've defined this pipeline, and mapping for this field is type: date format:… --- ## [Too many open files Elasticsearch & App Search](https://discuss.elastic.co/t/too-many-open-files-elasticsearch-app-search/230879)
**Author:** [@Srini12](https://discuss.elastic.co/u/Srini12)\ **Replies:** 1\ **Last updated:** [May 4, 2020, 4:01pm UTC](https://discuss.elastic.co/t/too-many-open-files-elasticsearch-app-search/230879 "2020-05-04T16:01:22Z")
Dear All, I have elastic search index on linux vm. I am getting below error, please advise how to resolve. The index was working fine some reason the server went offline and while client app pushing data to the elasti… --- ## [Elasticsearch index\_prefixes usage](https://discuss.elastic.co/t/elasticsearch-index-prefixes-usage/230999)
**Author:** [@CSharpBender](https://discuss.elastic.co/u/CSharpBender)\ **Replies:** 0\ **Last updated:** [May 4, 2020, 3:57pm UTC](https://discuss.elastic.co/t/elasticsearch-index-prefixes-usage/230999 "2020-05-04T15:57:34Z")
Hi, I've read that index\_prefixes can improve prefix queries but it's not clear how I should use it. Is there a way to see the generated .\_index\_prefix field values, it doesn't appear when using the \_mapping api? I'm u… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=932) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=934)