# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=709 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 710 --- ## [Limit in fetching documents through rest API](https://discuss.elastic.co/t/limit-in-fetching-documents-through-rest-api/263551)
**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\ **Replies:** 3\ **Last updated:** [February 8, 2021, 10:32am UTC](https://discuss.elastic.co/t/limit-in-fetching-documents-through-rest-api/263551 "2021-02-08T10:32:10Z")
Hi All, I'm trying to fetch documents from elasticsearch using rest api but it looks like i can pull down only limited set of documents, below is the query i'm using and i'm getting very limited documents eventhough my … --- ## [Logstash doesn't auto reconnect to another node ES cluster](https://discuss.elastic.co/t/logstash-doesnt-auto-reconnect-to-another-node-es-cluster/263568)
**Author:** [@lenjeti](https://discuss.elastic.co/u/lenjeti)\ **Replies:** 0\ **Last updated:** [February 8, 2021, 9:41am UTC](https://discuss.elastic.co/t/logstash-doesnt-auto-reconnect-to-another-node-es-cluster/263568 "2021-02-08T09:41:19Z")
We have a 3 node elasticsearch cluster set up. The logstash ouput config looks like this: output { elasticsearch { hosts =\> \["node1:9200", "node2:9200", "node3:9200" … --- ## [Elasticsearch join query](https://discuss.elastic.co/t/elasticsearch-join-query/263567)
**Author:** [@diya5](https://discuss.elastic.co/u/diya5)\ **Replies:** 0\ **Last updated:** [February 8, 2021, 9:36am UTC](https://discuss.elastic.co/t/elasticsearch-join-query/263567 "2021-02-08T09:36:11Z")
I have two indices. One indices "indications" which have some set of values. Other is "projects". In this indices i will add indications value like " indication = oncology". Now i want to show all indications. Which i… --- ## [Search for fields with dot in name](https://discuss.elastic.co/t/search-for-fields-with-dot-in-name/260692)
**Author:** [@sudpaw](https://discuss.elastic.co/u/sudpaw)\ **Replies:** 6\ **Last updated:** [February 8, 2021, 9:35am UTC](https://discuss.elastic.co/t/search-for-fields-with-dot-in-name/260692 "2021-02-08T09:35:19Z")
Hi, We are migrating from Es6.8 to latest ES7. We are using Re-index. While testing we came across a doc with a malformed fieldname. (the mapping does not allow for the field, but it is there). Example: { "id": "1… --- ## [Elastic Cloud Integration with FusionAuth](https://discuss.elastic.co/t/elastic-cloud-integration-with-fusionauth/263323)
**Author:** [@vexana](https://discuss.elastic.co/u/vexana)\ **Replies:** 7\ **Last updated:** [February 8, 2021, 8:51am UTC](https://discuss.elastic.co/t/elastic-cloud-integration-with-fusionauth/263323 "2021-02-08T08:51:26Z")
Hi Everyone, I am trying to using FusionAuth (https://fusionauth.io/) as IdP (OpenID or SAML) to my elastic stack running on Elastic Cloud. Here is my elasticsearch.yaml configuration: xpack: security: authc: … --- ## [Match\_phrase is not working with keep\_words\_filter in percolator index](https://discuss.elastic.co/t/match-phrase-is-not-working-with-keep-words-filter-in-percolator-index/263557)
**Author:** [@Dahea\_Moon](https://discuss.elastic.co/u/Dahea_Moon)\ **Replies:** 0\ **Last updated:** [February 8, 2021, 8:27am UTC](https://discuss.elastic.co/t/match-phrase-is-not-working-with-keep-words-filter-in-percolator-index/263557 "2021-02-08T08:27:55Z")
Hi, elastic team. I'm working on percolator index with match\_phrase query and keep\_words\_filter. I found that match\_phrase query is not working properly with keep\_words\_filter. I've tried both match\_phrase query and s… --- ## [Whether to allow the profile to be opened on every query request](https://discuss.elastic.co/t/whether-to-allow-the-profile-to-be-opened-on-every-query-request/263540)
**Author:** [@asasas234](https://discuss.elastic.co/u/asasas234)\ **Replies:** 12\ **Last updated:** [February 8, 2021, 7:05am UTC](https://discuss.elastic.co/t/whether-to-allow-the-profile-to-be-opened-on-every-query-request/263540 "2021-02-08T07:05:29Z")
I want to turn on profile for each elasticsearch query request in my system, so that I can get the profile results to print the logs, combined with traceId, I can get what the reason for each slow request is, but I am wo… --- ## [How can use 'org.elasticsearch.spark.sql' with kerberos to read es data](https://discuss.elastic.co/t/how-can-use-org-elasticsearch-spark-sql-with-kerberos-to-read-es-data/263548)
**Author:** [@wenyangchou](https://discuss.elastic.co/u/wenyangchou)\ **Replies:** 0\ **Last updated:** [February 8, 2021, 6:39am UTC](https://discuss.elastic.co/t/how-can-use-org-elasticsearch-spark-sql-with-kerberos-to-read-es-data/263548 "2021-02-08T06:39:22Z")
I have tried use es-hadoop to read a elasticsearch which had configured kerberos. I have a reference to this https://www.elastic.co/guide/en/elasticsearch/hadoop/7.x/kerberos.html but not success. Is there any example I … --- ## [How to add nested datatype using Java api?](https://discuss.elastic.co/t/how-to-add-nested-datatype-using-java-api/263542)
**Author:** [@rohit.singh3](https://discuss.elastic.co/u/rohit.singh3)\ **Replies:** 0\ **Last updated:** [February 8, 2021, 5:20am UTC](https://discuss.elastic.co/t/how-to-add-nested-datatype-using-java-api/263542 "2021-02-08T05:20:44Z")
Below is the sample snippet: "price":{ "type":"nested", --\> how to add this nested type? "properties":{ "activity\_price":{ "type":"double" }, … --- ## [Shrink shards not respecting node settings 7.10.0](https://discuss.elastic.co/t/shrink-shards-not-respecting-node-settings-7-10-0/262883)
**Author:** [@nz-1](https://discuss.elastic.co/u/nz-1)\ **Replies:** 1\ **Last updated:** [February 8, 2021, 4:49am UTC](https://discuss.elastic.co/t/shrink-shards-not-respecting-node-settings-7-10-0/262883 "2021-02-08T04:49:44Z")
I have a 5 node cluster with 4 nodes as the data\_warm, data\_hot and 1 node as the cold storage. When ES goes to shrink the node I see on some of the indexes it chooses the cold storage node (dx6MirFmT2y9AdXEF02pDw) whic… --- ## [Transforming into JSON-Documents](https://discuss.elastic.co/t/transforming-into-json-documents/262884)
**Author:** [@Werner](https://discuss.elastic.co/u/Werner)\ **Replies:** 9\ **Last updated:** [February 8, 2021, 4:48am UTC](https://discuss.elastic.co/t/transforming-into-json-documents/262884 "2021-02-08T04:48:33Z")
Hello ! I am an absolute beginner in elasticsearch and after some hours of reading an watching tutorial-videos I got the impression, that it needs a lot of knowledge and preparation, before I can make a fast search. In… --- ## [Questions on getting started with ELK](https://discuss.elastic.co/t/questions-on-getting-started-with-elk/263194)
**Author:** [@Anita2](https://discuss.elastic.co/u/Anita2)\ **Replies:** 3\ **Last updated:** [February 8, 2021, 4:46am UTC](https://discuss.elastic.co/t/questions-on-getting-started-with-elk/263194 "2021-02-08T04:46:28Z")
For reference, I have followed this guide to get me started: Hello, I'm extremely new to ELK, as in I have just now installed everything, as I will be needing it for a research project. My current goal is to be able t… --- ## [What does this error mean, and would it cause a data node to crash](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173)
**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\ **Replies:** 7\ **Last updated:** [February 8, 2021, 4:45am UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173 "2021-02-08T04:45:21Z")
I have a cluster on ES 5.x and suddenly some of the data nodes simply crash randomly. I see this error and want to know what it is and is this something I'm overlooking to fix it??? Any insight would be GREATLY appreci… --- ## [How to pass a variable to elasticsearch query javascript](https://discuss.elastic.co/t/how-to-pass-a-variable-to-elasticsearch-query-javascript/263536)
**Author:** [@adonnini](https://discuss.elastic.co/u/adonnini)\ **Replies:** 0\ **Last updated:** [February 8, 2021, 3:07am UTC](https://discuss.elastic.co/t/how-to-pass-a-variable-to-elasticsearch-query-javascript/263536 "2021-02-08T03:07:13Z")
Hi, I am a nebie to ElasticSearch. I have searched for an answer to this question before making this post. I am trying to run an ElasticSearch query from a JavaScript app using a variable for the search string. I have … --- ## [If else condition with logstash filter](https://discuss.elastic.co/t/if-else-condition-with-logstash-filter/263517)
**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\ **Replies:** 3\ **Last updated:** [February 7, 2021, 3:24pm UTC](https://discuss.elastic.co/t/if-else-condition-with-logstash-filter/263517 "2021-02-07T15:24:13Z")
Hi Folks, I am trying to achive certain conditions with logstash and wondering \\if - if-else statement or validation is possible in Logstash filter? I have below messages in json and parsing DMARC logs with logstash. I… --- ## [Get subset of values that exist for a given search](https://discuss.elastic.co/t/get-subset-of-values-that-exist-for-a-given-search/263523)
**Author:** [@cozzbp](https://discuss.elastic.co/u/cozzbp)\ **Replies:** 0\ **Last updated:** [February 7, 2021, 2:25pm UTC](https://discuss.elastic.co/t/get-subset-of-values-that-exist-for-a-given-search/263523 "2021-02-07T14:25:20Z")
Is it possible to query for which values of a given set are represented/not represented in the data set? If I have documents that look like: { "category": "fiction", "tags": \["horror", "thriller"\] }… --- ## [Elasticsearch master node start failed. There is insufficient memory for the Java Runtime Environment to continue](https://discuss.elastic.co/t/elasticsearch-master-node-start-failed-there-is-insufficient-memory-for-the-java-runtime-environment-to-continue/263520)
**Author:** [@Jinlian\_Chen](https://discuss.elastic.co/u/Jinlian_Chen)\ **Replies:** 0\ **Last updated:** [February 7, 2021, 9:16am UTC](https://discuss.elastic.co/t/elasticsearch-master-node-start-failed-there-is-insufficient-memory-for-the-java-runtime-environment-to-continue/263520 "2021-02-07T09:16:51Z")
I have setup a elasticsearch cluster with 3 master node and 2 data node on k8s. While start master node , it failed. System config: ulimit -n 65535 ulimit -l unlimited sysctl -w vm.max\_map\_count=262144 sysctl -w vm.ove… --- ## [Coordinating node](https://discuss.elastic.co/t/coordinating-node/263510)
**Author:** [@leemase004](https://discuss.elastic.co/u/leemase004)\ **Replies:** 2\ **Last updated:** [February 7, 2021, 12:39am UTC](https://discuss.elastic.co/t/coordinating-node/263510 "2021-02-07T00:39:31Z")
I know data nodes can act as coordinating nodes if one is not set; but, if I set up a designated coordinating-only node does that mean the data nodes will completely stop performing the coordinating function? Or will the… --- ## [Elasticsearch Nodes Crash After Attempt to Create Scripted Filed](https://discuss.elastic.co/t/elasticsearch-nodes-crash-after-attempt-to-create-scripted-filed/263179)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 3\ **Last updated:** [February 6, 2021, 11:33pm UTC](https://discuss.elastic.co/t/elasticsearch-nodes-crash-after-attempt-to-create-scripted-filed/263179 "2021-02-06T23:33:05Z")
Hello Community, I am trying to create a scripted field. I want to parse a string into a date format. I have created the following script DateTimeFormatter formatter = DateTimeFormatter.ofPattern("yyyy-MM-dd HH:mm:ss… --- ## [Question in elastic search to get specific records with specific date and time range](https://discuss.elastic.co/t/question-in-elastic-search-to-get-specific-records-with-specific-date-and-time-range/261217)
**Author:** [@Kin\_Wan](https://discuss.elastic.co/u/Kin_Wan)\ **Replies:** 8\ **Last updated:** [February 6, 2021, 11:32pm UTC](https://discuss.elastic.co/t/question-in-elastic-search-to-get-specific-records-with-specific-date-and-time-range/261217 "2021-02-06T23:32:28Z")
Hello all, I would like to perform a query to get last weeks records on our log which the record are within Mon-Fri from (19:00-07:00) and Sat from (15:00-00:00) and full day on Sunday. How should I write the query? Than… --- ## [Securing Elasticsearch cluster](https://discuss.elastic.co/t/securing-elasticsearch-cluster/263509)
**Author:** [@ehsan\_kabiri\_33](https://discuss.elastic.co/u/ehsan_kabiri_33)\ **Replies:** 2\ **Last updated:** [February 6, 2021, 11:24pm UTC](https://discuss.elastic.co/t/securing-elasticsearch-cluster/263509 "2021-02-06T23:24:13Z")
I have a 3 nodes cluster in my local VM ware workstation. I followed the instructions on below to make my Elasticsearch 7.10 secure: configuring-security getting-started-with-elasticsearch-security I could complete th… --- ## [Question on what Elasticsearch considers data vs logs](https://discuss.elastic.co/t/question-on-what-elasticsearch-considers-data-vs-logs/263506)
**Author:** [@halfbakedprod](https://discuss.elastic.co/u/halfbakedprod)\ **Replies:** 1\ **Last updated:** [February 6, 2021, 6:10pm UTC](https://discuss.elastic.co/t/question-on-what-elasticsearch-considers-data-vs-logs/263506 "2021-02-06T18:10:12Z")
Hello all, I just setup Graylog + Elasticsearch for my first time. I'm trying to change the default location that ingested logs are saved. Currently, the default filepath is the OS drive, which will fill up in no time. … --- ## [Cluster with mix of cloud and self hosted](https://discuss.elastic.co/t/cluster-with-mix-of-cloud-and-self-hosted/263489)
**Author:** [@efftee](https://discuss.elastic.co/u/efftee)\ **Replies:** 2\ **Last updated:** [February 6, 2021, 5:35pm UTC](https://discuss.elastic.co/t/cluster-with-mix-of-cloud-and-self-hosted/263489 "2021-02-06T17:35:53Z")
Hi Are there any difficulties or limitations to have a cluster of instances mixing cloud-hosted Elasticsearch with self-hosted instances ? I have a main cloud instance, hosted by Elasticsearch. And I am wondering if it… --- ## [My elsticsearch cannot start](https://discuss.elastic.co/t/my-elsticsearch-cannot-start/263494)
**Author:** [@baber1223](https://discuss.elastic.co/u/baber1223)\ **Replies:** 3\ **Last updated:** [February 6, 2021, 2:39pm UTC](https://discuss.elastic.co/t/my-elsticsearch-cannot-start/263494 "2021-02-06T14:39:20Z")
I have installed elasticsearch-1.7.2-1.noarch now due start service show follow error : \[root@testopenbank ~\]# Exception in thread "main" java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.Vers… --- ## [Beginner questions on Supervised ML](https://discuss.elastic.co/t/beginner-questions-on-supervised-ml/262744)
**Author:** [@kvtang](https://discuss.elastic.co/u/kvtang)\ **Replies:** 4\ **Last updated:** [February 6, 2021, 11:37am UTC](https://discuss.elastic.co/t/beginner-questions-on-supervised-ml/262744 "2021-02-06T11:37:31Z")
Hi all, Sorry if this question has been asked somewhere previously but I couldn't find any relevant information. For supervised ML, during training phase, do we have to provide label for each event that is already in E… --- ## [From Coveo to Elasticsearch](https://discuss.elastic.co/t/from-coveo-to-elasticsearch/263457)
**Author:** [@manideep](https://discuss.elastic.co/u/manideep)\ **Replies:** 3\ **Last updated:** [February 6, 2021, 5:03am UTC](https://discuss.elastic.co/t/from-coveo-to-elasticsearch/263457 "2021-02-06T05:03:04Z")
Dear Community, I have a web application built for enterprise search using Coveo. It has lot of sources (CSVs, Excel, Sharepoint, S3, APIs, etc.) indexed using default Coveo Connectors and few custom Connector written … --- ## [Best way to resolve this out of memory error in my ES Data Nodes](https://discuss.elastic.co/t/best-way-to-resolve-this-out-of-memory-error-in-my-es-data-nodes/263478)
**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\ **Replies:** 2\ **Last updated:** [February 6, 2021, 4:04am UTC](https://discuss.elastic.co/t/best-way-to-resolve-this-out-of-memory-error-in-my-es-data-nodes/263478 "2021-02-06T04:04:57Z")
I have a cluster and now my data nodes are crashing. Looking over the logs i see this error. Its an out of memory error. Is there something i should set in the Elastic yml file to help lock memory? Add more data nodes… --- ## [Difference on dotted notation vs dictionary](https://discuss.elastic.co/t/difference-on-dotted-notation-vs-dictionary/263450)
**Author:** [@oskrdt](https://discuss.elastic.co/u/oskrdt)\ **Replies:** 2\ **Last updated:** [February 6, 2021, 3:00am UTC](https://discuss.elastic.co/t/difference-on-dotted-notation-vs-dictionary/263450 "2021-02-06T03:00:38Z")
I'm using a python script to populate data to elasticsearch using pandas to transform the data before the population. I was creating columns on pandas using dotted notation expecting that the elasticsearch index process… --- ## [Cluster Health yellow because of unassigned shards](https://discuss.elastic.co/t/cluster-health-yellow-because-of-unassigned-shards/263459)
**Author:** [@maheshe](https://discuss.elastic.co/u/maheshe)\ **Replies:** 2\ **Last updated:** [February 5, 2021, 10:48pm UTC](https://discuss.elastic.co/t/cluster-health-yellow-because-of-unassigned-shards/263459 "2021-02-05T22:48:13Z")
The Cluster Health is yellow because of unassigned shards I have 1 master and 1 data node deployed through helm2 elastic repo. This is the getShards output, How can I turn cluster health to green by just having 1 master… --- ## [Swapping values within a field](https://discuss.elastic.co/t/swapping-values-within-a-field/263473)
**Author:** [@CoffeeDog](https://discuss.elastic.co/u/CoffeeDog)\ **Replies:** 0\ **Last updated:** [February 5, 2021, 10:46pm UTC](https://discuss.elastic.co/t/swapping-values-within-a-field/263473 "2021-02-05T22:46:24Z")
I already have some data that is the following format: example\_field : test\_1,test\_2 I'd like to flip it to say example\_field: test\_2,test\_1 is painless the way to do this? Or should I leverage something else within … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=708) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=710)