# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=861 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 862 --- ## [RestHighLevelClient - Unable to parse response body](https://discuss.elastic.co/t/resthighlevelclient-unable-to-parse-response-body/240809)
**Author:** [@drouinc](https://discuss.elastic.co/u/drouinc)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 12:04pm UTC](https://discuss.elastic.co/t/resthighlevelclient-unable-to-parse-response-body/240809 "2020-07-14T12:04:46Z")
I'm new to ES and wiring up my first sample in a Java Spring Boot app. I'm using the pure RestHighLevelClient approach but seem to keep getting a Unable to parse response body message when I call the client. I'm a bi… --- ## [How to divide must query into separate queries](https://discuss.elastic.co/t/how-to-divide-must-query-into-separate-queries/241115)
**Author:** [@buka\_bidzina](https://discuss.elastic.co/u/buka_bidzina)\ **Replies:** 3\ **Last updated:** [July 14, 2020, 11:27am UTC](https://discuss.elastic.co/t/how-to-divide-must-query-into-separate-queries/241115 "2020-07-14T11:27:15Z")
Mapping PUT index PUT /index/\_mapping { "properties": { "categories": { "type": "nested", "properties": { "id": { "type": "integer" } } }, "deleted": { "ty… --- ## [Shingles and terms aggregation not working as expected](https://discuss.elastic.co/t/shingles-and-terms-aggregation-not-working-as-expected/240705)
**Author:** [@zp230](https://discuss.elastic.co/u/zp230)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 10:01am UTC](https://discuss.elastic.co/t/shingles-and-terms-aggregation-not-working-as-expected/240705 "2020-07-14T10:01:42Z")
Hi, I am having issues with getting even a simple terms aggregation on a shingled field. For context, I want to be able to get a list of words/phrases found in the sentence/display\_text field (using shingles), and their… --- ## [Get the top 10 host in composite query with agregation](https://discuss.elastic.co/t/get-the-top-10-host-in-composite-query-with-agregation/241062)
**Author:** [@Incauto](https://discuss.elastic.co/u/Incauto)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 9:44am UTC](https://discuss.elastic.co/t/get-the-top-10-host-in-composite-query-with-agregation/241062 "2020-07-14T09:44:48Z")
Hi, Im trying to emulate the anomaly explorer in a custom vega-lite visualization, for that I need to get the top ten host based on the sum of their anomaly record\_score, I have tried with this query but the record\_score… --- ## [How to remove unwanted records](https://discuss.elastic.co/t/how-to-remove-unwanted-records/241099)
**Author:** [@Shaun\_Mccullagh](https://discuss.elastic.co/u/Shaun_Mccullagh)\ **Replies:** 2\ **Last updated:** [July 14, 2020, 9:19am UTC](https://discuss.elastic.co/t/how-to-remove-unwanted-records/241099 "2020-07-14T09:19:51Z")
Hi, I want to delete all records containing Project:cfa\_uk and env:tst from my ElasticSearch indexes. I created this son data file: { "query": { "query\_string" : { "fields" : \["project", "env"\]… --- ## [How can move Elasticsearch index data to RDBMS](https://discuss.elastic.co/t/how-can-move-elasticsearch-index-data-to-rdbms/241093)
**Author:** [@hyungsun\_lim](https://discuss.elastic.co/u/hyungsun_lim)\ **Replies:** 0\ **Last updated:** [July 14, 2020, 8:19am UTC](https://discuss.elastic.co/t/how-can-move-elasticsearch-index-data-to-rdbms/241093 "2020-07-14T08:19:47Z")
In order to join two indexes, i use spark-elasticsearch. However, this connecter takes so long time to join data. ex) A: 1,000,000 docs join B:500,000 makes 200,000 docs but it takes to long time. (2 hours) So i … --- ## [Setting the whitespace analyzer for query\_string search](https://discuss.elastic.co/t/setting-the-whitespace-analyzer-for-query-string-search/240517)
**Author:** [@Josip\_Cagalj](https://discuss.elastic.co/u/Josip_Cagalj)\ **Replies:** 8\ **Last updated:** [July 14, 2020, 8:06am UTC](https://discuss.elastic.co/t/setting-the-whitespace-analyzer-for-query-string-search/240517 "2020-07-14T08:06:05Z")
Hi all, I have a problem regarding how the query string is tokenized when performing a query\_string search. Could it be possible to opt for the whitespace tokenizer instead of standard because I'm searching for an exact… --- ## [Unable to post nested json data using bulk api in an index refering docs (Elasticsearch 7.8)](https://discuss.elastic.co/t/unable-to-post-nested-json-data-using-bulk-api-in-an-index-refering-docs-elasticsearch-7-8/240446)
**Author:** [@Akash\_Gusain](https://discuss.elastic.co/u/Akash_Gusain)\ **Replies:** 2\ **Last updated:** [July 14, 2020, 7:33am UTC](https://discuss.elastic.co/t/unable-to-post-nested-json-data-using-bulk-api-in-an-index-refering-docs-elasticsearch-7-8/240446 "2020-07-14T07:33:14Z")
I am new to elastic, post data using bulk api but unable to send nested data. can any body help where i am wrong. POST \_bulk {"index":{"\_index" : "network\_data", "\_id" : "1"}} {"predictionDate": "16-07-2019", "categ… --- ## [Memory allocation for inserted data and timeout](https://discuss.elastic.co/t/memory-allocation-for-inserted-data-and-timeout/241063)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 7:20am UTC](https://discuss.elastic.co/t/memory-allocation-for-inserted-data-and-timeout/241063 "2020-07-14T07:20:22Z")
Hi, I would love to know what u think about the 2 next problems: I inserted 119mb of data Into elastic In the output of the command \_cat/allocation I could see that disk.available is 1 gb less than it was before the … --- ## [Filter settings preserve\_original and shingle](https://discuss.elastic.co/t/filter-settings-preserve-original-and-shingle/241069)
**Author:** [@xlisfo](https://discuss.elastic.co/u/xlisfo)\ **Replies:** 0\ **Last updated:** [July 14, 2020, 7:14am UTC](https://discuss.elastic.co/t/filter-settings-preserve-original-and-shingle/241069 "2020-07-14T07:14:15Z")
I have a question on how to use preserve\_original : true and shingle token filters together. Say, I have a query "camelCase apple", the word\_delimiter will split on case change to "camel case" first while keeping the ori… --- ## [Index Lifecycle error and index size is huge](https://discuss.elastic.co/t/index-lifecycle-error-and-index-size-is-huge/241041)
**Author:** [@alankong](https://discuss.elastic.co/u/alankong)\ **Replies:** 4\ **Last updated:** [July 14, 2020, 6:24am UTC](https://discuss.elastic.co/t/index-lifecycle-error-and-index-size-is-huge/241041 "2020-07-14T06:24:22Z")
Index lifecycle management Index lifecycle error illegal\_argument\_exception: index.lifecycle.rollover\_alias \[packetbeat-7.0.0-ilm-00000n\] does not point to index \[packetbeat-7.0.0-ilm\] I have been getting the above err… --- ## [Ingest Pipeline apply Java Function](https://discuss.elastic.co/t/ingest-pipeline-apply-java-function/241030)
**Author:** [@AV25242](https://discuss.elastic.co/u/AV25242)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 5:49am UTC](https://discuss.elastic.co/t/ingest-pipeline-apply-java-function/241030 "2020-07-14T05:49:25Z")
This forum has been really quick in providing solutions, really appreciate it. The question I have is, I am moving data from a NOSQL database to Elastic Search , some fields in the NOSQL database are encrypted and I wou… --- ## [Fscrawler version and minimum index compatibility](https://discuss.elastic.co/t/fscrawler-version-and-minimum-index-compatibility/241031)
**Author:** [@David\_Green](https://discuss.elastic.co/u/David_Green)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 5:46am UTC](https://discuss.elastic.co/t/fscrawler-version-and-minimum-index-compatibility/241031 "2020-07-14T05:46:53Z")
I used fscrawler 2.7 to index my pdf files. I've just noticed this on 'localhost:9200' "minimum index compatibility version" : "6.0.0-betal" (see below) At what 'index compatibility version' will I need to re-index my … --- ## [ELK to monitor Kubernetes Containerized application Logs and IaaS VM Infra /Application Logs](https://discuss.elastic.co/t/elk-to-monitor-kubernetes-containerized-application-logs-and-iaas-vm-infra-application-logs/241055)
**Author:** [@Shalinicts](https://discuss.elastic.co/u/Shalinicts)\ **Replies:** 2\ **Last updated:** [July 14, 2020, 5:35am UTC](https://discuss.elastic.co/t/elk-to-monitor-kubernetes-containerized-application-logs-and-iaas-vm-infra-application-logs/241055 "2020-07-14T05:35:09Z")
Hi Team , We have a requirement to monitor IaaS Infra / Application Logs and Kubernetes application logs in GCP.We also have requirement to integrate with ticketing tool and some of monitoring tools via JDBC/API Consid… --- ## [Remote Cluster Connectivity failure](https://discuss.elastic.co/t/remote-cluster-connectivity-failure/240955)
**Author:** [@viveknagar](https://discuss.elastic.co/u/viveknagar)\ **Replies:** 4\ **Last updated:** [July 14, 2020, 5:08am UTC](https://discuss.elastic.co/t/remote-cluster-connectivity-failure/240955 "2020-07-14T05:08:40Z")
Hello , I am trying to connect to a remote cluster which has connectivity with my server. But I am getting issue while connecting. I am sharing my elasticsearch.yml. Can anyone suggest whether configurations are correct… --- ## [Priority On Data Nodes In Elastic Search](https://discuss.elastic.co/t/priority-on-data-nodes-in-elastic-search/239804)
**Author:** [@Kumar\_Ashish](https://discuss.elastic.co/u/Kumar_Ashish)\ **Replies:** 5\ **Last updated:** [July 14, 2020, 4:52am UTC](https://discuss.elastic.co/t/priority-on-data-nodes-in-elastic-search/239804 "2020-07-14T04:52:23Z")
We have a self-hosted cluster on Kubernetes (EKS) with 1 master node and 2 master-data nodes. To get the performance, we have used NVMe instances. But if both the data node dies, the cluster gets corrupt and we have a lo… --- ## [ES 5.6 - Delete by query](https://discuss.elastic.co/t/es-5-6-delete-by-query/240745)
**Author:** [@natasha\_adewar](https://discuss.elastic.co/u/natasha_adewar)\ **Replies:** 7\ **Last updated:** [July 14, 2020, 4:29am UTC](https://discuss.elastic.co/t/es-5-6-delete-by-query/240745 "2020-07-14T04:29:47Z")
We have an index in ES 2.4 that holds 120 million plus documents with different ttl values on each of them and we do insert upto 700k documents every day into the same index. We are now migrating to ES 5.6 and are plann… --- ## [Requirements planning](https://discuss.elastic.co/t/requirements-planning/240856)
**Author:** [@parthmaniar](https://discuss.elastic.co/u/parthmaniar)\ **Replies:** 7\ **Last updated:** [July 14, 2020, 4:12am UTC](https://discuss.elastic.co/t/requirements-planning/240856 "2020-07-14T04:12:19Z")
I am running Ubuntu server 20.04 LTS in a VM hosted on a NAS (Synology.) Configuration is: Compute: Intel Celeron J3455 (4 cores allocated to the VM.) 1.5 (base) / 2.3 (burst) GHz Memory: 4 GB DDR3. Storage: 7200 RPM d… --- ## [Elasticsearch Active-Directory: Native User Authentication Failure](https://discuss.elastic.co/t/elasticsearch-active-directory-native-user-authentication-failure/241010)
**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\ **Replies:** 2\ **Last updated:** [July 14, 2020, 3:41am UTC](https://discuss.elastic.co/t/elasticsearch-active-directory-native-user-authentication-failure/241010 "2020-07-14T03:41:11Z")
Elasticsearch: 7.8 I'm trying to enable X-Pack Active-Directory Realm authentication along with Native user authentication feature but after the .yml config update/change I'm unable to start the elasticsearch service: … --- ## [Unable to access VM from Host Machine](https://discuss.elastic.co/t/unable-to-access-vm-from-host-machine/240980)
**Author:** [@Mystic\_Wayfarer](https://discuss.elastic.co/u/Mystic_Wayfarer)\ **Replies:** 1\ **Last updated:** [July 14, 2020, 2:21am UTC](https://discuss.elastic.co/t/unable-to-access-vm-from-host-machine/240980 "2020-07-14T02:21:35Z")
Dears, I am new to elastic search so bear with me for basic questions. I installed Elastic Search on Ubuntu20.4, everything works on localhost. When I try to access this from my host machine by giving the IP of VM it g… --- ## [NEST C# aggregations - Count and Max](https://discuss.elastic.co/t/nest-c-aggregations-count-and-max/240171)
**Author:** [@rd8388](https://discuss.elastic.co/u/rd8388)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 11:40pm UTC](https://discuss.elastic.co/t/nest-c-aggregations-count-and-max/240171 "2020-07-13T23:40:18Z")
var sDescriptor = new Nest.SearchDescriptor\(); sDescriptor.Aggregations(a =\>a.Terms("sources", t =\> t.Field(f =\> f.sourceName.Suffix("keyword")))); var searchResponse = \_client.Search\(sDescrip… --- ## [Reindexing Logstash indices to use new index template](https://discuss.elastic.co/t/reindexing-logstash-indices-to-use-new-index-template/238917)
**Author:** [@vanessa](https://discuss.elastic.co/u/vanessa)\ **Replies:** 3\ **Last updated:** [July 13, 2020, 11:26pm UTC](https://discuss.elastic.co/t/reindexing-logstash-indices-to-use-new-index-template/238917 "2020-07-13T23:26:09Z")
Hi. We have some existing logstash logs in our elasticsearch cluster. Their pattern is logstash-imu-logs-\*. We have a template for that pattern, but unfortunately it was missing the mapping for one of our fields. As the … --- ## [Watcher - Alerts to call an External API](https://discuss.elastic.co/t/watcher-alerts-to-call-an-external-api/238160)
**Author:** [@sushmamagesh](https://discuss.elastic.co/u/sushmamagesh)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 11:13pm UTC](https://discuss.elastic.co/t/watcher-alerts-to-call-an-external-api/238160 "2020-07-13T23:13:54Z")
Hi Can you please point to any documentation on how to connect from watcher alerts to an external third party API, basically as http call that returns a set of parameters in JSON format. The alert then needs to be able … --- ## [Average age](https://discuss.elastic.co/t/average-age/240796)
**Author:** [@joaopedro](https://discuss.elastic.co/u/joaopedro)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 9:42pm UTC](https://discuss.elastic.co/t/average-age/240796 "2020-07-13T21:42:26Z")
So, I have a database whith personal information where we calculate the age of the people using the birthdate, the problem is that I want to calculate the average age of the population, but I have a problems: scalability… --- ## [Elasticsearch Active-Directory Authentication Failure](https://discuss.elastic.co/t/elasticsearch-active-directory-authentication-failure/241032)
**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 9:27pm UTC](https://discuss.elastic.co/t/elasticsearch-active-directory-authentication-failure/241032 "2020-07-13T21:27:06Z")
Elasticsearch: 7.8 Below is my xpack conf: xpack: security: authc: realms: active\_directory: corp\_ad: order: 0 domain\_name: \ follow\_referra… --- ## [LDAP Settings Elastic Stack 7.8.0 released](https://discuss.elastic.co/t/ldap-settings-elastic-stack-7-8-0-released/240954)
**Author:** [@S26](https://discuss.elastic.co/u/S26)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 11:03am UTC](https://discuss.elastic.co/t/ldap-settings-elastic-stack-7-8-0-released/240954 "2020-07-13T11:03:47Z")
using below settings ; xpack.security.enabled: true xpack: security: authc: realms: ldap: ldap1: order: 0 url: "ldaps://ldap.example.com:636" user\_dn\_templates: - "cn={0}, ou=users, o=marketing, dc=example, dc… --- ## [Doubt about dm\_crypt](https://discuss.elastic.co/t/doubt-about-dm-crypt/240999)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 8:50pm UTC](https://discuss.elastic.co/t/doubt-about-dm-crypt/240999 "2020-07-13T20:50:52Z")
Hi everybody, I know that we can use dm\_crypt with a basic license even if we will be out of support. I would like just to know: where dm\_crypt will perform the encryption? I mean, directly on the filesystem? who will … --- ## [How to configure sso for platinum account elkastic.co hosted ES deployement](https://discuss.elastic.co/t/how-to-configure-sso-for-platinum-account-elkastic-co-hosted-es-deployement/241020)
**Author:** [@aditya\_nirmala](https://discuss.elastic.co/u/aditya_nirmala)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 5:52pm UTC](https://discuss.elastic.co/t/how-to-configure-sso-for-platinum-account-elkastic-co-hosted-es-deployement/241020 "2020-07-13T17:52:50Z")
Hey Guys, i want configure azure sso to my elastic search 7.0 which is hosted on elastic.co with aws deployement none of document is helpful. Is there any helpful doc that someone can share or put down steps how can i… --- ## [Ingest Pipeline for Transformations](https://discuss.elastic.co/t/ingest-pipeline-for-transformations/240736)
**Author:** [@AV25242](https://discuss.elastic.co/u/AV25242)\ **Replies:** 6\ **Last updated:** [July 13, 2020, 7:11pm UTC](https://discuss.elastic.co/t/ingest-pipeline-for-transformations/240736 "2020-07-13T19:11:27Z")
I am very new to elastic search, I have downloaded Elastic search on MacOs and have also installed Kibana for visualization. I am working with a connector which allows me to provide a pipeline name. However I dont know h… --- ## [Date Format - Elastic index mapping - Please help](https://discuss.elastic.co/t/date-format-elastic-index-mapping-please-help/241008)
**Author:** [@Bhavani\_Prasad](https://discuss.elastic.co/u/Bhavani_Prasad)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 4:01pm UTC](https://discuss.elastic.co/t/date-format-elastic-index-mapping-please-help/241008 "2020-07-13T16:01:27Z")
Hi, In my log, i have date value for a date field as : "dateOfTravel":"2020-07-14 11:49" What should be the date format for the "dateofTravel" DataType when I set the mappings in the index. I have used below "dateOfTra… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=860) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=862)