# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=755 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 756 --- ## [Elastic APIs versioning and usage without breaking the integrated services](https://discuss.elastic.co/t/elastic-apis-versioning-and-usage-without-breaking-the-integrated-services/256483)
**Author:** [@es\_user2](https://discuss.elastic.co/u/es_user2)\ **Replies:** 7\ **Last updated:** [November 26, 2020, 4:30pm UTC](https://discuss.elastic.co/t/elastic-apis-versioning-and-usage-without-breaking-the-integrated-services/256483 "2020-11-26T16:30:15Z")
hi Team, we have few queries on Elasticserach APIs: Suppose we have used an API in our code and there is a version upgrade. How to handle the version change ? Will it not break our code integration with this API ? (If … --- ## [ElasticSearch aggregation for recommendation engine](https://discuss.elastic.co/t/elasticsearch-aggregation-for-recommendation-engine/256789)
**Author:** [@martsuga](https://discuss.elastic.co/u/martsuga)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 3:52pm UTC](https://discuss.elastic.co/t/elasticsearch-aggregation-for-recommendation-engine/256789 "2020-11-26T15:52:36Z")
I need some advice for aggregations. I am trying to build a recommendation engine based on existing ElasticSearch data but i am out of ideas how to build this query with aggregations. The easiest way would be to use "s… --- ## [Facing data too large exception frequently](https://discuss.elastic.co/t/facing-data-too-large-exception-frequently/255943)
**Author:** [@Divy\_Garg](https://discuss.elastic.co/u/Divy_Garg)\ **Replies:** 4\ **Last updated:** [November 26, 2020, 1:51pm UTC](https://discuss.elastic.co/t/facing-data-too-large-exception-frequently/255943 "2020-11-26T13:51:00Z")
CircuitBreakingException\[\[parent\] Data too large, data for \[internal:index/shard/recovery/start\_recovery\] would be \[7805417954/7.2gb\], which is larger than the limit of \[6941363404/6.4gb\], real usage: \[7805416568/7.2gb\],… --- ## [Elasticsearch 7.10 does not start on MacOS](https://discuss.elastic.co/t/elasticsearch-7-10-does-not-start-on-macos/256740)
**Author:** [@snicoll](https://discuss.elastic.co/u/snicoll)\ **Replies:** 7\ **Last updated:** [November 26, 2020, 1:17pm UTC](https://discuss.elastic.co/t/elasticsearch-7-10-does-not-start-on-macos/256740 "2020-11-26T13:17:49Z")
I am very confused. I've downloaded the latest ELK stack to make a test on my machine. I am on MacOS 10.15.7 and Java 11 Here's what I did: Unzip the tar somewhere in my home directory cd to the elasticsearch invoke b… --- ## [Index deleted, want to restore from backup](https://discuss.elastic.co/t/index-deleted-want-to-restore-from-backup/256770)
**Author:** [@Arbind\_Bhagat](https://discuss.elastic.co/u/Arbind_Bhagat)\ **Replies:** 0\ **Last updated:** [November 26, 2020, 12:34pm UTC](https://discuss.elastic.co/t/index-deleted-want-to-restore-from-backup/256770 "2020-11-26T12:34:50Z")
All of my index have been deleted. So, I don't see them in Kibana. Of course, all the corresponding data has also been deleted. However, I do have the backup of the disk that contains all the files and folders. In this… --- ## [ILM and max size with logstash ELK 7.10.0](https://discuss.elastic.co/t/ilm-and-max-size-with-logstash-elk-7-10-0/256764)
**Author:** [@fredbcode](https://discuss.elastic.co/u/fredbcode)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 12:15pm UTC](https://discuss.elastic.co/t/ilm-and-max-size-with-logstash-elk-7-10-0/256764 "2020-11-26T12:15:18Z")
Hello I am using ELK stack 7.10.0 and I have an issue with ilm and max\_size { "indices" : { "logstash\_netflow-2020.11.26" : { "index" : "logstash\_netflow-2020.11.26", "managed" : t… --- ## [Cluster is not available and http request failed, but request by transport client worked well](https://discuss.elastic.co/t/cluster-is-not-available-and-http-request-failed-but-request-by-transport-client-worked-well/256722)
**Author:** [@fanwang](https://discuss.elastic.co/u/fanwang)\ **Replies:** 4\ **Last updated:** [November 26, 2020, 10:51am UTC](https://discuss.elastic.co/t/cluster-is-not-available-and-http-request-failed-but-request-by-transport-client-worked-well/256722 "2020-11-26T10:51:56Z")
Elasticsearch version V5.6.12 JVM version JDK 1.8 OS version CentOS7.6 Description of the problem including expected versus actual behavior : In a cluster with 3 master nodes, minuimum\_master\_nodes is 2. Kill 2 o… --- ## [Attachments on ELK](https://discuss.elastic.co/t/attachments-on-elk/256717)
**Author:** [@AChopra](https://discuss.elastic.co/u/AChopra)\ **Replies:** 4\ **Last updated:** [November 26, 2020, 10:07am UTC](https://discuss.elastic.co/t/attachments-on-elk/256717 "2020-11-26T10:07:35Z")
Hello, I have some attachments which need to be ingested into elastic. There are of varying types i.e PDF, TXT, CSV, XLS, DOC, MSG (Outlook emails). As far as I could find out , I got to know that I can use Ingest Att… --- ## [Reindexing does not resolve conflict](https://discuss.elastic.co/t/reindexing-does-not-resolve-conflict/256745)
**Author:** [@eliwap](https://discuss.elastic.co/u/eliwap)\ **Replies:** 0\ **Last updated:** [November 26, 2020, 9:33am UTC](https://discuss.elastic.co/t/reindexing-does-not-resolve-conflict/256745 "2020-11-26T09:33:01Z")
Recently we upgraded our stack to elasticsearch-7.9.2 from 6.8. I had to reindex to resolve several mapping conflicts. However reindexing did not resolve all of them. How do I fix the following conflicts filebeat - rea… --- ## [Default index template is it reale?](https://discuss.elastic.co/t/default-index-template-is-it-reale/256658)
**Author:** [@zakabluk](https://discuss.elastic.co/u/zakabluk)\ **Replies:** 0\ **Last updated:** [November 25, 2020, 12:35pm UTC](https://discuss.elastic.co/t/default-index-template-is-it-reale/256658 "2020-11-25T12:35:46Z")
I want create some index template which will use all new indexes which will create logstash and that doesn't have exactly template for his. Example: I have templates: pattern: log1-\* + ilm1 + priority 200 pattern: lo… --- ## [Unable to find any unassigned shards to explain](https://discuss.elastic.co/t/unable-to-find-any-unassigned-shards-to-explain/256733)
**Author:** [@devdatta\_mulgund](https://discuss.elastic.co/u/devdatta_mulgund)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 8:01am UTC](https://discuss.elastic.co/t/unable-to-find-any-unassigned-shards-to-explain/256733 "2020-11-26T08:01:34Z")
I am facing this error in Elasticsearch. Can someone help with this? Below is the output for Elasticsearch APIs: curl localhost:9200/\_cluster/health output: {"cluster\_name":"docker-cluster","status":"green","timed\_ou… --- ## [How can I set x-opaque-id when I use es-sql？](https://discuss.elastic.co/t/how-can-i-set-x-opaque-id-when-i-use-es-sql/256065)
**Author:** [@ITzhangqiang](https://discuss.elastic.co/u/ITzhangqiang)\ **Replies:** 4\ **Last updated:** [November 26, 2020, 7:38am UTC](https://discuss.elastic.co/t/how-can-i-set-x-opaque-id-when-i-use-es-sql/256065 "2020-11-26T07:38:19Z")
Hi,all How can I set x-opaque-id when I use es-sql？ --- ## [Pipeline with id does not exist](https://discuss.elastic.co/t/pipeline-with-id-does-not-exist/256689)
**Author:** [@Integration](https://discuss.elastic.co/u/Integration)\ **Replies:** 2\ **Last updated:** [November 26, 2020, 7:32am UTC](https://discuss.elastic.co/t/pipeline-with-id-does-not-exist/256689 "2020-11-26T07:32:37Z")
Hello, I'm trying to configure my filebeat.yml file with a pipeline that I created, and it's not working. I created the pipeline using Ingest Node Pipelines on the ElasticSearch UI. I get this error: 'pipeline with i… --- ## [Too Many Scroll Context ERROR but found no active scroll context](https://discuss.elastic.co/t/too-many-scroll-context-error-but-found-no-active-scroll-context/256598)
**Author:** [@zchar](https://discuss.elastic.co/u/zchar)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 3:34am UTC](https://discuss.elastic.co/t/too-many-scroll-context-error-but-found-no-active-scroll-context/256598 "2020-11-26T03:34:33Z")
Hi team, Recently, I upgraded my ES cluster from 7.4.2 to 7.6.2. Then I found "Too Many Scroll Context ..." error always occurred and scroll search is not available on my cluster. I followed the exception tips and turn… --- ## [When i add extended.plugins=lang-mustache in plugin-descriptor.properties im getting below error](https://discuss.elastic.co/t/when-i-add-extended-plugins-lang-mustache-in-plugin-descriptor-properties-im-getting-below-error/256439)
**Author:** [@rakeshdkaatkar](https://discuss.elastic.co/u/rakeshdkaatkar)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 1:16am UTC](https://discuss.elastic.co/t/when-i-add-extended-plugins-lang-mustache-in-plugin-descriptor-properties-im-getting-below-error/256439 "2020-11-26T01:16:38Z")
java.lang.IllegalStateException: Plugin \[search-engine-plugin\] cannot extend non-extensible plugin \[lang-mustache\] at org.elasticsearch.plugins.PluginsService.loadBundle(PluginsService.java:624) at org.elasticsearch.pl… --- ## [Date Mapping Parse Failure](https://discuss.elastic.co/t/date-mapping-parse-failure/256469)
**Author:** [@nara1](https://discuss.elastic.co/u/nara1)\ **Replies:** 2\ **Last updated:** [November 25, 2020, 11:29pm UTC](https://discuss.elastic.co/t/date-mapping-parse-failure/256469 "2020-11-25T23:29:50Z")
Hello there, I am trying to send a date in the format 2020-10-29T05:36:06.143Z\[UTC\]. My mapping looks like this: "timeStamp": { "type": "date" } And I am getting the following error: Elasticsearch excep… --- ## [Data\_detection setting in the ECS index template](https://discuss.elastic.co/t/data-detection-setting-in-the-ecs-index-template/256715)
**Author:** [@Chris\_Stone](https://discuss.elastic.co/u/Chris_Stone)\ **Replies:** 1\ **Last updated:** [November 25, 2020, 11:07pm UTC](https://discuss.elastic.co/t/data-detection-setting-in-the-ecs-index-template/256715 "2020-11-25T23:07:08Z")
Hi, I posted first in the Logstash category, and it looks like this might be more Elasticsearch related... I am collecting http access logs and wanting to place some date headers into date type fields. I've tried a coup… --- ## [Problem with deployment docker-compose](https://discuss.elastic.co/t/problem-with-deployment-docker-compose/256678)
**Author:** [@javig12](https://discuss.elastic.co/u/javig12)\ **Replies:** 1\ **Last updated:** [November 25, 2020, 8:18pm UTC](https://discuss.elastic.co/t/problem-with-deployment-docker-compose/256678 "2020-11-25T20:18:41Z")
Hello Community, I got this error: kib01 | 2020-11-25T15:23:45.708146631Z {"type":"log","@timestamp":"2020-11-25T15:23:45Z","tags":\["warning","elasticsearch","monitoring"\],"pid":6,"message":"Unable to revive connect… --- ## [Missing data in log - Source field is always Null](https://discuss.elastic.co/t/missing-data-in-log-source-field-is-always-null/256705)
**Author:** [@hilne1](https://discuss.elastic.co/u/hilne1)\ **Replies:** 0\ **Last updated:** [November 25, 2020, 7:12pm UTC](https://discuss.elastic.co/t/missing-data-in-log-source-field-is-always-null/256705 "2020-11-25T19:12:57Z")
Hi, I'm using ELK stack in docker swarm with 6 filebeat, 1 logstash, 1 elasticsearch and 1 kibana. All is in version 7.6.1. I have a problem when receiving data (cf the photo below) All logs are sending with empty … --- ## [AWS Elasticsearch 7.7 : Query index for one field to match a subset of chars in another text field in a document? Can it be done?](https://discuss.elastic.co/t/aws-elasticsearch-7-7-query-index-for-one-field-to-match-a-subset-of-chars-in-another-text-field-in-a-document-can-it-be-done/256509)
**Author:** [@yoyomonkey](https://discuss.elastic.co/u/yoyomonkey)\ **Replies:** 5\ **Last updated:** [November 25, 2020, 5:30pm UTC](https://discuss.elastic.co/t/aws-elasticsearch-7-7-query-index-for-one-field-to-match-a-subset-of-chars-in-another-text-field-in-a-document-can-it-be-done/256509 "2020-11-25T17:30:09Z")
Hi everyone, I hope someone can guide me with some guides or links on this please . I have an index with two fields of interest : adapterid and country and I am trying to write a query without going thorugh every permu… --- ## [ELI5: Elasticsearch, Kibana and Logstash (and Beats)](https://discuss.elastic.co/t/eli5-elasticsearch-kibana-and-logstash-and-beats/256694)
**Author:** [@riahc3](https://discuss.elastic.co/u/riahc3)\ **Replies:** 0\ **Last updated:** [November 25, 2020, 5:15pm UTC](https://discuss.elastic.co/t/eli5-elasticsearch-kibana-and-logstash-and-beats/256694 "2020-11-25T17:15:38Z")
Im having some issues understanding the components. Elasticsearch: Used for indexing and searching thru logs. Pretty straight forward. Kibana: Used as a GUI. Pretty straight forward. Logstash: Is this a syslog? Does t… --- ## [NEST: customize creation of HttpClient](https://discuss.elastic.co/t/nest-customize-creation-of-httpclient/256687)
**Author:** [@jonsagara](https://discuss.elastic.co/u/jonsagara)\ **Replies:** 0\ **Last updated:** [November 25, 2020, 4:29pm UTC](https://discuss.elastic.co/t/nest-customize-creation-of-httpclient/256687 "2020-11-25T16:29:57Z")
Hello, There is a known issue with targeting net5.0 on Azure App Service and trying to connect to Elasticsearch on a virtual machine connected to via an Azure VNet. The main ticket is here: The issue is essentially t… --- ## [Elasticsearch job to end messages with beginning messages, merge, then reindex](https://discuss.elastic.co/t/elasticsearch-job-to-end-messages-with-beginning-messages-merge-then-reindex/256541)
**Author:** [@aerodynamic](https://discuss.elastic.co/u/aerodynamic)\ **Replies:** 3\ **Last updated:** [November 25, 2020, 3:44pm UTC](https://discuss.elastic.co/t/elasticsearch-job-to-end-messages-with-beginning-messages-merge-then-reindex/256541 "2020-11-25T15:44:21Z")
The system I'm running is currently matching beginning messages with end messages then sending them to logstash for further processing. This is done through a web of python code. I was wondering if this could be accompl… --- ## [Intervals wildcard 128 expansion limit](https://discuss.elastic.co/t/intervals-wildcard-128-expansion-limit/256390)
**Author:** [@prasad.deshpande](https://discuss.elastic.co/u/prasad.deshpande)\ **Replies:** 1\ **Last updated:** [November 25, 2020, 2:57pm UTC](https://discuss.elastic.co/t/intervals-wildcard-128-expansion-limit/256390 "2020-11-25T14:57:23Z")
Hi, I'm trying out intervals wildcard queries. But in the process, depending on the term I'm hitting the 128 expansion limit. I know that this is a hard limit imposed by Lucene. But my question is if I have to get past … --- ## [Transform: Sum doesn't add up](https://discuss.elastic.co/t/transform-sum-doesnt-add-up/256622)
**Author:** [@kaijun](https://discuss.elastic.co/u/kaijun)\ **Replies:** 15\ **Last updated:** [November 25, 2020, 2:09pm UTC](https://discuss.elastic.co/t/transform-sum-doesnt-add-up/256622 "2020-11-25T14:09:20Z")
I have an existing index datalog.gl\_sep20 and I want to transform to a new index based on some fields and do a sum aggregation based on "count" field. This is how I do it: curl -X PUT "localhost:9200/\_transform/transfor… --- ## [Client requested protocol tlsv1 is not enabled or supported in server context](https://discuss.elastic.co/t/client-requested-protocol-tlsv1-is-not-enabled-or-supported-in-server-context/256610)
**Author:** [@adnanahmed](https://discuss.elastic.co/u/adnanahmed)\ **Replies:** 4\ **Last updated:** [November 25, 2020, 1:54pm UTC](https://discuss.elastic.co/t/client-requested-protocol-tlsv1-is-not-enabled-or-supported-in-server-context/256610 "2020-11-25T13:54:42Z")
Hi, we are using ELK stack version 7.9.0 , when we try to connect logstash with elastic it give us error . 'client requested protocol tlsv1 is not enabled or supported in server context' when we specify following … --- ## [Suggester not returning and hits](https://discuss.elastic.co/t/suggester-not-returning-and-hits/255231)
**Author:** [@Bart\_de\_Man](https://discuss.elastic.co/u/Bart_de_Man)\ **Replies:** 1\ **Last updated:** [November 25, 2020, 1:49pm UTC](https://discuss.elastic.co/t/suggester-not-returning-and-hits/255231 "2020-11-25T13:49:28Z")
Elasticsearch version ( bin/elasticsearch --version ): 5.6.11 Plugins installed : JVM version ( java -version ): openjdk version "1.8.0\_222" OpenJDK Runtime Environment (build 1.8.0\_222-8u222-b10-1ubuntu1~16.04.1-b1… --- ## [Using Collapse in elastic low level client with Hibernate Search](https://discuss.elastic.co/t/using-collapse-in-elastic-low-level-client-with-hibernate-search/256616)
**Author:** [@daviddavid](https://discuss.elastic.co/u/daviddavid)\ **Replies:** 5\ **Last updated:** [November 25, 2020, 1:47pm UTC](https://discuss.elastic.co/t/using-collapse-in-elastic-low-level-client-with-hibernate-search/256616 "2020-11-25T13:47:00Z")
Using Collapse in elastic low level client with Hibernate Search. How to use Collapse in Java Code as it is working in query search in browser with Collapse on field but with elastic low level client with Hibernate Sear… --- ## [Elastic cloud cpu scaling](https://discuss.elastic.co/t/elastic-cloud-cpu-scaling/256401)
**Author:** [@probson](https://discuss.elastic.co/u/probson)\ **Replies:** 4\ **Last updated:** [November 25, 2020, 12:50pm UTC](https://discuss.elastic.co/t/elastic-cloud-cpu-scaling/256401 "2020-11-25T12:50:42Z")
When increasing the ram on an instance in elastic cloud, does this increase the cpu cores to that instances as well as increase the credit? --- ## [Unable to save the array of json object in elasticsearch. Need to save it as string](https://discuss.elastic.co/t/unable-to-save-the-array-of-json-object-in-elasticsearch-need-to-save-it-as-string/256557)
**Author:** [@Saumya\_Mishra](https://discuss.elastic.co/u/Saumya_Mishra)\ **Replies:** 0\ **Last updated:** [November 24, 2020, 6:30pm UTC](https://discuss.elastic.co/t/unable-to-save-the-array-of-json-object-in-elasticsearch-need-to-save-it-as-string/256557 "2020-11-24T18:30:46Z")
I want to save this kind of data as a string in elasticsearch, but it fails to save \[{"flag":0,"amt":0,"code":1,"start":0,"end":0,"phrase":"they "},{"flag":0,"amt":0,"code":1,"start":0,"end":0,"phrase":"they qwe "},{"fl… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=754) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=756)