# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=914

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 915

---

## [Authentication issues while xpack security enabling - Elasticsearch version 7.7](https://discuss.elastic.co/t/authentication-issues-while-xpack-security-enabling-elasticsearch-version-7-7/233555)

<div class="topic-metadata">

**Author:** [@tryelk](https://discuss.elastic.co/u/tryelk)\
**Replies:** 6\
**Last updated:** [May 21, 2020, 11:33am UTC](https://discuss.elastic.co/t/authentication-issues-while-xpack-security-enabling-elasticsearch-version-7-7/233555 "2020-05-21T11:33:53Z")

</div>

Hello, I'm having issues setting up security for a fresh install of ES. The issue is after enabling xpack.security on the elasticsearch.yml and starting the ES service, then executing for example: " curl --insecure …

---

## [Elasticsearch Search error](https://discuss.elastic.co/t/elasticsearch-search-error/232784)

<div class="topic-metadata">

**Author:** [@Yassine\_Nifa](https://discuss.elastic.co/u/Yassine_Nifa)\
**Replies:** 1\
**Last updated:** [May 21, 2020, 11:08am UTC](https://discuss.elastic.co/t/elasticsearch-search-error/232784 "2020-05-21T11:08:28Z")

</div>

Hello guys !! I am working on text similarity using text\_embedding and cosine similarity with elasticsearch I am getting this error : elasticsearch.exceptions.RequestError: RequestError(400, 'search\_phase\_execution\_ex…

---

## [Mapping Create Error using version 6.3](https://discuss.elastic.co/t/mapping-create-error-using-version-6-3/233725)

<div class="topic-metadata">

**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 11:04am UTC](https://discuss.elastic.co/t/mapping-create-error-using-version-6-3/233725 "2020-05-21T11:04:30Z")

</div>

{ "settings": { "analysis": { "filter": { "substring": { "type": "nGram", "min\_gram": "2", "max\_gram": "50" } }, "analyzer": { "str\_index\_analyzer": { "filter": \[ "lowercase", "substring" \], "tokenizer": …

---

## [More search time](https://discuss.elastic.co/t/more-search-time/233136)

<div class="topic-metadata">

**Author:** [@hegebharat](https://discuss.elastic.co/u/hegebharat)\
**Replies:** 9\
**Last updated:** [May 21, 2020, 11:04am UTC](https://discuss.elastic.co/t/more-search-time/233136 "2020-05-21T11:04:22Z")

</div>

Hi, We have case where we have indexed 1billion vectors(each is 512 -dims) using dense\_vector (elastic version 7.6). We are using cosine similarity to find the best hits. But every query is taking 6.7 sec to get the …

---

## [Updating of indexes with elasticsearch-py](https://discuss.elastic.co/t/updating-of-indexes-with-elasticsearch-py/233711)

<div class="topic-metadata">

**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 9:46am UTC](https://discuss.elastic.co/t/updating-of-indexes-with-elasticsearch-py/233711 "2020-05-21T09:46:04Z")

</div>

Hi, I have gotten my python script which is using the elasticsearch-py library to index a csv file which will be updated daily. However, i am currently deleting the existing index and creating it again to "update" the d…

---

## [Mapping field meta not working](https://discuss.elastic.co/t/mapping-field-meta-not-working/233696)

<div class="topic-metadata">

**Author:** [@suspai](https://discuss.elastic.co/u/suspai)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 8:39am UTC](https://discuss.elastic.co/t/mapping-field-meta-not-working/233696 "2020-05-21T08:39:33Z")

</div>

Hi, I need to create a meta data for the field mapping as mentioned in this url: https://www.elastic.co/guide/en/elasticsearch/reference/7.x/mapping-field-meta.html But it gives a 400 error, as below. Please let me kno…

---

## [Words matching with fuzziness 2 aren't highlighted](https://discuss.elastic.co/t/words-matching-with-fuzziness-2-arent-highlighted/233694)

<div class="topic-metadata">

**Author:** [@Shubham](https://discuss.elastic.co/u/Shubham)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 8:23am UTC](https://discuss.elastic.co/t/words-matching-with-fuzziness-2-arent-highlighted/233694 "2020-05-21T08:23:02Z")

</div>

I have placed highlighter in my search query and performing fuzzy search. Some of the matched words aren't highlighted in despite of fuzzy matching with two character change. For example: "James" is matching with "Thame…

---

## [Unable to enable https and internode communication in 2 node cluster](https://discuss.elastic.co/t/unable-to-enable-https-and-internode-communication-in-2-node-cluster/232306)

<div class="topic-metadata">

**Author:** [@nityaraj06](https://discuss.elastic.co/u/nityaraj06)\
**Replies:** 16\
**Last updated:** [May 21, 2020, 7:50am UTC](https://discuss.elastic.co/t/unable-to-enable-https-and-internode-communication-in-2-node-cluster/232306 "2020-05-21T07:50:37Z")

</div>

Hi, I have setup a 2 node ES cluster as follows node-1 : elasticsearch and kibana node-2: elasticsearch I have enabled https and tls level security on node-1 successfully on both between kibana and browser and betwee…

---

## [Recommendation for Multiple index vs single index for small amounts of query](https://discuss.elastic.co/t/recommendation-for-multiple-index-vs-single-index-for-small-amounts-of-query/233661)

<div class="topic-metadata">

**Author:** [@yui98jaesok](https://discuss.elastic.co/u/yui98jaesok)\
**Replies:** 4\
**Last updated:** [May 21, 2020, 6:51am UTC](https://discuss.elastic.co/t/recommendation-for-multiple-index-vs-single-index-for-small-amounts-of-query/233661 "2020-05-21T06:51:18Z")

</div>

Hello everyone, I have read a lot on the forums for pros and cons of multiple indexs vs single index and I want to get some advice for my specific use case. I have a pipeline that ingests word documents from clients, an…

---

## [\[parent\] data too large](https://discuss.elastic.co/t/parent-data-too-large/233671)

<div class="topic-metadata">

**Author:** [@ted\_ye](https://discuss.elastic.co/u/ted_ye)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 6:13am UTC](https://discuss.elastic.co/t/parent-data-too-large/233671 "2020-05-21T06:13:33Z")

</div>

Hello , I am seeking the frequent occurence of the CircuitBreakingException in our ES cluster. org.elasticsearch.xpack.monitoring.exporter.ExportException: RemoteTransportException\[\[mdwdata04\]\[10.10.30.66:9302\]\[indices…

---

## [Unable to form cluster after enabling TLS in elasticsearch](https://discuss.elastic.co/t/unable-to-form-cluster-after-enabling-tls-in-elasticsearch/233669)

<div class="topic-metadata">

**Author:** [@nityaraj06](https://discuss.elastic.co/u/nityaraj06)\
**Replies:** 1\
**Last updated:** [May 21, 2020, 5:39am UTC](https://discuss.elastic.co/t/unable-to-form-cluster-after-enabling-tls-in-elasticsearch/233669 "2020-05-21T05:39:38Z")

</div>

Hi, I am unable to form a cluster after enabling TLS. error from master node: \[2020-05-21T07:19:55,969\]\[WARN \]\[o.e.x.c.s.t.n.SecurityNetty4Transport\] \[node1\] client did not trust this server's certificate, closing c…

---

## [How to send logs to AWS S3](https://discuss.elastic.co/t/how-to-send-logs-to-aws-s3/229977)

<div class="topic-metadata">

**Author:** [@suresh123](https://discuss.elastic.co/u/suresh123)\
**Replies:** 3\
**Last updated:** [May 21, 2020, 4:39am UTC](https://discuss.elastic.co/t/how-to-send-logs-to-aws-s3/229977 "2020-05-21T04:39:32Z")

</div>

I have setup ELK on AWS EC2. and started sending logs to it. But after 1 week logserver stopped working due to less space on device. So I need to move the logs (archive) to S3 . But no idea of that. Please help me to s…

---

## [Comparing records from different inventory systems](https://discuss.elastic.co/t/comparing-records-from-different-inventory-systems/233660)

<div class="topic-metadata">

**Author:** [@Jez1](https://discuss.elastic.co/u/Jez1)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 4:30am UTC](https://discuss.elastic.co/t/comparing-records-from-different-inventory-systems/233660 "2020-05-21T04:30:06Z")

</div>

Hi All, I'm not sure if this is possible or advised with ElasticSearch but thought it would be a good place to start. What I'm working on is I have multiple systems that contain information of computers on my network (…

---

## [Unable to get terms + terms + top hits aggregation](https://discuss.elastic.co/t/unable-to-get-terms-terms-top-hits-aggregation/233650)

<div class="topic-metadata">

**Author:** [@Andy93](https://discuss.elastic.co/u/Andy93)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 2:45am UTC](https://discuss.elastic.co/t/unable-to-get-terms-terms-top-hits-aggregation/233650 "2020-05-21T02:45:18Z")

</div>

Hi, I am trying to do a terms + terms + top hits aggregation on an index of ~5.4m documents. The relevant fields are equipment ID, location, and the timestamp. I want to get the latest location of the equipment via the…

---

## [When I use OR condition in multiline.pattern each line comes in a separate message](https://discuss.elastic.co/t/when-i-use-or-condition-in-multiline-pattern-each-line-comes-in-a-separate-message/233639)

<div class="topic-metadata">

**Author:** [@ebisada](https://discuss.elastic.co/u/ebisada)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 1:20am UTC](https://discuss.elastic.co/t/when-i-use-or-condition-in-multiline-pattern-each-line-comes-in-a-separate-message/233639 "2020-05-21T01:20:24Z")

</div>

When I use OR condition in multiline.pattern each line comes in a separate message: When I use the following lines, I can successfully parse multiple line logs starting with \[INFO\], \[ERROR\] or \[DEBUG\]: multiline.patter…

---

## [If the es-watcher webhook link is down, why does it directly affect the work of the elasticsearch cluster](https://discuss.elastic.co/t/if-the-es-watcher-webhook-link-is-down-why-does-it-directly-affect-the-work-of-the-elasticsearch-cluster/233638)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 0\
**Last updated:** [May 21, 2020, 1:13am UTC](https://discuss.elastic.co/t/if-the-es-watcher-webhook-link-is-down-why-does-it-directly-affect-the-work-of-the-elasticsearch-cluster/233638 "2020-05-21T01:13:11Z")

</div>

I want to make a suggestion, is es and watcher too coupled? es log https://paste.ubuntu.com/p/JMWYbMtb6W/ 304 will always appear in the log of kibana

---

## [Copying Incremental Data](https://discuss.elastic.co/t/copying-incremental-data/232356)

<div class="topic-metadata">

**Author:** [@alajangi](https://discuss.elastic.co/u/alajangi)\
**Replies:** 6\
**Last updated:** [May 21, 2020, 12:41am UTC](https://discuss.elastic.co/t/copying-incremental-data/232356 "2020-05-21T00:41:55Z")

</div>

Hi, I am using elasticsearch version 6.5.1 I have 2 indexes, say index1 and index2, index2 is reindexed from index1 with same mapping, new data will keep come to index1, i want to copy incremental data to index2 from …

---

## [Unable to create index in Elastic search using API](https://discuss.elastic.co/t/unable-to-create-index-in-elastic-search-using-api/233446)

<div class="topic-metadata">

**Author:** [@rupini](https://discuss.elastic.co/u/rupini)\
**Replies:** 3\
**Last updated:** [May 21, 2020, 12:24am UTC](https://discuss.elastic.co/t/unable-to-create-index-in-elastic-search-using-api/233446 "2020-05-21T00:24:59Z")

</div>

Hi, I am trying to create index in Elastic search using API in Kibana dev tools. PUT /ipflow-logs { "ipflow-logs" : { "mappings" : { "properties" : { "conn\_state" : { "type" : "keyword" …

---

## [The shard cannot be allocated to the same node on which a copy of the shard already exists](https://discuss.elastic.co/t/the-shard-cannot-be-allocated-to-the-same-node-on-which-a-copy-of-the-shard-already-exists/233133)

<div class="topic-metadata">

**Author:** [@johnny12311](https://discuss.elastic.co/u/johnny12311)\
**Replies:** 2\
**Last updated:** [May 20, 2020, 11:12pm UTC](https://discuss.elastic.co/t/the-shard-cannot-be-allocated-to-the-same-node-on-which-a-copy-of-the-shard-already-exists/233133 "2020-05-20T23:12:32Z")

</div>

Suddenly the count operation on an index returned a few million less results than usual. Looking at application logs I see stacktraces when trying to add a new document. File "/myapp/MetaControl/MetaController.py"…

---

## [What recomendations could you give to redesign my cluster.. ( I need to boost it)](https://discuss.elastic.co/t/what-recomendations-could-you-give-to-redesign-my-cluster-i-need-to-boost-it/233619)

<div class="topic-metadata">

**Author:** [@Luis\_Alfredo\_Gonzale](https://discuss.elastic.co/u/Luis_Alfredo_Gonzale)\
**Replies:** 1\
**Last updated:** [May 20, 2020, 11:17pm UTC](https://discuss.elastic.co/t/what-recomendations-could-you-give-to-redesign-my-cluster-i-need-to-boost-it/233619 "2020-05-20T23:17:31Z")

</div>

We are currently receiving about 200 gb of information per day. Distributed in approximately two million logs. We need to increase the capacity of our cluster in order to generate some reports in less time than now. Wh…

---

## [Notification on successful load of data to elasticsearch](https://discuss.elastic.co/t/notification-on-successful-load-of-data-to-elasticsearch/233587)

<div class="topic-metadata">

**Author:** [@mnrdammu](https://discuss.elastic.co/u/mnrdammu)\
**Replies:** 1\
**Last updated:** [May 20, 2020, 11:05pm UTC](https://discuss.elastic.co/t/notification-on-successful-load-of-data-to-elasticsearch/233587 "2020-05-20T23:05:42Z")

</div>

I need some help on one of the use case I am working on.. Basically, Its a simple use case where, log stash is reading data from the csv file from a directory and loading into the elastic search. Every time when there i…

---

## [Unable to run support-diagnostics utility on my logstash server](https://discuss.elastic.co/t/unable-to-run-support-diagnostics-utility-on-my-logstash-server/233537)

<div class="topic-metadata">

**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\
**Replies:** 1\
**Last updated:** [May 20, 2020, 10:51pm UTC](https://discuss.elastic.co/t/unable-to-run-support-diagnostics-utility-on-my-logstash-server/233537 "2020-05-20T22:51:14Z")

</div>

Hi, I am receiving This error when i run ./diagnostics.sh file Using /bin/java as Java Runtime Using -Xms256m -Xmx2000m for options. Error: Could not find or load main class com.elastic.support.diagnostics.Diagnosti…

---

## [Tengo este error](https://discuss.elastic.co/t/tengo-este-error/233601)

<div class="topic-metadata">

**Author:** [@ferhogan](https://discuss.elastic.co/u/ferhogan)\
**Replies:** 1\
**Last updated:** [May 20, 2020, 10:44pm UTC](https://discuss.elastic.co/t/tengo-este-error/233601 "2020-05-20T22:44:27Z")

</div>

{ "timestamp": "2020-05-20T19:15:10.645+0000", "status": 500, "error": "Internal Server Error", "message": "None of the configured nodes are available: \[{#transport#-1}{7GYeCRnnT5mX5INtz3ScOw}{localhost}{127.0.0.1:92…

---

## [Shards Resizing](https://discuss.elastic.co/t/shards-resizing/233606)

<div class="topic-metadata">

**Author:** [@hsalim](https://discuss.elastic.co/u/hsalim)\
**Replies:** 3\
**Last updated:** [May 20, 2020, 10:17pm UTC](https://discuss.elastic.co/t/shards-resizing/233606 "2020-05-20T22:17:01Z")

</div>

Hello, This topic has been discussed in-depth, and I am still looking for a better understanding. So hoping someone can provide insights. How do we actually allocate storage to a shard? I know we can increase number of…

---

## [Spark writes documents in non-suitable indices](https://discuss.elastic.co/t/spark-writes-documents-in-non-suitable-indices/233531)

<div class="topic-metadata">

**Author:** [@Hamza\_BENNANI](https://discuss.elastic.co/u/Hamza_BENNANI)\
**Replies:** 4\
**Last updated:** [May 20, 2020, 9:17pm UTC](https://discuss.elastic.co/t/spark-writes-documents-in-non-suitable-indices/233531 "2020-05-20T21:17:11Z")

</div>

Hello, I have a Spark code which loads data from multiple indices and writes back the enriched data into the origin index. Hence, I use the pattern '{index}' to specify the target index dynamically. However, Spark tries…

---

## [Inconsistent doc\_freq in \_mtermvectors](https://discuss.elastic.co/t/inconsistent-doc-freq-in-mtermvectors/233610)

<div class="topic-metadata">

**Author:** [@Xheneta](https://discuss.elastic.co/u/Xheneta)\
**Replies:** 0\
**Last updated:** [May 20, 2020, 8:42pm UTC](https://discuss.elastic.co/t/inconsistent-doc-freq-in-mtermvectors/233610 "2020-05-20T20:42:02Z")

</div>

Hi there, I have been using Elasticsearch to analyze a text with a customized analyzer in Elasticsearch. Then using the \_mtermvectors to get for each keyword the statistics. While trying it out, I found an inconsistency…

---

## ["numHits must be \> 0; please use TotalHitCountCollector if you just need the total hit count" following upgrade to ES 7.7](https://discuss.elastic.co/t/numhits-must-be-0-please-use-totalhitcountcollector-if-you-just-need-the-total-hit-count-following-upgrade-to-es-7-7/233174)

<div class="topic-metadata">

**Author:** [@toby\_jn](https://discuss.elastic.co/u/toby_jn)\
**Replies:** 3\
**Last updated:** [May 20, 2020, 8:41pm UTC](https://discuss.elastic.co/t/numhits-must-be-0-please-use-totalhitcountcollector-if-you-just-need-the-total-hit-count-following-upgrade-to-es-7-7/233174 "2020-05-20T20:41:05Z")

</div>

Following an upgrade from 7.5.1 to 7.7.0 we've started seeing an unusual error with queries used to count the number of documents in an index. In 7.7.0 this query now returns an error: curl -X POST '127.0.0.1:9200/v33.…

---

## [Dynamic Templates error on Elastic 7.x+](https://discuss.elastic.co/t/dynamic-templates-error-on-elastic-7-x/233593)

<div class="topic-metadata">

**Author:** [@mehta.svarun](https://discuss.elastic.co/u/mehta.svarun)\
**Replies:** 0\
**Last updated:** [May 20, 2020, 6:45pm UTC](https://discuss.elastic.co/t/dynamic-templates-error-on-elastic-7-x/233593 "2020-05-20T18:45:56Z")

</div>

Is there an example of a Graph data structure source data to ingestion in Elastic? We have been doing a lot of work in Elastic Graph and it all worked great with the template until Kibana 6.x versions. But from 7.x it st…

---

## [GC OverHead Collecting Frequently](https://discuss.elastic.co/t/gc-overhead-collecting-frequently/233408)

<div class="topic-metadata">

**Author:** [@Phyo\_Thinza](https://discuss.elastic.co/u/Phyo_Thinza)\
**Replies:** 2\
**Last updated:** [May 20, 2020, 5:14pm UTC](https://discuss.elastic.co/t/gc-overhead-collecting-frequently/233408 "2020-05-20T17:14:40Z")

</div>

Hello, I am seeing GC overhead collection calls frequently in my ES cluster. ES is deployed on AWS. JVM memory usage is high and average is 96% max, 79% min. I appreciate for any idea and suggestion. Elasticsearch ver…

---

## [Error using SQL Translate API](https://discuss.elastic.co/t/error-using-sql-translate-api/233550)

<div class="topic-metadata">

**Author:** [@sanjaysubramanian](https://discuss.elastic.co/u/sanjaysubramanian)\
**Replies:** 2\
**Last updated:** [May 20, 2020, 5:00pm UTC](https://discuss.elastic.co/t/error-using-sql-translate-api/233550 "2020-05-20T17:00:39Z")

</div>

My index name is called fan\_messages curl -XPUT "http://localhost:9200/fan\_messages" -H 'Content-Type: application/json' -d' { "mappings" : { "properties": { "email": { "type": "keyword" …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=913)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=915)
