# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=770

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 771

---

## [Tableau Connector for Elasticsearch connecting string details](https://discuss.elastic.co/t/tableau-connector-for-elasticsearch-connecting-string-details/251907)

<div class="topic-metadata">

**Author:** [@Prabhu.292](https://discuss.elastic.co/u/Prabhu.292)\
**Replies:** 10\
**Last updated:** [November 8, 2020, 12:34pm UTC](https://discuss.elastic.co/t/tableau-connector-for-elasticsearch-connecting-string-details/251907 "2020-11-08T12:34:33Z")

</div>

Hi Team, By using this link : https://extensiongallery.tableau.com/connectors/180?version=2019.4&per-page=50&loginRedirected Using this above link from the Tableau gallery I have installed the JDBC driver and it is suc…

---

## [How to bootstrap security for an existing cluster](https://discuss.elastic.co/t/how-to-bootstrap-security-for-an-existing-cluster/254633)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 2\
**Last updated:** [November 7, 2020, 8:41pm UTC](https://discuss.elastic.co/t/how-to-bootstrap-security-for-an-existing-cluster/254633 "2020-11-07T20:41:43Z")

</div>

Cluster of 4 nodes currently running 6.8.12 soon to be upgraded to latest 7.x This cluster started life several years ago before xpack was available for free so it was set up using host based firewalls for security. Re…

---

## [Exists query calls DocValuesFieldExistsQuery for all subfields of an object under the field](https://discuss.elastic.co/t/exists-query-calls-docvaluesfieldexistsquery-for-all-subfields-of-an-object-under-the-field/254627)

<div class="topic-metadata">

**Author:** [@bek](https://discuss.elastic.co/u/bek)\
**Replies:** 0\
**Last updated:** [November 7, 2020, 4:11pm UTC](https://discuss.elastic.co/t/exists-query-calls-docvaluesfieldexistsquery-for-all-subfields-of-an-object-under-the-field/254627 "2020-11-07T16:11:17Z")

</div>

While upgrading elasticsearch from 5.6 to 7.9, we noticed that the DocValuesFieldExistsQuery is getting called for all child fields of a field, causing wait times up to a minute. Is there a way to prevent triggering DocV…

---

## [\[Errno 111\] Connection refused)](https://discuss.elastic.co/t/errno-111-connection-refused/253813)

<div class="topic-metadata">

**Author:** [@subham\_p](https://discuss.elastic.co/u/subham_p)\
**Replies:** 5\
**Last updated:** [November 7, 2020, 7:27pm UTC](https://discuss.elastic.co/t/errno-111-connection-refused/253813 "2020-11-07T19:27:26Z")

</div>

During handling of the above exception, another exception occurred: Traceback (most recent call last): File "for\_bulk\_insert.py", line 61, in es.indices.delete(index=index\_name, ignore=\[400, 404\]) File "/home/subham…

---

## [Help me](https://discuss.elastic.co/t/help-me/254626)

<div class="topic-metadata">

**Author:** [@YONGZHI](https://discuss.elastic.co/u/YONGZHI)\
**Replies:** 1\
**Last updated:** [November 7, 2020, 4:25pm UTC](https://discuss.elastic.co/t/help-me/254626 "2020-11-07T16:25:40Z")

</div>

I dont know why... could someone can help me, please.

---

## [Searching multifield with nested object not working in the nested object](https://discuss.elastic.co/t/searching-multifield-with-nested-object-not-working-in-the-nested-object/254623)

<div class="topic-metadata">

**Author:** [@Diogo\_Filipe](https://discuss.elastic.co/u/Diogo_Filipe)\
**Replies:** 0\
**Last updated:** [November 7, 2020, 3:54pm UTC](https://discuss.elastic.co/t/searching-multifield-with-nested-object-not-working-in-the-nested-object/254623 "2020-11-07T15:54:35Z")

</div>

Hi, I'm using Elastic 7.9.2 with ECK 1.2.1. Using Java and Spring too. I'm trying to query a nested object directly to the id variable(inside the 2nd object) but it always returns zero results. An example of my mappin…

---

## [Shard sizing as per the RAM available for an instance](https://discuss.elastic.co/t/shard-sizing-as-per-the-ram-available-for-an-instance/254594)

<div class="topic-metadata">

**Author:** [@SaitejaParsi](https://discuss.elastic.co/u/SaitejaParsi)\
**Replies:** 1\
**Last updated:** [November 7, 2020, 2:57am UTC](https://discuss.elastic.co/t/shard-sizing-as-per-the-ram-available-for-an-instance/254594 "2020-11-07T02:57:40Z")

</div>

How do the shard size related to the RAM capacity of the es instance? From the articles I read, 20 - 25 shards per GB is ideal and each shard can be from few GB to 10s of GB but should be less than 50GB. Also, the recomm…

---

## [GetTransformResponse unable to parse "source" field](https://discuss.elastic.co/t/gettransformresponse-unable-to-parse-source-field/254305)

<div class="topic-metadata">

**Author:** [@Craig\_Uss](https://discuss.elastic.co/u/Craig_Uss)\
**Replies:** 11\
**Last updated:** [November 6, 2020, 7:24pm UTC](https://discuss.elastic.co/t/gettransformresponse-unable-to-parse-source-field/254305 "2020-11-06T19:24:45Z")

</div>

ELK 7.8.1 Using Springboot 2.2.5 I am able to create a transform using the Kibana Stack Management and using the PUT \_transform curl command. However when trying to retrieve the same transform using the High Level REST…

---

## [Fleet and Elastic-Agent Installed but No Dataset](https://discuss.elastic.co/t/fleet-and-elastic-agent-installed-but-no-dataset/253462)

<div class="topic-metadata">

**Author:** [@rudyamid](https://discuss.elastic.co/u/rudyamid)\
**Replies:** 1\
**Last updated:** [November 6, 2020, 5:33pm UTC](https://discuss.elastic.co/t/fleet-and-elastic-agent-installed-but-no-dataset/253462 "2020-11-06T17:33:59Z")

</div>

I've installed a fresh version (clean filesystem) of Elasticsearch 7.9.2 in Docker environment as outlined here: https://www.elastic.co/guide/en/elastic-stack-get-started/7.9/get-started-docker.html#get-started-docker-tl…

---

## [Distribution of ElasticSearch](https://discuss.elastic.co/t/distribution-of-elasticsearch/254500)

<div class="topic-metadata">

**Author:** [@Anik\_Saha](https://discuss.elastic.co/u/Anik_Saha)\
**Replies:** 2\
**Last updated:** [November 6, 2020, 4:28pm UTC](https://discuss.elastic.co/t/distribution-of-elasticsearch/254500 "2020-11-06T16:28:20Z")

</div>

Is it allowed to distribute ElasticSearch as a part of an application?

---

## [Pagination for Nested Objects?](https://discuss.elastic.co/t/pagination-for-nested-objects/254552)

<div class="topic-metadata">

**Author:** [@mobeit00](https://discuss.elastic.co/u/mobeit00)\
**Replies:** 0\
**Last updated:** [November 6, 2020, 3:55pm UTC](https://discuss.elastic.co/t/pagination-for-nested-objects/254552 "2020-11-06T15:55:24Z")

</div>

I currently have an array of objects in my Elasticsearch. Currently I only have one filter on the name and I load all objects from the Elasticsearch and process them later in the application. Now I have too much data in …

---

## [What backend to use for EUI library?](https://discuss.elastic.co/t/what-backend-to-use-for-eui-library/254547)

<div class="topic-metadata">

**Author:** [@spyderman4g63](https://discuss.elastic.co/u/spyderman4g63)\
**Replies:** 0\
**Last updated:** [November 6, 2020, 3:18pm UTC](https://discuss.elastic.co/t/what-backend-to-use-for-eui-library/254547 "2020-11-06T15:18:38Z")

</div>

The EUI react.js library looks very interesting. I'd like to experiment with it but I can't find any examples of the backend code people are using to connect to elasticsearch. Is there any recommendation for this?

---

## [Soft\_deletes enabled maybe slow down the index performance](https://discuss.elastic.co/t/soft-deletes-enabled-maybe-slow-down-the-index-performance/254520)

<div class="topic-metadata">

**Author:** [@hackerwin7](https://discuss.elastic.co/u/hackerwin7)\
**Replies:** 6\
**Last updated:** [November 6, 2020, 2:28pm UTC](https://discuss.elastic.co/t/soft-deletes-enabled-maybe-slow-down-the-index-performance/254520 "2020-11-06T14:28:32Z")

</div>

Hi, Our elasticsearch is on 6.8.0 when we use soft\_delete is enabled, we find that the index which indexing requests is mainly updates, so the segments bytes grow up more and more bigger, and docs.deleted count is more…

---

## [Max\_open\_scroll\_context, scroll\_ids, and shards](https://discuss.elastic.co/t/max-open-scroll-context-scroll-ids-and-shards/253872)

<div class="topic-metadata">

**Author:** [@Michael\_Cayanan](https://discuss.elastic.co/u/Michael_Cayanan)\
**Replies:** 3\
**Last updated:** [November 6, 2020, 1:39pm UTC](https://discuss.elastic.co/t/max-open-scroll-context-scroll-ids-and-shards/253872 "2020-11-06T13:39:03Z")

</div>

Hi. I'm making a query across several indices with 8 shards per index. To be specific it ends up being about 752 shards in total. When I make a scroll query, I initially get that Trying to create too many scroll contex…

---

## [org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?)](https://discuss.elastic.co/t/org-apache-lucene-index-corruptindexexception-codec-footer-mismatch-file-truncated/254517)

<div class="topic-metadata">

**Author:** [@Tin\_Deng](https://discuss.elastic.co/u/Tin_Deng)\
**Replies:** 2\
**Last updated:** [November 6, 2020, 1:34pm UTC](https://discuss.elastic.co/t/org-apache-lucene-index-corruptindexexception-codec-footer-mismatch-file-truncated/254517 "2020-11-06T13:34:38Z")

</div>

ES version: 5.6.8 1 master, 3 data nodes, replica = 0 Hi everyone, I was wondering if it's possible to recover the data with the exception in this case? Caused by: org.elasticsearch.gateway.CorruptStateException: org…

---

## [Ingesting/appending pandas dataframe to same index everyday](https://discuss.elastic.co/t/ingesting-appending-pandas-dataframe-to-same-index-everyday/254532)

<div class="topic-metadata">

**Author:** [@aditya5](https://discuss.elastic.co/u/aditya5)\
**Replies:** 1\
**Last updated:** [November 6, 2020, 1:32pm UTC](https://discuss.elastic.co/t/ingesting-appending-pandas-dataframe-to-same-index-everyday/254532 "2020-11-06T13:32:53Z")

</div>

I want to append data to same ES index from dataframe every day. Please let me know if its possible ? If yes how?

---

## [Some Change in Percolation/QueryStringQuery/Mapping between 7.6.2 and 7.7.0?](https://discuss.elastic.co/t/some-change-in-percolation-querystringquery-mapping-between-7-6-2-and-7-7-0/250579)

<div class="topic-metadata">

**Author:** [@Andrew\_DS](https://discuss.elastic.co/u/Andrew_DS)\
**Replies:** 4\
**Last updated:** [November 6, 2020, 1:31pm UTC](https://discuss.elastic.co/t/some-change-in-percolation-querystringquery-mapping-between-7-6-2-and-7-7-0/250579 "2020-11-06T13:31:15Z")

</div>

I've noticed that, while trying to migrate from Elasticsearch 7.5.2 -\> 7.9.2, something seems to have changed in how percolator queries seem to work. I have narrowed down my problem to a change between 7.6.2 and 7.7.0; t…

---

## [Kibana outlook alert doesn't work](https://discuss.elastic.co/t/kibana-outlook-alert-doesnt-work/254529)

<div class="topic-metadata">

**Author:** [@TomChv](https://discuss.elastic.co/u/TomChv)\
**Replies:** 0\
**Last updated:** [November 6, 2020, 1:21pm UTC](https://discuss.elastic.co/t/kibana-outlook-alert-doesnt-work/254529 "2020-11-06T13:21:22Z")

</div>

Hi everybody, I'm sorry for that newbie question, I'm new on elastic... I would like to setup an email alert when I have some logs with error level.. I've successfully setup the event, I can see my alert been triggere…

---

## [Erally stuck while running against already existing cluster](https://discuss.elastic.co/t/erally-stuck-while-running-against-already-existing-cluster/254415)

<div class="topic-metadata">

**Author:** [@juriskr](https://discuss.elastic.co/u/juriskr)\
**Replies:** 5\
**Last updated:** [November 6, 2020, 12:25pm UTC](https://discuss.elastic.co/t/erally-stuck-while-running-against-already-existing-cluster/254415 "2020-11-06T12:25:23Z")

</div>

I'm trying to start erally using docker based installation and the following command: docker run elastic/rally --track=nyc\_taxis --test-mode --pipeline=benchmark-only --target-hosts=, got the following output and then e…

---

## [Unable to start Elasticsearch service in centos](https://discuss.elastic.co/t/unable-to-start-elasticsearch-service-in-centos/254439)

<div class="topic-metadata">

**Author:** [@Dhamodharan](https://discuss.elastic.co/u/Dhamodharan)\
**Replies:** 7\
**Last updated:** [November 6, 2020, 12:24pm UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-service-in-centos/254439 "2020-11-06T12:24:20Z")

</div>

Recently setup elk stack, but unable to start the es service, its throwing the below error when i run "journalctl -xe" Also the logs of elasticsearch Can someone help me on this?

---

## [Task not found after Elasticsearch restart](https://discuss.elastic.co/t/task-not-found-after-elasticsearch-restart/254518)

<div class="topic-metadata">

**Author:** [@nisham](https://discuss.elastic.co/u/nisham)\
**Replies:** 0\
**Last updated:** [November 6, 2020, 10:57am UTC](https://discuss.elastic.co/t/task-not-found-after-elasticsearch-restart/254518 "2020-11-06T10:57:12Z")

</div>

Hello, I had a reindexing task running, in between my Elasticsearch (7.9.1) got restarted. When I tried to get that task information using taks API its giving resource\_not\_found\_exception and "task \[2Wdrswwr433ss:11111\]…

---

## [Doing computation on count aggregation in heatmap](https://discuss.elastic.co/t/doing-computation-on-count-aggregation-in-heatmap/254513)

<div class="topic-metadata">

**Author:** [@josefy](https://discuss.elastic.co/u/josefy)\
**Replies:** 0\
**Last updated:** [November 6, 2020, 10:16am UTC](https://discuss.elastic.co/t/doing-computation-on-count-aggregation-in-heatmap/254513 "2020-11-06T10:16:11Z")

</div>

Hi, I created a heatmap visualization. For the x-axis I have a date histogram, for the y-axis I have a "Terms" aggregation. For metrics I'm currently using the "Count" aggregation. What I actually want is the "Count" d…

---

## [Authentication for kibana, unknown setting xpack.security.enabled](https://discuss.elastic.co/t/authentication-for-kibana-unknown-setting-xpack-security-enabled/254434)

<div class="topic-metadata">

**Author:** [@oobi89](https://discuss.elastic.co/u/oobi89)\
**Replies:** 5\
**Last updated:** [November 6, 2020, 9:47am UTC](https://discuss.elastic.co/t/authentication-for-kibana-unknown-setting-xpack-security-enabled/254434 "2020-11-06T09:47:25Z")

</div>

I've had Elasticsearch and kibana as part of my docker-compose stack for some project for a while but now I need to add authentication for kibana and came across a strange problem. According to docs I need to set xpack.s…

---

## [Eland and Elk 7.6](https://discuss.elastic.co/t/eland-and-elk-7-6/254495)

<div class="topic-metadata">

**Author:** [@vinod\_kumar](https://discuss.elastic.co/u/vinod_kumar)\
**Replies:** 2\
**Last updated:** [November 6, 2020, 8:20am UTC](https://discuss.elastic.co/t/eland-and-elk-7-6/254495 "2020-11-06T08:20:12Z")

</div>

I want to know if we can configure Eland using free version of ELK 7.6.

---

## [Lucene Documents](https://discuss.elastic.co/t/lucene-documents/254378)

<div class="topic-metadata">

**Author:** [@tsp](https://discuss.elastic.co/u/tsp)\
**Replies:** 2\
**Last updated:** [November 6, 2020, 8:00am UTC](https://discuss.elastic.co/t/lucene-documents/254378 "2020-11-06T08:00:05Z")

</div>

Hi all, I am not too sure that this is the right place. But we are new to build our own full-text engine. We are planning to index files on the fly using the Lucence Java API. That would be an easy requirement as such,…

---

## [Cancel a forcemerge operation](https://discuss.elastic.co/t/cancel-a-forcemerge-operation/254481)

<div class="topic-metadata">

**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\
**Replies:** 1\
**Last updated:** [November 6, 2020, 4:32am UTC](https://discuss.elastic.co/t/cancel-a-forcemerge-operation/254481 "2020-11-06T04:32:24Z")

</div>

Is there a way to cancel and on-going \[\_forcemerge\](https://www.elastic.co/guide/en/elasticsearch/reference/6.8/indices-forcemerge.html#indices-forcemerge) operation? ES Version 6.8.6.

---

## [Alternative for CentOS 5 machines](https://discuss.elastic.co/t/alternative-for-centos-5-machines/254396)

<div class="topic-metadata">

**Author:** [@headtea](https://discuss.elastic.co/u/headtea)\
**Replies:** 2\
**Last updated:** [November 5, 2020, 9:58pm UTC](https://discuss.elastic.co/t/alternative-for-centos-5-machines/254396 "2020-11-05T21:58:18Z")

</div>

I've deployed beats on most servers and it works really well. The only problem is that there are about 10 machines left that still run CentOS 5.4 and cannot be updated. I've tried installing filebeat but it said the ker…

---

## [Why Elastic search doesn't support storing encrypted data](https://discuss.elastic.co/t/why-elastic-search-doesnt-support-storing-encrypted-data/254375)

<div class="topic-metadata">

**Author:** [@Vivek\_Sagar](https://discuss.elastic.co/u/Vivek_Sagar)\
**Replies:** 1\
**Last updated:** [November 5, 2020, 9:57pm UTC](https://discuss.elastic.co/t/why-elastic-search-doesnt-support-storing-encrypted-data/254375 "2020-11-05T21:57:16Z")

</div>

As in previous discussion, ES works on encrypted volumes(dm-crypt). Is there any specific reason why it does not support storing and searching on encrypted data?

---

## [Unable to start elasticsearch on centos 7 server](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-centos-7-server/254276)

<div class="topic-metadata">

**Author:** [@valsaraj\_pv](https://discuss.elastic.co/u/valsaraj_pv)\
**Replies:** 3\
**Last updated:** [November 5, 2020, 9:41pm UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-centos-7-server/254276 "2020-11-05T21:41:58Z")

</div>

After installation, we got following error when started the service: \[2020-11-04T07:20:12,233\]\[WARN \]\[o.e.b.Natives \] \[test\] unable to load JNA native support library, native methods will be disabled. java.lang.Unsati…

---

## [Elasticsearch time to as in via python (timezone)](https://discuss.elastic.co/t/elasticsearch-time-to-as-in-via-python-timezone/254340)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 5\
**Last updated:** [November 5, 2020, 8:38pm UTC](https://discuss.elastic.co/t/elasticsearch-time-to-as-in-via-python-timezone/254340 "2020-11-05T20:38:34Z")

</div>

I have a wrote small python script where I am reading certain information from Elasticsearch and pushing that back in to ELK. what I want it to keep what ever date-time I get from ELK. I want to push same as is back in …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=769)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=771)
