# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1305

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1306

---

## [Filebeat Index Lifecycle Management Issue (No Data)](https://discuss.elastic.co/t/filebeat-index-lifecycle-management-issue-no-data/180039)

<div class="topic-metadata">

**Author:** [@chadhanson](https://discuss.elastic.co/u/chadhanson)\
**Replies:** 11\
**Last updated:** [May 9, 2019, 3:59pm UTC](https://discuss.elastic.co/t/filebeat-index-lifecycle-management-issue-no-data/180039 "2019-05-09T15:59:02Z")

</div>

My filebeat index seems to be corrupted and will not take new ingestion data. While reviewing the logs I noticed the life cycle error below over and over in the logs. The filebeat index is the only index that seems t…

---

## [Indexing Anatomy](https://discuss.elastic.co/t/indexing-anatomy/180364)

<div class="topic-metadata">

**Author:** [@DeepakBhatt](https://discuss.elastic.co/u/DeepakBhatt)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 3:55pm UTC](https://discuss.elastic.co/t/indexing-anatomy/180364 "2019-05-09T15:55:50Z")

</div>

Hi Team, Just want to ask, if we are indexing a document and replica shards are not able to index the documents only primary shards indexed. Are we able to search that document? If yes, then our shards are not synced, …

---

## [Upgrading from 6.5.4 to 7.0.1 : problem with an old index](https://discuss.elastic.co/t/upgrading-from-6-5-4-to-7-0-1-problem-with-an-old-index/180393)

<div class="topic-metadata">

**Author:** [@samia](https://discuss.elastic.co/u/samia)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 3:44pm UTC](https://discuss.elastic.co/t/upgrading-from-6-5-4-to-7-0-1-problem-with-an-old-index/180393 "2019-05-09T15:44:16Z")

</div>

Hi, While upgrading from version 6.5.4 to 7.0.1, I forgot I had a very old index created with elastic 5.6. As I am not in production, I haven't snapshots .... When I launched version 7.0.1 : I had first an error becau…

---

## [Task Cancel API - How to id the task I want to cancel](https://discuss.elastic.co/t/task-cancel-api-how-to-id-the-task-i-want-to-cancel/180062)

<div class="topic-metadata">

**Author:** [@codeboy](https://discuss.elastic.co/u/codeboy)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 3:42pm UTC](https://discuss.elastic.co/t/task-cancel-api-how-to-id-the-task-i-want-to-cancel/180062 "2019-05-09T15:42:45Z")

</div>

I am looking into the tasks api. I have found the listing api using curl /\_tasks?detailed=true&actions=\*search&pretty" and I can successfully cancel one or all. I would like to implement a \[Cancel\] button in my applica…

---

## [Automatically apply filtered alias for daily indices](https://discuss.elastic.co/t/automatically-apply-filtered-alias-for-daily-indices/180388)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 3:39pm UTC](https://discuss.elastic.co/t/automatically-apply-filtered-alias-for-daily-indices/180388 "2019-05-09T15:39:00Z")

</div>

Hi! I'm currently adding rollup jobs where filtering isn't an option. I have various cases, some would be a simple match for one field (I'd monitor the count), others would require bucketing, cardinality and a final sum…

---

## [Decreasing query time node ram vs another node](https://discuss.elastic.co/t/decreasing-query-time-node-ram-vs-another-node/180396)

<div class="topic-metadata">

**Author:** [@klaus82](https://discuss.elastic.co/u/klaus82)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 3:24pm UTC](https://discuss.elastic.co/t/decreasing-query-time-node-ram-vs-another-node/180396 "2019-05-09T15:24:56Z")

</div>

Hi, we have a question about the scalability in particular number of nodes vs amount of ram of each node. Our problem is the following: we have 8 processes that perform query on elastic and our elastic cluster (o elast…

---

## [How to count number of fileds on nested object with Elasticsearch and kibana](https://discuss.elastic.co/t/how-to-count-number-of-fileds-on-nested-object-with-elasticsearch-and-kibana/180395)

<div class="topic-metadata">

**Author:** [@aeljazouli](https://discuss.elastic.co/u/aeljazouli)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 3:19pm UTC](https://discuss.elastic.co/t/how-to-count-number-of-fileds-on-nested-object-with-elasticsearch-and-kibana/180395 "2019-05-09T15:19:34Z")

</div>

Hi there, I want to count number of fields on a nested object that matchs a query in order to visualize them on Kibana. { "meta":{ "ID\_FICHIER":127745, "DATE\_APPEL":"2018-10-15'T'17:17:45", "SITE":…

---

## [Best way of importing very large JSON files into Elasticsearch](https://discuss.elastic.co/t/best-way-of-importing-very-large-json-files-into-elasticsearch/180386)

<div class="topic-metadata">

**Author:** [@Niels\_van\_Rijn](https://discuss.elastic.co/u/Niels_van_Rijn)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 2:32pm UTC](https://discuss.elastic.co/t/best-way-of-importing-very-large-json-files-into-elasticsearch/180386 "2019-05-09T14:32:54Z")

</div>

Hi! Im pretty new to the whole ELK stack. So I have about 10136 json files, all with a minimum of 1000 lines. Here is an example of one of these json files What is the best way of inserting this into Elasticsearch? A…

---

## [Failed to configure email alerts with gmail](https://discuss.elastic.co/t/failed-to-configure-email-alerts-with-gmail/180316)

<div class="topic-metadata">

**Author:** [@Leon\_Voerman](https://discuss.elastic.co/u/Leon_Voerman)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 2:21pm UTC](https://discuss.elastic.co/t/failed-to-configure-email-alerts-with-gmail/180316 "2019-05-09T14:21:33Z")

</div>

Error I get: \[2019-05-09T08:45:12,470\]\[INFO \]\[o.e.p.PluginsService \] \[app\] loaded module \[aggs-matrix-stats\] \[2019-05-09T08:45:12,470\]\[INFO \]\[o.e.p.PluginsService \] \[app\] loaded module \[analysis-common\] \[2019-05…

---

## [HCP 1.9.1 Installation and demo, No results found in Kibana](https://discuss.elastic.co/t/hcp-1-9-1-installation-and-demo-no-results-found-in-kibana/180308)

<div class="topic-metadata">

**Author:** [@deodion](https://discuss.elastic.co/u/deodion)\
**Replies:** 3\
**Last updated:** [May 9, 2019, 2:17pm UTC](https://discuss.elastic.co/t/hcp-1-9-1-installation-and-demo-no-results-found-in-kibana/180308 "2019-05-09T14:17:28Z")

</div>

Since this situation feels like related to elasticsearch index, I post it here, I have installed and working HCP 1.9.1 After that, when I try the learning and training tutorial described at: https://docs.hortonworks.c…

---

## [ElasticSearch : Unknown key for a VALUE\_STRING in \[index\]](https://discuss.elastic.co/t/elasticsearch-unknown-key-for-a-value-string-in-index/180380)

<div class="topic-metadata">

**Author:** [@Ankur\_Kumar1](https://discuss.elastic.co/u/Ankur_Kumar1)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 2:03pm UTC](https://discuss.elastic.co/t/elasticsearch-unknown-key-for-a-value-string-in-index/180380 "2019-05-09T14:03:19Z")

</div>

My code written in nodejs import elasticsearch from 'elasticsearch'; const elasticClient = new elasticsearch.Client({ host: es\_host }) let body = let \_query = { "size": 1, "query": { "match": {"item\_id" : 1} …

---

## [Not getting exact completions as expected](https://discuss.elastic.co/t/not-getting-exact-completions-as-expected/180372)

<div class="topic-metadata">

**Author:** [@tarunnar](https://discuss.elastic.co/u/tarunnar)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 1:17pm UTC](https://discuss.elastic.co/t/not-getting-exact-completions-as-expected/180372 "2019-05-09T13:17:47Z")

</div>

I have defined my mapping for index autocomplete as { "mappings": { "panels": { "properties": { "dealer": { "type": "completion" }, "county": { "type": "completion", "contexts": \[{ …

---

## [There is a dataloss when data is been pushed to ElasticSearch via Fluentd](https://discuss.elastic.co/t/there-is-a-dataloss-when-data-is-been-pushed-to-elasticsearch-via-fluentd/180365)

<div class="topic-metadata">

**Author:** [@Varun\_S](https://discuss.elastic.co/u/Varun_S)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 1:11pm UTC](https://discuss.elastic.co/t/there-is-a-dataloss-when-data-is-been-pushed-to-elasticsearch-via-fluentd/180365 "2019-05-09T13:11:21Z")

</div>

HI , I am using ElasticSearch With fluentd with Below configuration in Kubernetes environment. ElasticSearch Configuration:- belk-elasticsearch: elasticsearch\_master: replicas: 3 no\_of\_masters: 2 resources: limi…

---

## [Error at updating ES index using JS API](https://discuss.elastic.co/t/error-at-updating-es-index-using-js-api/180356)

<div class="topic-metadata">

**Author:** [@matheusribeirogarcia](https://discuss.elastic.co/u/matheusribeirogarcia)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 12:43pm UTC](https://discuss.elastic.co/t/error-at-updating-es-index-using-js-api/180356 "2019-05-09T12:43:11Z")

</div>

Basically I have this function: this.es.update({ index: 'contentman', type: 'sites', id: "\_id", body: { name: form.value.name, …

---

## [Ingest Node: Adding new Objects?](https://discuss.elastic.co/t/ingest-node-adding-new-objects/180189)

<div class="topic-metadata">

**Author:** [@PeterPain](https://discuss.elastic.co/u/PeterPain)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 12:31pm UTC](https://discuss.elastic.co/t/ingest-node-adding-new-objects/180189 "2019-05-09T12:31:37Z")

</div>

Hey there ! Im pulling data from a device via http-module (metricbeat). Unfortunately the Data is put in mixed datatypes within one array (elasticsearch doesn't support these types of arrays) First Example {"\_P\_SUM3"…

---

## [Same results over scrolling in elastic search](https://discuss.elastic.co/t/same-results-over-scrolling-in-elastic-search/180349)

<div class="topic-metadata">

**Author:** [@tarunnar](https://discuss.elastic.co/u/tarunnar)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 11:40am UTC](https://discuss.elastic.co/t/same-results-over-scrolling-in-elastic-search/180349 "2019-05-09T11:40:21Z")

</div>

\#elasticsearch #scroll #completion suggestion I am getting the same results when scrolling through the results of elastic search when I am using scroll request is giving me the same \_scroll\_id in response. I am not ge…

---

## [ElasticSearch Java Client and OffestDateTime](https://discuss.elastic.co/t/elasticsearch-java-client-and-offestdatetime/180322)

<div class="topic-metadata">

**Author:** [@mdoh](https://discuss.elastic.co/u/mdoh)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 11:07am UTC](https://discuss.elastic.co/t/elasticsearch-java-client-and-offestdatetime/180322 "2019-05-09T11:07:20Z")

</div>

Hi, I updated my elasticsearch java client from 6.2.4 to 6.4. Now I got an exception Exception in thread "main" java.lang.IllegalArgumentException: cannot write xcontent for unknown value of type class java.time.Offse…

---

## [What is X-Content folder in the libs section?](https://discuss.elastic.co/t/what-is-x-content-folder-in-the-libs-section/180203)

<div class="topic-metadata">

**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 10:10am UTC](https://discuss.elastic.co/t/what-is-x-content-folder-in-the-libs-section/180203 "2019-05-09T10:10:37Z")

</div>

I would like to know what are the purposes of following in the libs folder of elasticsearch github project. dissect geo groc x-content

---

## [Why my elasticsearch index has a lot deleted doc?](https://discuss.elastic.co/t/why-my-elasticsearch-index-has-a-lot-deleted-doc/180110)

<div class="topic-metadata">

**Author:** [@Haitianisgood](https://discuss.elastic.co/u/Haitianisgood)\
**Replies:** 4\
**Last updated:** [May 9, 2019, 10:09am UTC](https://discuss.elastic.co/t/why-my-elasticsearch-index-has-a-lot-deleted-doc/180110 "2019-05-09T10:09:37Z")

</div>

env: elasticsearch 6.2.4 My application just has insert operations，but my elasticsearch index has a lot deleted doc when I check elasticsearch status? { "primaries": { "docs": { "count": 1044318, "deleted": 34382 }, "…

---

## [Elasticsearch monitoring no data in Nodes view](https://discuss.elastic.co/t/elasticsearch-monitoring-no-data-in-nodes-view/180104)

<div class="topic-metadata">

**Author:** [@Jehutywong](https://discuss.elastic.co/u/Jehutywong)\
**Replies:** 3\
**Last updated:** [May 9, 2019, 10:09am UTC](https://discuss.elastic.co/t/elasticsearch-monitoring-no-data-in-nodes-view/180104 "2019-05-09T10:09:08Z")

</div>

I recently upgraded my ES cluster from 6.3 to 7.0. Everything goes well so far, but in monitoring-\> nodes, the table list show "No items found", other views in monitoring works though. What am I missing?

---

## [How to send Query output as an Email](https://discuss.elastic.co/t/how-to-send-query-output-as-an-email/180268)

<div class="topic-metadata">

**Author:** [@jskharay](https://discuss.elastic.co/u/jskharay)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 10:01am UTC](https://discuss.elastic.co/t/how-to-send-query-output-as-an-email/180268 "2019-05-09T10:01:43Z")

</div>

Hi Everyone, I'm stuck at an simple query. Thing is that we need to send an alert email to administrator if there are more than 3 exception came into process. Exceptions are covered under TransactionStatus key in json. …

---

## [SSL fatal error in ES logs](https://discuss.elastic.co/t/ssl-fatal-error-in-es-logs/180208)

<div class="topic-metadata">

**Author:** [@bkasrai](https://discuss.elastic.co/u/bkasrai)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 9:56am UTC](https://discuss.elastic.co/t/ssl-fatal-error-in-es-logs/180208 "2019-05-09T09:56:40Z")

</div>

Good morning-I am seeing errors in my ES logs on a specific node (no other node within the cluster is reporting this) with regards to SSL fatal error-bad certificate (actual log information is below) This one is a bit tr…

---

## [Dedicated replica nodes](https://discuss.elastic.co/t/dedicated-replica-nodes/180321)

<div class="topic-metadata">

**Author:** [@sambodhi](https://discuss.elastic.co/u/sambodhi)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 9:32am UTC](https://discuss.elastic.co/t/dedicated-replica-nodes/180321 "2019-05-09T09:32:34Z")

</div>

We have two use cases, forcing us to think about autoscaling in a way that we can have more nodes which have only replica shards. We use spot instances which can recycle (change) instance once a month. If these instanc…

---

## [Getting Elasticsearch url from kibana](https://discuss.elastic.co/t/getting-elasticsearch-url-from-kibana/179974)

<div class="topic-metadata">

**Author:** [@vishwas\_php](https://discuss.elastic.co/u/vishwas_php)\
**Replies:** 2\
**Last updated:** [May 7, 2019, 1:49pm UTC](https://discuss.elastic.co/t/getting-elasticsearch-url-from-kibana/179974 "2019-05-07T13:49:26Z")

</div>

My client have installed the elasticsearch on a server and given me the credentials for kibana for that server elasticsearch. Now, I have to add indices and data in that. But, I don't have the elasticsearch url to config…

---

## [Elasticsearch search performance](https://discuss.elastic.co/t/elasticsearch-search-performance/180130)

<div class="topic-metadata">

**Author:** [@flyniumeng](https://discuss.elastic.co/u/flyniumeng)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 11:23pm UTC](https://discuss.elastic.co/t/elasticsearch-search-performance/180130 "2019-05-08T23:23:28Z")

</div>

hi, I use elasticsearch-py to search doc in elasticsearch . when i try to search doc under concurrent conditions , the time consumerd increased . I computed and traced the time consumed by urllib3(elasticsearch-py d…

---

## [Accuracy of elastic search aggregation (sum) when number of unique values in greater than a million](https://discuss.elastic.co/t/accuracy-of-elastic-search-aggregation-sum-when-number-of-unique-values-in-greater-than-a-million/180141)

<div class="topic-metadata">

**Author:** [@Prashant\_Priyadarshi](https://discuss.elastic.co/u/Prashant_Priyadarshi)\
**Replies:** 9\
**Last updated:** [May 9, 2019, 8:46am UTC](https://discuss.elastic.co/t/accuracy-of-elastic-search-aggregation-sum-when-number-of-unique-values-in-greater-than-a-million/180141 "2019-05-09T08:46:41Z")

</div>

Hi, I am new to elastic search. lets suppose I have elastic search documents with 3 fields: date, user\_id, money\_spent. I have around 10 million such documents and number of unique user\_id 's is greater than 1 million…

---

## [Is there any NEST tool to convert sql query to DSL](https://discuss.elastic.co/t/is-there-any-nest-tool-to-convert-sql-query-to-dsl/180297)

<div class="topic-metadata">

**Author:** [@emir](https://discuss.elastic.co/u/emir)\
**Replies:** 3\
**Last updated:** [May 9, 2019, 8:39am UTC](https://discuss.elastic.co/t/is-there-any-nest-tool-to-convert-sql-query-to-dsl/180297 "2019-05-09T08:39:35Z")

</div>

Hi, I'm quite new for document databases and DSL queries. I would like to achieve to create a dynamic filter queries with AND and OR conditions. I've used the NEST library to achieve that but it does not work as well …

---

## [How to completely remove indices from disks after shard filtering definition](https://discuss.elastic.co/t/how-to-completely-remove-indices-from-disks-after-shard-filtering-definition/180309)

<div class="topic-metadata">

**Author:** [@aqiank](https://discuss.elastic.co/u/aqiank)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 8:27am UTC](https://discuss.elastic.co/t/how-to-completely-remove-indices-from-disks-after-shard-filtering-definition/180309 "2019-05-09T08:27:39Z")

</div>

Hi, I wanted to create a simple two-node hot-warm cluster for quick experimentation. One ("warm") with already 100+GB of sample data and the other ("hot") with zero data initially. But I forgot to set shard filtering for…

---

## [Elasticsearch not reachable from webapp and kibana containers](https://discuss.elastic.co/t/elasticsearch-not-reachable-from-webapp-and-kibana-containers/180310)

<div class="topic-metadata">

**Author:** [@paulrusu8](https://discuss.elastic.co/u/paulrusu8)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 8:26am UTC](https://discuss.elastic.co/t/elasticsearch-not-reachable-from-webapp-and-kibana-containers/180310 "2019-05-09T08:26:28Z")

</div>

I have a docker-compose.yml file which declares webapp, postgres database, a two node elasticsearch, and a kibana container. version: '3' services: webapp: build: context: ../../../ dockerfile: config/…

---

## [How to calculate the throughput for search operation in Elasticsearch by using Rally](https://discuss.elastic.co/t/how-to-calculate-the-throughput-for-search-operation-in-elasticsearch-by-using-rally/180306)

<div class="topic-metadata">

**Author:** [@suvarna](https://discuss.elastic.co/u/suvarna)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 7:54am UTC](https://discuss.elastic.co/t/how-to-calculate-the-throughput-for-search-operation-in-elasticsearch-by-using-rally/180306 "2019-05-09T07:54:24Z")

</div>

Hi We are using Elasticsearch as search engine and esrally as load generator to Elasticsearch. The esrally is providing following details.. All,Min Throughput,relative-kibana-content\_issues-dashboard\_50%,0.03,ops/s A…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1304)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1306)
