# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1021 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1022 --- ## [Beat ILM Problems](https://discuss.elastic.co/t/beat-ilm-problems/218636)
**Author:** [@Ali\_Szoenyi](https://discuss.elastic.co/u/Ali_Szoenyi)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 4:32pm UTC](https://discuss.elastic.co/t/beat-ilm-problems/218636 "2020-02-10T16:32:04Z")
Dear All. I have following configuration. Elasticsearch Version 7.4.0 We have several beats in use. filebeat, metricbeat, packetbeat, auditbeat and heartbeat We have following to communication streams from the beats… --- ## [Nodes crashing with unable to create native thread error](https://discuss.elastic.co/t/nodes-crashing-with-unable-to-create-native-thread-error/216701)
**Author:** [@SpeedDaemon](https://discuss.elastic.co/u/SpeedDaemon)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 4:19pm UTC](https://discuss.elastic.co/t/nodes-crashing-with-unable-to-create-native-thread-error/216701 "2020-02-10T16:19:45Z")
I have an elastic cluster that had some nodes crash due to the "java.lang.OutOfMemoryError: unable to create native thread" error. Found some other posts here with the same error, but no useful information yet. The clus… --- ## [Cant get text on a START\_OBJECT failure to parse](https://discuss.elastic.co/t/cant-get-text-on-a-start-object-failure-to-parse/218617)
**Author:** [@Chris\_Broll](https://discuss.elastic.co/u/Chris_Broll)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 3:04pm UTC](https://discuss.elastic.co/t/cant-get-text-on-a-start-object-failure-to-parse/218617 "2020-02-10T15:04:26Z")
Just noticed an error in Logstash that pointed to a problem in elasticsearch. Looking at the elasticsearch log I can see the following stacktrace: \[2020-02-10T13:38:09,559\]\[DEBUG\]\[o.e.a.b.TransportShardBulkAction\] \[farg… --- ## [Hardware suggestions for docker implementations? How to make the best of my situation?](https://discuss.elastic.co/t/hardware-suggestions-for-docker-implementations-how-to-make-the-best-of-my-situation/218615)
**Author:** [@fallenreaper](https://discuss.elastic.co/u/fallenreaper)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 2:58pm UTC](https://discuss.elastic.co/t/hardware-suggestions-for-docker-implementations-how-to-make-the-best-of-my-situation/218615 "2020-02-10T14:58:48Z")
Right now, I need a 1-time ingestion of about 4tb of data, to make it queryable. My largest piece of hardware is my gaming rig, 16 core, 64 gig ram, 27T disc space, etc. Sadly it is running Windows 10 Home, and I would… --- ## [All fields are dropped that arent date fields](https://discuss.elastic.co/t/all-fields-are-dropped-that-arent-date-fields/218614)
**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 2:50pm UTC](https://discuss.elastic.co/t/all-fields-are-dropped-that-arent-date-fields/218614 "2020-02-10T14:50:49Z")
Hi, I am having issues over the past few days where every single field is being dropped in a document that is not a "date" field. Any ideas why this could be the case? Example: { "\_index": "tid.496e3cfd-672c-47ae-9… --- ## [How can I delete all the duplicate records except one to keep my data?](https://discuss.elastic.co/t/how-can-i-delete-all-the-duplicate-records-except-one-to-keep-my-data/218553)
**Author:** [@arhneim](https://discuss.elastic.co/u/arhneim)\ **Replies:** 12\ **Last updated:** [February 10, 2020, 2:54pm UTC](https://discuss.elastic.co/t/how-can-i-delete-all-the-duplicate-records-except-one-to-keep-my-data/218553 "2020-02-10T14:54:58Z")
Hello I'm new to ElasticSearch. The project I'm going to show you here is a study project. I could use your help to deduplicate records that have been registered 10 times during half a day. I tried different things tha… --- ## [Automatic plugin update on package update](https://discuss.elastic.co/t/automatic-plugin-update-on-package-update/218612)
**Author:** [@mtrojan](https://discuss.elastic.co/u/mtrojan)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 2:49pm UTC](https://discuss.elastic.co/t/automatic-plugin-update-on-package-update/218612 "2020-02-10T14:49:30Z")
Dear Community, we ran into this kind of error multiple times: Plugin \[analysis-icu\] was built for Elasticsearch version 7.5.0 but version 7.5.2 is running So we had an Elasticsearch installation in CentOS 8 dnf i… --- ## [CPU at 100% with XPACK security Enabled - ES 7.3](https://discuss.elastic.co/t/cpu-at-100-with-xpack-security-enabled-es-7-3/214544)
**Author:** [@nsoni](https://discuss.elastic.co/u/nsoni)\ **Replies:** 3\ **Last updated:** [February 10, 2020, 2:20pm UTC](https://discuss.elastic.co/t/cpu-at-100-with-xpack-security-enabled-es-7-3/214544 "2020-02-10T14:20:32Z")
I am using elasticsearch 7.3 cluster which consists of 3 Master, 10 Data nodes The cluster contains almost 100 active index and 10,000 aliases to write on the index. Cluster load is almost 15-20k bulk ingestion per m… --- ## [Elastic Search Inverted Indexes + Dynamic mappings](https://discuss.elastic.co/t/elastic-search-inverted-indexes-dynamic-mappings/218580)
**Author:** [@andresribeiro1996](https://discuss.elastic.co/u/andresribeiro1996)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 2:16pm UTC](https://discuss.elastic.co/t/elastic-search-inverted-indexes-dynamic-mappings/218580 "2020-02-10T14:16:21Z")
Hey, i have some doubts about elastic performance in this scenario: So we have index Contacts, and we want to insert docs that have dynamic searchable data into this index, e.g: contactA has 3 fields, name, age, addres… --- ## [Reindexing data in a cluster serving live traffic](https://discuss.elastic.co/t/reindexing-data-in-a-cluster-serving-live-traffic/218594)
**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 1:16pm UTC](https://discuss.elastic.co/t/reindexing-data-in-a-cluster-serving-live-traffic/218594 "2020-02-10T13:16:59Z")
Hi, We have a cluster today with 3 master, client and 5 data nodes which is serving live traffic We are planning to expand the cluster to 15 data nodes because we are migrating another feature (which is pretty big with… --- ## [BUG - Sum bucket aggregation always returning zero](https://discuss.elastic.co/t/bug-sum-bucket-aggregation-always-returning-zero/218152)
**Author:** [@wiouser](https://discuss.elastic.co/u/wiouser)\ **Replies:** 2\ **Last updated:** [February 10, 2020, 1:04pm UTC](https://discuss.elastic.co/t/bug-sum-bucket-aggregation-always-returning-zero/218152 "2020-02-10T13:04:34Z")
Hi, I am trying to do a sum bucket using pipeline aggregation path separator. But sum bucket value is always zero. It doesn't even throw an error. I don't have any zero values in my data. { "size": 0, "aggs": { … --- ## [Null\_pointer\_exception](https://discuss.elastic.co/t/null-pointer-exception/218487)
**Author:** [@pawelks](https://discuss.elastic.co/u/pawelks)\ **Replies:** 4\ **Last updated:** [February 10, 2020, 12:31pm UTC](https://discuss.elastic.co/t/null-pointer-exception/218487 "2020-02-10T12:31:07Z")
Hello. I'm a newbie in elasticsearch and I have a strange elastic search behaviour. Could someone explain me why belowed query sometimes works and sometimes didnt work? This query should for current date found records. I… --- ## [Progress on update](https://discuss.elastic.co/t/progress-on-update/218583)
**Author:** [@A\_Mightiev](https://discuss.elastic.co/u/A_Mightiev)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 12:24pm UTC](https://discuss.elastic.co/t/progress-on-update/218583 "2020-02-10T12:24:41Z")
Hi I am updating by query an index it has millions of documents, I am constantly checking the count of total documents Vs the documents already done. Is there a way to do a visualization in kibana for that? basically a… --- ## [Cannot PUT Nginx access default pipeline to Elastic](https://discuss.elastic.co/t/cannot-put-nginx-access-default-pipeline-to-elastic/218556)
**Author:** [@stevizik](https://discuss.elastic.co/u/stevizik)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 10:07am UTC](https://discuss.elastic.co/t/cannot-put-nginx-access-default-pipeline-to-elastic/218556 "2020-02-10T10:07:36Z")
Hi, i want to modify the default Nginx Access pipeline in order to add new fields. In order to test the pipeline before using it to my Production environment i though of creating a new pipeline and test using this one. … --- ## [Any suggestion to encrypt data per index with different keys and do full text search](https://discuss.elastic.co/t/any-suggestion-to-encrypt-data-per-index-with-different-keys-and-do-full-text-search/218499)
**Author:** [@yuecong](https://discuss.elastic.co/u/yuecong)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 10:04am UTC](https://discuss.elastic.co/t/any-suggestion-to-encrypt-data-per-index-with-different-keys-and-do-full-text-search/218499 "2020-02-10T10:04:28Z")
Is it possible to do full-text search on indexes encrypted using different keys? e.g. If I want to use one ES cluster for different customers who have different keys to encrypt their data. --- ## [Unable to form cluster in GCP with discovery-gce plugin](https://discuss.elastic.co/t/unable-to-form-cluster-in-gcp-with-discovery-gce-plugin/218293)
**Author:** [@Kumar\_Pratyush](https://discuss.elastic.co/u/Kumar_Pratyush)\ **Replies:** 16\ **Last updated:** [February 10, 2020, 9:50am UTC](https://discuss.elastic.co/t/unable-to-form-cluster-in-gcp-with-discovery-gce-plugin/218293 "2020-02-10T09:50:12Z")
I am trying to setup an 3-node ES cluster in GCP over 3 VM instances. I have created the 3 VMs and am trying to setup ES in each using docker-compose referring to the original ES documentation. Yet, I am unable to form c… --- ## [Date Field Issue in kibana filtering](https://discuss.elastic.co/t/date-field-issue-in-kibana-filtering/218276)
**Author:** [@Sangeetha\_Sivaji](https://discuss.elastic.co/u/Sangeetha_Sivaji)\ **Replies:** 3\ **Last updated:** [February 10, 2020, 9:46am UTC](https://discuss.elastic.co/t/date-field-issue-in-kibana-filtering/218276 "2020-02-10T09:46:15Z")
Hi, In kibana, when I tried to filter the date field, it is not filtering and showing the error message. PFB the error. Error: Request to Elasticsearch failed: {"error":{"root\_cause":\[{"type":"parse\_exception","reason"… --- ## [Rank Exact Phrase Match above All Words](https://discuss.elastic.co/t/rank-exact-phrase-match-above-all-words/218544)
**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 8:48am UTC](https://discuss.elastic.co/t/rank-exact-phrase-match-above-all-words/218544 "2020-02-10T08:48:15Z")
Searching for "cap screw M6x" brings a result with the exact phrase lower down in the ranking than another phrase with all words in the wrong order. "\_score": 18.250565, "text\_en": "Screw M6X 16 Skt Cap Ss", "\_score": … --- ## [ESRally Parallel Tasks start after x seconds](https://discuss.elastic.co/t/esrally-parallel-tasks-start-after-x-seconds/218530)
**Author:** [@dbakti7](https://discuss.elastic.co/u/dbakti7)\ **Replies:** 2\ **Last updated:** [February 10, 2020, 7:59am UTC](https://discuss.elastic.co/t/esrally-parallel-tasks-start-after-x-seconds/218530 "2020-02-10T07:59:56Z")
Hi! Is there any way in Rally to specify multiple tasks in parallel with some tasks only starting after x seconds? For example, having indexing and search tasks in parallel, but I want search to be performed after some… --- ## [How to find intersection of multiple queries](https://discuss.elastic.co/t/how-to-find-intersection-of-multiple-queries/218525)
**Author:** [@ankitwandx](https://discuss.elastic.co/u/ankitwandx)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 7:15am UTC](https://discuss.elastic.co/t/how-to-find-intersection-of-multiple-queries/218525 "2020-02-10T07:15:44Z")
My record looks like this: user\_uuid, keywords, timestamp I need to find out the list of user\_uuids who searched for given keywords within a given timestamp. However, there can be multiple conditions for finding use… --- ## [Throughput "docs/s" vs "ops/s"?](https://discuss.elastic.co/t/throughput-docs-s-vs-ops-s/218242)
**Author:** [@Chris1234](https://discuss.elastic.co/u/Chris1234)\ **Replies:** 3\ **Last updated:** [February 10, 2020, 7:31am UTC](https://discuss.elastic.co/t/throughput-docs-s-vs-ops-s/218242 "2020-02-10T07:31:22Z")
I've been running Rally (which is great thank you!) on clusters to test different setups. I've been watching the Throughput results as a rough "This is faster/slower" indicator. It's reported in "docs/s" for all the ru… --- ## [Order of results inconsistent between similar indices and same data set](https://discuss.elastic.co/t/order-of-results-inconsistent-between-similar-indices-and-same-data-set/218381)
**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 7:12am UTC](https://discuss.elastic.co/t/order-of-results-inconsistent-between-similar-indices-and-same-data-set/218381 "2020-02-10T07:12:12Z")
I have 2 identical indices with similar (overlapping) data though one index has more data. I am getting the same documents in each index with the same query with a different order. When I search for "foo" (boost 2) and … --- ## [How to give s3 client and server certificates to s3 repository client](https://discuss.elastic.co/t/how-to-give-s3-client-and-server-certificates-to-s3-repository-client/218518)
**Author:** [@bikkina\_mahesh](https://discuss.elastic.co/u/bikkina_mahesh)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 6:42am UTC](https://discuss.elastic.co/t/how-to-give-s3-client-and-server-certificates-to-s3-repository-client/218518 "2020-02-10T06:42:44Z")
I am trying to create s3 client PUT \_snapshot/my\_s3\_repository { "type": "s3", "settings": { "bucket": "test1", "endpoint": "s3.tally.com", "access\_key": "", "secret\_key": "" } } Getting following error { "e… --- ## [Import response from kibana](https://discuss.elastic.co/t/import-response-from-kibana/218521)
**Author:** [@Saraalk](https://discuss.elastic.co/u/Saraalk)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 6:38am UTC](https://discuss.elastic.co/t/import-response-from-kibana/218521 "2020-02-10T06:38:26Z")
I am new in elastic search and kibana, i run some test in my cloud to test the healthiness of it. in Kibana dashboard i get some table which measure test performance and the average timing, min ,max. i have found from i… --- ## [Group indexes multi searching?](https://discuss.elastic.co/t/group-indexes-multi-searching/218477)
**Author:** [@elink12](https://discuss.elastic.co/u/elink12)\ **Replies:** 4\ **Last updated:** [February 10, 2020, 6:28am UTC](https://discuss.elastic.co/t/group-indexes-multi-searching/218477 "2020-02-10T06:28:48Z")
Hi, I have 5 indexes with identical properties. How do I get 10 best results from each index when multi searching? $search = \[ 'index' =\> 'table\_\*', 'body' =\> \[ 'size' =\> '10', 'query' =\> \[ … --- ## [Securt in kibana](https://discuss.elastic.co/t/securt-in-kibana/218468)
**Author:** [@Andreas\_Bakopoulos1](https://discuss.elastic.co/u/Andreas_Bakopoulos1)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 6:16am UTC](https://discuss.elastic.co/t/securt-in-kibana/218468 "2020-02-10T06:16:07Z")
Hello, I am trying to setup the basic authentication in kibana but it seems that something is wrong. More specifically, I have six elasticsearch notes and the version of the elastic is the 7.2 Following the recommen… --- ## [Elastic.elasticsearch role and Ansible Tower Dynamic Inventory](https://discuss.elastic.co/t/elastic-elasticsearch-role-and-ansible-tower-dynamic-inventory/218269)
**Author:** [@mudricd](https://discuss.elastic.co/u/mudricd)\ **Replies:** 1\ **Last updated:** [February 10, 2020, 5:55am UTC](https://discuss.elastic.co/t/elastic-elasticsearch-role-and-ansible-tower-dynamic-inventory/218269 "2020-02-10T05:55:13Z")
Hi, I am trying to configure Elasticsearch cluster over Ansible using official Elastic Ansible role elastic.elasticsearch. I set up Ansible tower and Dynamic Inventory for my AWS instances. I tagged my instances and hav… --- ## [Solution Design](https://discuss.elastic.co/t/solution-design/218510)
**Author:** [@Shalinicts](https://discuss.elastic.co/u/Shalinicts)\ **Replies:** 0\ **Last updated:** [February 10, 2020, 5:22am UTC](https://discuss.elastic.co/t/solution-design/218510 "2020-02-10T05:22:21Z")
What would be the good solution to monitor application and infra logs of servers implemented in GCP . Considering server count ~500 servers (Most of them RHEL 6.x) Logs:Infra Logs , 2 Application Logs per server Will … --- ## [How to deal with password in watcher](https://discuss.elastic.co/t/how-to-deal-with-password-in-watcher/218497)
**Author:** [@janice](https://discuss.elastic.co/u/janice)\ **Replies:** 3\ **Last updated:** [February 10, 2020, 4:39am UTC](https://discuss.elastic.co/t/how-to-deal-with-password-in-watcher/218497 "2020-02-10T04:39:34Z")
I am using watcher with webhook to login an IM tool which can only put username and password in payload as a SOAP message. Thus, I cannot benefit from password field encryption in HTTP basic authentication block. May I… --- ## [Search requests for an exact mach on a value with ampersand](https://discuss.elastic.co/t/search-requests-for-an-exact-mach-on-a-value-with-ampersand/218260)
**Author:** [@StephenGoodall](https://discuss.elastic.co/u/StephenGoodall)\ **Replies:** 6\ **Last updated:** [February 10, 2020, 12:18am UTC](https://discuss.elastic.co/t/search-requests-for-an-exact-mach-on-a-value-with-ampersand/218260 "2020-02-10T00:18:01Z")
Hi all, I'm trying to resolve an issue we have where the field has an ampersand. I did a search on a different field (field\_id)and found this document (edited to remove most of it): { "\_index": "index\_v1",… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1020) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1022)