# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=660 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 661 --- ## [Elasticsearch bulk Ingestion](https://discuss.elastic.co/t/elasticsearch-bulk-ingestion/270754)
**Author:** [@Rokshan\_Jahan](https://discuss.elastic.co/u/Rokshan_Jahan)\ **Replies:** 3\ **Last updated:** [April 21, 2021, 10:29pm UTC](https://discuss.elastic.co/t/elasticsearch-bulk-ingestion/270754 "2021-04-21T22:29:52Z")
Hi, I have 7 TB ( 32 billion records) to ingest in elastic search. What would be the best elastic search configuration we can use to load these data quickly. --- ## [How are "applications" supposed to be used in context of the create/update application privileges api?](https://discuss.elastic.co/t/how-are-applications-supposed-to-be-used-in-context-of-the-create-update-application-privileges-api/269594)
**Author:** [@fletches](https://discuss.elastic.co/u/fletches)\ **Replies:** 5\ **Last updated:** [April 21, 2021, 9:01pm UTC](https://discuss.elastic.co/t/how-are-applications-supposed-to-be-used-in-context-of-the-create-update-application-privileges-api/269594 "2021-04-21T21:01:22Z")
I'm new to Elasticsearch. We have the need for multiple applications to share the same cluster and restrict indices privileges to those owned by that team. I see the application api to create/update application privileg… --- ## [Monitoring Elasticsearch with metricbeats 7.9.2](https://discuss.elastic.co/t/monitoring-elasticsearch-with-metricbeats-7-9-2/270903)
**Author:** [@frankfoti](https://discuss.elastic.co/u/frankfoti)\ **Replies:** 0\ **Last updated:** [April 21, 2021, 8:35pm UTC](https://discuss.elastic.co/t/monitoring-elasticsearch-with-metricbeats-7-9-2/270903 "2021-04-21T20:35:32Z")
I followed the steps to switch to metricbeat monitoring but still not working in kibana: Metricbeat quick start: installation and configuration | Metricbeat Reference \[7.9\] | Elastic metricbeat-\* index pattern exists … --- ## [Reproduce 206 Partial result](https://discuss.elastic.co/t/reproduce-206-partial-result/270875)
**Author:** [@theredcat](https://discuss.elastic.co/u/theredcat)\ **Replies:** 3\ **Last updated:** [April 21, 2021, 7:08pm UTC](https://discuss.elastic.co/t/reproduce-206-partial-result/270875 "2021-04-21T19:08:08Z")
Hi, I had a problem in production that seems related to a 206 partial response being returned when I restarted one of my node for maintenance. I'm trying to reproduce this but I had no luck for now. Is there any proced… --- ## [Date field mapping error with type \[date\] to \[long\]](https://discuss.elastic.co/t/date-field-mapping-error-with-type-date-to-long/270766)
**Author:** [@Lorenzo\_Zuluaga](https://discuss.elastic.co/u/Lorenzo_Zuluaga)\ **Replies:** 12\ **Last updated:** [April 21, 2021, 1:45am UTC](https://discuss.elastic.co/t/date-field-mapping-error-with-type-date-to-long/270766 "2021-04-21T01:45:10Z")
Hi, I'm currently having a strange issue and I can't find anything related to it. I have an elasticsearch cluster for my production environment with 3 nodes. Recently I created a single-node cluster for my staging enviro… --- ## [Filebeat with Suricata module](https://discuss.elastic.co/t/filebeat-with-suricata-module/270863)
**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\ **Replies:** 0\ **Last updated:** [April 21, 2021, 3:13pm UTC](https://discuss.elastic.co/t/filebeat-with-suricata-module/270863 "2021-04-21T15:13:46Z")
Hi there! Here is my question. I have Filebeat sending Suricata logs directly to Elasticsearch (via Suricata module). My Suricata log files are divided by types of events (eve-alerts, eve-dns, eve-events). In Kibana is… --- ## [Create instance of elasticsearch](https://discuss.elastic.co/t/create-instance-of-elasticsearch/270831)
**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\ **Replies:** 6\ **Last updated:** [April 21, 2021, 12:14pm UTC](https://discuss.elastic.co/t/create-instance-of-elasticsearch/270831 "2021-04-21T12:14:49Z")
Hi I have a cluster with 4 nodes of Elasticsearch. 2 of them are in datacenter A and the other 2 are in datacenter B Here is my concern: I want to run an instance of each node in another datacenter. For example node1 … --- ## [Data too large circuit breaking exception after migrating to 7.12](https://discuss.elastic.co/t/data-too-large-circuit-breaking-exception-after-migrating-to-7-12/269029)
**Author:** [@voharunado](https://discuss.elastic.co/u/voharunado)\ **Replies:** 3\ **Last updated:** [April 21, 2021, 12:10pm UTC](https://discuss.elastic.co/t/data-too-large-circuit-breaking-exception-after-migrating-to-7-12/269029 "2021-04-21T12:10:45Z")
Hello, We have just migrated our cluster from 6.8 to 7.12 and just noticed some recurring errors during intensive parallel indexations. Here is the kind of error we have: \[parent\] Data too large, data for \[\ **Author:** [@arcturuscom](https://discuss.elastic.co/u/arcturuscom)\ **Replies:** 13\ **Last updated:** [April 21, 2021, 11:15am UTC](https://discuss.elastic.co/t/collapse-with-multi-value/270437 "2021-04-21T11:15:16Z") Hello, i tried to collapse multivalued field and its doesnt work e.g: "field": \[id1, id2, id3\] i'm asking if there's a workaround to solve this issue. any suggestions please !! --- ## [Stop the search request once it finds first 10 hits](https://discuss.elastic.co/t/stop-the-search-request-once-it-finds-first-10-hits/270783)
**Author:** [@DEEPTHI\_SONA\_G](https://discuss.elastic.co/u/DEEPTHI_SONA_G)\ **Replies:** 8\ **Last updated:** [April 21, 2021, 9:02am UTC](https://discuss.elastic.co/t/stop-the-search-request-once-it-finds-first-10-hits/270783 "2021-04-21T09:02:35Z")
I am doing some performance testing on Elasticsearch. So I am comparing Oracle db with Elasticsearch. The Oracle query is able to stop it's search once it finds the first 10matches by using the code select \* from mtd\_s… --- ## [Kibana transform latest continously not updating](https://discuss.elastic.co/t/kibana-transform-latest-continously-not-updating/268739)
**Author:** [@charles97](https://discuss.elastic.co/u/charles97)\ **Replies:** 2\ **Last updated:** [April 21, 2021, 7:50am UTC](https://discuss.elastic.co/t/kibana-transform-latest-continously-not-updating/268739 "2021-04-21T07:50:07Z")
Hi everyone, so I'm trying on the latest transform. I have 3 files. Those are: name, status, tgl. I will ingest data1 and data2 at the same time to index transformtest then I will create transformation index transfor… --- ## [Hot-warm search question](https://discuss.elastic.co/t/hot-warm-search-question/270778)
**Author:** [@abhishekc92](https://discuss.elastic.co/u/abhishekc92)\ **Replies:** 2\ **Last updated:** [April 21, 2021, 2:26am UTC](https://discuss.elastic.co/t/hot-warm-search-question/270778 "2021-04-21T02:26:53Z")
Hi, I have a pretty basic question around how search functions under the hood. I am evaluating a hot-warm architecture on aws (SSD, S3 backed respectively). Our use case is such that some searches may have to be issued a… --- ## [Supporting very high number of query terms a good idea?](https://discuss.elastic.co/t/supporting-very-high-number-of-query-terms-a-good-idea/270771)
**Author:** [@elastic\_yogi](https://discuss.elastic.co/u/elastic_yogi)\ **Replies:** 1\ **Last updated:** [April 20, 2021, 11:07pm UTC](https://discuss.elastic.co/t/supporting-very-high-number-of-query-terms-a-good-idea/270771 "2021-04-20T23:07:24Z")
We have a postgres table with nearly a million rows that we index into elasticsearch. We want to support a specific use case of allowing a user to copy and paste nearly 10k unique identifiers to filter for specific entri… --- ## [Elasticsearch using more RAM](https://discuss.elastic.co/t/elasticsearch-using-more-ram/270669)
**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\ **Replies:** 1\ **Last updated:** [April 20, 2021, 10:56pm UTC](https://discuss.elastic.co/t/elasticsearch-using-more-ram/270669 "2021-04-20T22:56:49Z")
my /etc/elasticsearch/jvm.options is : ## JVM configuration ################################################################ ## IMPORTANT: JVM heap size ################################################################ … --- ## [ServiceNow connector - alerts and actions, missing fields](https://discuss.elastic.co/t/servicenow-connector-alerts-and-actions-missing-fields/270576)
**Author:** [@nekirc](https://discuss.elastic.co/u/nekirc)\ **Replies:** 1\ **Last updated:** [April 20, 2021, 10:55pm UTC](https://discuss.elastic.co/t/servicenow-connector-alerts-and-actions-missing-fields/270576 "2021-04-20T22:55:58Z")
Hi, is there any chance to add some additional fields to ServiceNow connector in Alerts and Actions tab in the next Elastic version ? Would be good to have possibility to put information to below fields: Company Serv… --- ## [Multiple group\_search.base\_dn for one LDAP/AD](https://discuss.elastic.co/t/multiple-group-search-base-dn-for-one-ldap-ad/270746)
**Author:** [@ctan](https://discuss.elastic.co/u/ctan)\ **Replies:** 1\ **Last updated:** [April 20, 2021, 6:07pm UTC](https://discuss.elastic.co/t/multiple-group-search-base-dn-for-one-ldap-ad/270746 "2021-04-20T18:07:44Z")
We have two spots for groups to reside inside of AD, which are not children of the same folders (but in the same domain). I am looking for a way to have ES search them both to get the group membership, while not travers… --- ## [Hive overwhelming Elasticsearch](https://discuss.elastic.co/t/hive-overwhelming-elasticsearch/269930)
**Author:** [@albertkohl](https://discuss.elastic.co/u/albertkohl)\ **Replies:** 23\ **Last updated:** [April 20, 2021, 5:57pm UTC](https://discuss.elastic.co/t/hive-overwhelming-elasticsearch/269930 "2021-04-20T17:57:46Z")
i'm new to ES so bare with me :slight\_smile: i have a hadoop cluster running hive, and i have a table of about 441 million rows, 10 columns wide (string and bigint) i setup an external table in hive, created an index i… --- ## [Reindex API from remote server](https://discuss.elastic.co/t/reindex-api-from-remote-server/270743)
**Author:** [@cool\_aarti2](https://discuss.elastic.co/u/cool_aarti2)\ **Replies:** 0\ **Last updated:** [April 20, 2021, 4:43pm UTC](https://discuss.elastic.co/t/reindex-api-from-remote-server/270743 "2021-04-20T16:43:31Z")
Hi, We have a remote server which have some elastic indices. I would like to reindex the data from this server onto another. But I am getting the error: "type": "s\_s\_l\_handshake\_exception", "reason": "PKIX path build… --- ## [Exception : No alive nodes found in your cluster](https://discuss.elastic.co/t/exception-no-alive-nodes-found-in-your-cluster/270739)
**Author:** [@Erik\_Gevorgyan](https://discuss.elastic.co/u/Erik_Gevorgyan)\ **Replies:** 0\ **Last updated:** [April 20, 2021, 3:20pm UTC](https://discuss.elastic.co/t/exception-no-alive-nodes-found-in-your-cluster/270739 "2021-04-20T15:20:30Z")
Hi everyone, i have an issue according to elasticsearch , i am running this code php artisan index:ambassadors and it gives me Exception : No alive nodes found in your cluster here is my output Exception : No ali… --- ## [Cluster doesn't respect routing.allocation.require.data\_type](https://discuss.elastic.co/t/cluster-doesnt-respect-routing-allocation-require-data-type/270700)
**Author:** [@gorek](https://discuss.elastic.co/u/gorek)\ **Replies:** 1\ **Last updated:** [April 20, 2021, 3:11pm UTC](https://discuss.elastic.co/t/cluster-doesnt-respect-routing-allocation-require-data-type/270700 "2021-04-20T15:11:59Z")
Hi, we have cluster with 2 nodes. Every node has set data\_type attribute. One node has low disk watermark exceed. We prepared ILM policy to keep indices on one node for some time and after move it to another. Rarely … --- ## [Reverse proxy - Webseal](https://discuss.elastic.co/t/reverse-proxy-webseal/270737)
**Author:** [@kvmuralidhar](https://discuss.elastic.co/u/kvmuralidhar)\ **Replies:** 0\ **Last updated:** [April 20, 2021, 3:11pm UTC](https://discuss.elastic.co/t/reverse-proxy-webseal/270737 "2021-04-20T15:11:45Z")
Hi there, Has anyone integrated webseal (IBM Tivoli Access Manager) as reverse proxy to log into Kibana ? Thanks Murali --- ## [Surprised by deprecation of common\_terms query. What about its relevance features?](https://discuss.elastic.co/t/surprised-by-deprecation-of-common-terms-query-what-about-its-relevance-features/270416)
**Author:** [@softwaredoug](https://discuss.elastic.co/u/softwaredoug)\ **Replies:** 4\ **Last updated:** [April 20, 2021, 2:21pm UTC](https://discuss.elastic.co/t/surprised-by-deprecation-of-common-terms-query-what-about-its-relevance-features/270416 "2021-04-20T14:21:00Z")
Hi all, I was actually excited to dig into an experiment at work using the common terms query. I see however, it's been deprecated as the performance benefits are seen now in the match query, as mentioned in this issue. … --- ## [Secure access to data via NEST](https://discuss.elastic.co/t/secure-access-to-data-via-nest/270724)
**Author:** [@joaoantao](https://discuss.elastic.co/u/joaoantao)\ **Replies:** 0\ **Last updated:** [April 20, 2021, 2:06pm UTC](https://discuss.elastic.co/t/secure-access-to-data-via-nest/270724 "2021-04-20T14:06:14Z")
Currently, I am working with large indexes that contain hierarchical documents. I am trying to restrict read access to some documents (document level security) and certain fields (field level security) of those documents… --- ## [One elastic node fills up prior to the others?](https://discuss.elastic.co/t/one-elastic-node-fills-up-prior-to-the-others/269276)
**Author:** [@Jcroy](https://discuss.elastic.co/u/Jcroy)\ **Replies:** 13\ **Last updated:** [April 20, 2021, 1:48pm UTC](https://discuss.elastic.co/t/one-elastic-node-fills-up-prior-to-the-others/269276 "2021-04-20T13:48:39Z")
Am I missing a policy or something? I have a 8 node cluster. 3k Winlogbeat agents reporting in. I ran winlogbeat setup -e to get the template installed. I've reviewed logs and nothing related to allocation seems to be in… --- ## [Keep active index while deleting old indices with ILM](https://discuss.elastic.co/t/keep-active-index-while-deleting-old-indices-with-ilm/270119)
**Author:** [@Nexonus](https://discuss.elastic.co/u/Nexonus)\ **Replies:** 5\ **Last updated:** [April 20, 2021, 1:46pm UTC](https://discuss.elastic.co/t/keep-active-index-while-deleting-old-indices-with-ilm/270119 "2021-04-20T13:46:04Z")
We rebuild the same index regularly (multiple times per day) to keep our data up to date. This way we quickly generate a lot of old indices. So we thought about removing them with a policy (ILM) which deletes old indice… --- ## [Add new field in existing index and template](https://discuss.elastic.co/t/add-new-field-in-existing-index-and-template/270679)
**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\ **Replies:** 6\ **Last updated:** [April 20, 2021, 1:10pm UTC](https://discuss.elastic.co/t/add-new-field-in-existing-index-and-template/270679 "2021-04-20T13:10:59Z")
Hi, I want to add an new field in exiting index and corresponding to it's template. Could you pls help me on this ? This is current template: curl -XPUT 'vl-dev01:9200/\_template/latesttmpl-farm-qusage-mon?pretty' -H … --- ## [Pluggin securyti java](https://discuss.elastic.co/t/pluggin-securyti-java/269030)
**Author:** [@Alder](https://discuss.elastic.co/u/Alder)\ **Replies:** 5\ **Last updated:** [April 20, 2021, 11:07am UTC](https://discuss.elastic.co/t/pluggin-securyti-java/269030 "2021-04-20T11:07:12Z")
Hello everyone from elastic I have difficulties in java security to connect to the MSSQLServer database I have already edited the plugin-security.policy \[1\] and performed the installation \[2\], but the error \[3\] occurs … --- ## [Problem with ElasticsearchRepository](https://discuss.elastic.co/t/problem-with-elasticsearchrepository/270690)
**Author:** [@Atiqur\_Rahman](https://discuss.elastic.co/u/Atiqur_Rahman)\ **Replies:** 1\ **Last updated:** [April 20, 2021, 11:00am UTC](https://discuss.elastic.co/t/problem-with-elasticsearchrepository/270690 "2021-04-20T11:00:28Z")
Hi All I am not sure if this is the right place to ask this question. I am using Elasticsearch 7.11 and Spring-Boot 2.4.4 import org.springframework.data.elasticsearch.repository.ElasticsearchRepository; import org.sp… --- ## [Error - Failed to set password for user \[apm\_system\]](https://discuss.elastic.co/t/error-failed-to-set-password-for-user-apm-system/270252)
**Author:** [@Abhishek\_Pratap\_Sin1](https://discuss.elastic.co/u/Abhishek_Pratap_Sin1)\ **Replies:** 4\ **Last updated:** [April 20, 2021, 10:17am UTC](https://discuss.elastic.co/t/error-failed-to-set-password-for-user-apm-system/270252 "2021-04-20T10:17:34Z")
I am running Elastic-Search 7.11.1 Basic license 3 master & data nodes. While I was trying set password for build-in user, not able to set password for apm\_system. I following steps to set password. Step 1- update … --- ## [Unable to restart elasticsearch](https://discuss.elastic.co/t/unable-to-restart-elasticsearch/270665)
**Author:** [@sarabande](https://discuss.elastic.co/u/sarabande)\ **Replies:** 3\ **Last updated:** [April 20, 2021, 10:09am UTC](https://discuss.elastic.co/t/unable-to-restart-elasticsearch/270665 "2021-04-20T10:09:56Z")
Hi, I'm using elasticsearch in a multi-node cluster. Here's the configuration file (elasticsearch.yml) from one of the two elasticsearch log master nodes (in the cluster I have also 6 elasticsearch log nodes): # Netwo… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=659) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=661)