# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1394 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1395 --- ## [ES Ingestion Performance Issue](https://discuss.elastic.co/t/es-ingestion-performance-issue/168446)
**Author:** [@samwzm](https://discuss.elastic.co/u/samwzm)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 8:59am UTC](https://discuss.elastic.co/t/es-ingestion-performance-issue/168446 "2019-02-15T08:59:05Z")
Hi, We have two environments. One environment has two ES hot data nodes, another has five ES hot data nodes. The nodes server type is similar, all other config also similar. However, we tried to ingest the same data set… --- ## [Painless script library](https://discuss.elastic.co/t/painless-script-library/168448)
**Author:** [@Jean-Marc\_Autexier](https://discuss.elastic.co/u/Jean-Marc_Autexier)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 8:03am UTC](https://discuss.elastic.co/t/painless-script-library/168448 "2019-02-15T08:03:49Z")
Hi, I use painless scripts for upserts and some calculations on the merged documents (score...). I currently use one large script (with functions) stored in ES, which is referenced when ingesting documents. Is it poss… --- ## [Need help with X-pack TLS authentication](https://discuss.elastic.co/t/need-help-with-x-pack-tls-authentication/168121)
**Author:** [@jbourne](https://discuss.elastic.co/u/jbourne)\ **Replies:** 8\ **Last updated:** [February 15, 2019, 7:32am UTC](https://discuss.elastic.co/t/need-help-with-x-pack-tls-authentication/168121 "2019-02-15T07:32:57Z")
I'm trying to setup an elastic stack on kubernetes in AWS. I have: 1 - 3 master nodes 2 - 2 client nodes 3 - 1 data node In Kubernetes, I've created a Service that exposes ports 9200 and 9300. This service gets appli… --- ## [Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release](https://discuss.elastic.co/t/java-hotspot-tm-64-bit-server-vm-warning-option-useconcmarksweepgc-was-deprecated-in-version-9-0-and-will-likely-be-removed-in-a-future-release/168527)
**Author:** [@Nithin\_Sridhar](https://discuss.elastic.co/u/Nithin_Sridhar)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 7:18am UTC](https://discuss.elastic.co/t/java-hotspot-tm-64-bit-server-vm-warning-option-useconcmarksweepgc-was-deprecated-in-version-9-0-and-will-likely-be-removed-in-a-future-release/168527 "2019-02-15T07:18:00Z")
I'm using elasticsearch-6.6.0, Ubuntu 18.04 and Java verison as 10 details are below: java -version java version "10.0.2" 2018-07-17 Java(TM) SE Runtime Environment 18.3 (build 10.0.2+13) Java HotSpot(TM) 64-Bit Serv… --- ## [Connecting Users With Results in ES 6.5 using Java Rest API](https://discuss.elastic.co/t/connecting-users-with-results-in-es-6-5-using-java-rest-api/168532)
**Author:** [@Shyju\_M](https://discuss.elastic.co/u/Shyju_M)\ **Replies:** 0\ **Last updated:** [February 15, 2019, 7:05am UTC](https://discuss.elastic.co/t/connecting-users-with-results-in-es-6-5-using-java-rest-api/168532 "2019-02-15T07:05:07Z")
Hi All, I am trying to return the document id along with the suggestions as suggested in the article https://www.elastic.co/blog/you-complete-me. but, the payload option is not supported in the current version of ES. H… --- ## [Scroll\_id array element should only contain scroll\_id](https://discuss.elastic.co/t/scroll-id-array-element-should-only-contain-scroll-id/168505)
**Author:** [@iamazy](https://discuss.elastic.co/u/iamazy)\ **Replies:** 2\ **Last updated:** [February 15, 2019, 6:17am UTC](https://discuss.elastic.co/t/scroll-id-array-element-should-only-contain-scroll-id/168505 "2019-02-15T06:17:49Z")
Hello I run this code but has exception: type=illegal\_argument\_exception, reason=scroll\_id array element should only contain scroll\_id \> public List\\> testQuery(String index) throws IOException {… --- ## [Managing Users and Roles(Xpack) Cross Cluster Replication](https://discuss.elastic.co/t/managing-users-and-roles-xpack-cross-cluster-replication/167252)
**Author:** [@RamyaGowda](https://discuss.elastic.co/u/RamyaGowda)\ **Replies:** 2\ **Last updated:** [February 15, 2019, 5:56am UTC](https://discuss.elastic.co/t/managing-users-and-roles-xpack-cross-cluster-replication/167252 "2019-02-15T05:56:40Z")
Hi, When we are doing cross cluster replication ,for replicating data from remote to local, how users and roles data will be replicated to local cluster. Bit confused. --- ## [Elasticsearch, Where is my filebeat data?](https://discuss.elastic.co/t/elasticsearch-where-is-my-filebeat-data/168315)
**Author:** [@bradfordaemorton](https://discuss.elastic.co/u/bradfordaemorton)\ **Replies:** 10\ **Last updated:** [February 15, 2019, 5:48am UTC](https://discuss.elastic.co/t/elasticsearch-where-is-my-filebeat-data/168315 "2019-02-15T05:48:57Z")
I have been playing with ELK and setup Elasticstack to collect my personal webserver access logs. There will be more to come but I though this would be a good starting point. I have followed the installation and stash m… --- ## [Highlight "best matches" using Elastic Highlighting API](https://discuss.elastic.co/t/highlight-best-matches-using-elastic-highlighting-api/168513)
**Author:** [@Alexander\_Evtushenko](https://discuss.elastic.co/u/Alexander_Evtushenko)\ **Replies:** 0\ **Last updated:** [February 15, 2019, 4:50am UTC](https://discuss.elastic.co/t/highlight-best-matches-using-elastic-highlighting-api/168513 "2019-02-15T04:50:21Z")
Hi all. Is it possible to highlight "best matches" using Elastic Highlighting API? By "best match", I mean exact matches in a word even the whole word is matched by a query. For example: document content is Dubai sea… --- ## [Generic mapping/schema for a multi tenant use case](https://discuss.elastic.co/t/generic-mapping-schema-for-a-multi-tenant-use-case/168356)
**Author:** [@Srinivasan\_Ramaswamy](https://discuss.elastic.co/u/Srinivasan_Ramaswamy)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 3:59am UTC](https://discuss.elastic.co/t/generic-mapping-schema-for-a-multi-tenant-use-case/168356 "2019-02-15T03:59:39Z")
We have a multi-tenant use case where we need to index data coming from different tenants. There could be a shared common set of fields between users and each user can add their own fields. There can also be cases where … --- ## [Access currently authenticated user from custom realm logic](https://discuss.elastic.co/t/access-currently-authenticated-user-from-custom-realm-logic/167082)
**Author:** [@Guiss39](https://discuss.elastic.co/u/Guiss39)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 3:43am UTC](https://discuss.elastic.co/t/access-currently-authenticated-user-from-custom-realm-logic/167082 "2019-02-15T03:43:41Z")
Hi, I'm building a custom plugin with XPack and I have a custom Realm. From the token() method (e.g. https://github.com/elastic/elasticsearch/blob/6.4/x-pack/qa/security-example-spi-extension/src/main/java/org/elastics… --- ## [Authenticate user, save it and access it for all next requests](https://discuss.elastic.co/t/authenticate-user-save-it-and-access-it-for-all-next-requests/166963)
**Author:** [@Uiidoi12](https://discuss.elastic.co/u/Uiidoi12)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 3:36am UTC](https://discuss.elastic.co/t/authenticate-user-save-it-and-access-it-for-all-next-requests/166963 "2019-02-15T03:36:23Z")
Hi, I'm building a custom plugin with XPack and I have created a custom Realm and a custom RolesProvider. In my logic I want a user to authenticate and then all next requests will be done according to that user (who ha… --- ## [Help with Elasticsearch Query](https://discuss.elastic.co/t/help-with-elasticsearch-query/168489)
**Author:** [@jkrone72](https://discuss.elastic.co/u/jkrone72)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 1:12am UTC](https://discuss.elastic.co/t/help-with-elasticsearch-query/168489 "2019-02-15T01:12:13Z")
I have a data structure that looks like this: "dictionaryProximities": \[ { "proximity": 0.32427, "topicDictionaryName": "Electrical", }, { "proximity": 0.32141, "topicDictionar… --- ## [GET, and then QUERY](https://discuss.elastic.co/t/get-and-then-query/168479)
**Author:** [@jarraga](https://discuss.elastic.co/u/jarraga)\ **Replies:** 1\ **Last updated:** [February 15, 2019, 1:04am UTC](https://discuss.elastic.co/t/get-and-then-query/168479 "2019-02-15T01:04:29Z")
Hi! It's possible make a GET, to retrieve an document, and then make a query using some of the fields in this document like as match values? Is to say, make nested query in elasticsearch side, to improve the time to quer… --- ## [Initial attempt at installing Elasticsearch not going well - Windows Server 2016](https://discuss.elastic.co/t/initial-attempt-at-installing-elasticsearch-not-going-well-windows-server-2016/164923)
**Author:** [@kamuzz](https://discuss.elastic.co/u/kamuzz)\ **Replies:** 13\ **Last updated:** [February 15, 2019, 1:03am UTC](https://discuss.elastic.co/t/initial-attempt-at-installing-elasticsearch-not-going-well-windows-server-2016/164923 "2019-02-15T01:03:32Z")
Am trying to perform my first install of Elasticsearch; and I can't get the service to start. We always put our OS and programs on one drive and then the bulk of the data on a second drive. So in this case Windows and … --- ## [Need to generate UUID in painless script](https://discuss.elastic.co/t/need-to-generate-uuid-in-painless-script/165318)
**Author:** [@Oliver\_Henlich](https://discuss.elastic.co/u/Oliver_Henlich)\ **Replies:** 4\ **Last updated:** [February 15, 2019, 12:32am UTC](https://discuss.elastic.co/t/need-to-generate-uuid-in-painless-script/165318 "2019-02-15T00:32:09Z")
Hi, I am trying to use the reindex api to create a copy of a set of documents. One of the fields (productId) of the document is a UUID. I need the copied documents to have new UUIDs for the productId field. Please note… --- ## [Highlighting within fragments inconsistent](https://discuss.elastic.co/t/highlighting-within-fragments-inconsistent/168334)
**Author:** [@Tree1](https://discuss.elastic.co/u/Tree1)\ **Replies:** 2\ **Last updated:** [February 15, 2019, 12:07am UTC](https://discuss.elastic.co/t/highlighting-within-fragments-inconsistent/168334 "2019-02-15T00:07:52Z")
I'm trying to use ElasticSearch to locate important text which I then run a second process to extract information from the highlighted fragment. The problem is that in these highlighted fragments, the text I need to ext… --- ## [Updating documents without affecting search](https://discuss.elastic.co/t/updating-documents-without-affecting-search/168318)
**Author:** [@vijayaraj](https://discuss.elastic.co/u/vijayaraj)\ **Replies:** 12\ **Last updated:** [February 14, 2019, 9:20pm UTC](https://discuss.elastic.co/t/updating-documents-without-affecting-search/168318 "2019-02-14T21:20:35Z")
Hello Guys, I have 500,000 documents in my Index which are currently being consumed by search API. out of that there are 100,000 documents that I must update everyday. Buy my update shouldnt affect the current searc… --- ## [Elastic Cloud Provisioning (API, Terraform, etc)](https://discuss.elastic.co/t/elastic-cloud-provisioning-api-terraform-etc/168485)
**Author:** [@Defilan](https://discuss.elastic.co/u/Defilan)\ **Replies:** 0\ **Last updated:** [February 14, 2019, 8:48pm UTC](https://discuss.elastic.co/t/elastic-cloud-provisioning-api-terraform-etc/168485 "2019-02-14T20:48:27Z")
Hello all, I am interested in the Elastic Cloud offering but was wondering what others have done for provisioning? I was really hoping to see if there was some Terraform integration or at the very least some API support… --- ## [Elasticseach puppet set up](https://discuss.elastic.co/t/elasticseach-puppet-set-up/168183)
**Author:** [@msaardwark](https://discuss.elastic.co/u/msaardwark)\ **Replies:** 1\ **Last updated:** [February 14, 2019, 7:37pm UTC](https://discuss.elastic.co/t/elasticseach-puppet-set-up/168183 "2019-02-14T19:37:19Z")
Hello, I am trying to make a Puppet module that would install Elasticsearch on my node. I found this module that could do the job: However, I wasn't able to find any guide how to set it up. What do I need to configu… --- ## [Elastic Common Schema Implementation](https://discuss.elastic.co/t/elastic-common-schema-implementation/167651)
**Author:** [@Justin\_Doles](https://discuss.elastic.co/u/Justin_Doles)\ **Replies:** 4\ **Last updated:** [February 14, 2019, 7:07pm UTC](https://discuss.elastic.co/t/elastic-common-schema-implementation/167651 "2019-02-14T19:07:55Z")
I'm working on a PoC with ELK to replace our existing SIEM product. I've used ELK in the past to pull in log data from filebeat with great success. One thing I always struggled with was schema/mapping between different… --- ## [Emails stopped sending today with SMTP error](https://discuss.elastic.co/t/emails-stopped-sending-today-with-smtp-error/168424)
**Author:** [@jgburks](https://discuss.elastic.co/u/jgburks)\ **Replies:** 5\ **Last updated:** [February 14, 2019, 6:51pm UTC](https://discuss.elastic.co/t/emails-stopped-sending-today-with-smtp-error/168424 "2019-02-14T18:51:58Z")
Watcher emails have been working up until this morning. Every email attempt throws this error: \[ALERT Monetra Daily Ping\] via account \[work\]\]; nested: MessagingException\[Could not connect to SMTP host: dockerhost, port:… --- ## [Elasticsearch Disaster Recovery from Snapshots](https://discuss.elastic.co/t/elasticsearch-disaster-recovery-from-snapshots/168469)
**Author:** [@Darnell\_Martin](https://discuss.elastic.co/u/Darnell_Martin)\ **Replies:** 0\ **Last updated:** [February 14, 2019, 6:39pm UTC](https://discuss.elastic.co/t/elasticsearch-disaster-recovery-from-snapshots/168469 "2019-02-14T18:39:54Z")
Hey All, I am working on a Disaster Recovery Process for our 3 Node Elasticsearch cluster. The Warm Node in the cluster is using Curator to Snapshot all Indexes on the cluster to an S3 Snapshot Repository every hour. Du… --- ## [How to collect cpu stats for elastic nodes](https://discuss.elastic.co/t/how-to-collect-cpu-stats-for-elastic-nodes/168165)
**Author:** [@khergner](https://discuss.elastic.co/u/khergner)\ **Replies:** 2\ **Last updated:** [February 14, 2019, 5:43pm UTC](https://discuss.elastic.co/t/how-to-collect-cpu-stats-for-elastic-nodes/168165 "2019-02-14T17:43:58Z")
Hi everyone, I'd like to gather cpu level with rest api for any nodes. I am using the method on this page. if my request type http://localhost:9200/\_nodes/172.28../stats/os Response { "\_nodes" : { "total" : 1, … --- ## [Compare accuracy between rollup and normal indices](https://discuss.elastic.co/t/compare-accuracy-between-rollup-and-normal-indices/168200)
**Author:** [@cmallios](https://discuss.elastic.co/u/cmallios)\ **Replies:** 1\ **Last updated:** [February 14, 2019, 5:05pm UTC](https://discuss.elastic.co/t/compare-accuracy-between-rollup-and-normal-indices/168200 "2019-02-14T17:05:52Z")
I am trying to run some reports to compare rollup vs normal indices, but I am getting different results. At first I am using the version 6.5 and my config is: delay: 1d rollupindex: test-index index pattern: $product… --- ## [How to look up data in elasticseach as part of an ingest node process](https://discuss.elastic.co/t/how-to-look-up-data-in-elasticseach-as-part-of-an-ingest-node-process/168440)
**Author:** [@Ant](https://discuss.elastic.co/u/Ant)\ **Replies:** 2\ **Last updated:** [February 14, 2019, 5:04pm UTC](https://discuss.elastic.co/t/how-to-look-up-data-in-elasticseach-as-part-of-an-ingest-node-process/168440 "2019-02-14T17:04:48Z")
Hi, to start my level of knowledge with this kind of thing is very entry level. The over all task is that there is data in Apache Hive being pushed to an elastic index (that bit is working already) and I need to enrich … --- ## [Modify core storage of Elastic search](https://discuss.elastic.co/t/modify-core-storage-of-elastic-search/168274)
**Author:** [@akshay\_shetye](https://discuss.elastic.co/u/akshay_shetye)\ **Replies:** 3\ **Last updated:** [February 14, 2019, 5:03pm UTC](https://discuss.elastic.co/t/modify-core-storage-of-elastic-search/168274 "2019-02-14T17:03:29Z")
I am new to ES project and i am trying to understand the code. What am trying to do is instead of ES writing to DISK, i want to write to some other place. Ex amazon S3. I know that this is not ideal, but I have my own re… --- ## [Role mapping on user's metadata](https://discuss.elastic.co/t/role-mapping-on-users-metadata/167990)
**Author:** [@misomij](https://discuss.elastic.co/u/misomij)\ **Replies:** 2\ **Last updated:** [February 14, 2019, 4:46pm UTC](https://discuss.elastic.co/t/role-mapping-on-users-metadata/167990 "2019-02-14T16:46:46Z")
Hi all, I am on 6.5.4 and I am using AD for authentication. Authentication works correctly, now I am trying to create some role\_mapping. Following this guide I understand that it should be possible to create mappings … --- ## [Unique values query without aggregations](https://discuss.elastic.co/t/unique-values-query-without-aggregations/168442)
**Author:** [@Itay\_Bittan](https://discuss.elastic.co/u/Itay_Bittan)\ **Replies:** 1\ **Last updated:** [February 14, 2019, 4:07pm UTC](https://discuss.elastic.co/t/unique-values-query-without-aggregations/168442 "2019-02-14T16:07:59Z")
Hey, We have an index of unique products where each document represents a single product, with the following fields: product\_id, group\_id, group\_score, and product\_score. Consider the following index: { "product\_id":… --- ## [Elasticsearch 6.3.0 Scroll API requests got cancelled by backend](https://discuss.elastic.co/t/elasticsearch-6-3-0-scroll-api-requests-got-cancelled-by-backend/165613)
**Author:** [@goldsky](https://discuss.elastic.co/u/goldsky)\ **Replies:** 1\ **Last updated:** [February 14, 2019, 3:39pm UTC](https://discuss.elastic.co/t/elasticsearch-6-3-0-scroll-api-requests-got-cancelled-by-backend/165613 "2019-02-14T15:39:59Z")
After some time on one of my clusters (others have identical configuration and type of data/actions but do not have following problem) I detect some strange cluster behavior: \[2019-01-24T05:32:01,537\]\[DEBUG\]\[o.e.a.a.c.n… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1393) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1395)