# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1506

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1507

---

## [Using pipeline - java.lang.OutOfMemoryError: Java heap space](https://discuss.elastic.co/t/using-pipeline-java-lang-outofmemoryerror-java-heap-space/153952)

<div class="topic-metadata">

**Author:** [@ilma](https://discuss.elastic.co/u/ilma)\
**Replies:** 0\
**Last updated:** [October 25, 2018, 8:55am UTC](https://discuss.elastic.co/t/using-pipeline-java-lang-outofmemoryerror-java-heap-space/153952 "2018-10-25T08:55:54Z")

</div>

using pipeline ngest-attachment logstash로 elasticsearch로 output할때 생긴문제입니다. 파이프 라인은 아래와같습니다. ------------- PUT \_ingest/pipeline/attachment { "description" : "Extract attachment information", "processors" : \[ { "at…

---

## [Error in Kibana installation on Mac Local system](https://discuss.elastic.co/t/error-in-kibana-installation-on-mac-local-system/153949)

<div class="topic-metadata">

**Author:** [@sarvendras](https://discuss.elastic.co/u/sarvendras)\
**Replies:** 0\
**Last updated:** [October 25, 2018, 8:40am UTC](https://discuss.elastic.co/t/error-in-kibana-installation-on-mac-local-system/153949 "2018-10-25T08:40:49Z")

</div>

Hi All, Elastic search is working fine but while kibana is not working and giving below error..while with same steps Kibana working fine in another local mac machine. I am clueless.Please suggest. \[error\]\[status\]\[plug…

---

## [Implementing ElasticSearch with CS-CART](https://discuss.elastic.co/t/implementing-elasticsearch-with-cs-cart/153943)

<div class="topic-metadata">

**Author:** [@Admin\_Hack](https://discuss.elastic.co/u/Admin_Hack)\
**Replies:** 2\
**Last updated:** [October 25, 2018, 8:30am UTC](https://discuss.elastic.co/t/implementing-elasticsearch-with-cs-cart/153943 "2018-10-25T08:30:27Z")

</div>

I have Elasticsearch up and running at my localhost:9200 . How can i implement it in my cs-cart project ?? need help please... is there any config file where i need to make config changes??? @spinscale @Christian\_Dahlqv…

---

## [Elasticsearch index performance with mostly duplicate document](https://discuss.elastic.co/t/elasticsearch-index-performance-with-mostly-duplicate-document/153913)

<div class="topic-metadata">

**Author:** [@huydx](https://discuss.elastic.co/u/huydx)\
**Replies:** 6\
**Last updated:** [October 25, 2018, 8:20am UTC](https://discuss.elastic.co/t/elasticsearch-index-performance-with-mostly-duplicate-document/153913 "2018-10-25T08:20:05Z")

</div>

Hi Elasticsearch team, I have an application which generates ~ 1million document per sec, but mostly the documents are the same. Total unique documents are below 50 million. We have to use our own ID as doc ID (currently…

---

## [Change number of shards on daily index](https://discuss.elastic.co/t/change-number-of-shards-on-daily-index/153927)

<div class="topic-metadata">

**Author:** [@cowensel](https://discuss.elastic.co/u/cowensel)\
**Replies:** 1\
**Last updated:** [October 25, 2018, 8:08am UTC](https://discuss.elastic.co/t/change-number-of-shards-on-daily-index/153927 "2018-10-25T08:08:13Z")

</div>

We currently have the default 5 shards per index but I have started to notice when searching in Kibana it is taking around 20 seconds to search or kibana is slow to populate filter fields. We have a daily index that is …

---

## [Failed to process cluster event (put-mapping) within 30s](https://discuss.elastic.co/t/failed-to-process-cluster-event-put-mapping-within-30s/153898)

<div class="topic-metadata">

**Author:** [@shjdwxy](https://discuss.elastic.co/u/shjdwxy)\
**Replies:** 0\
**Last updated:** [October 25, 2018, 3:33am UTC](https://discuss.elastic.co/t/failed-to-process-cluster-event-put-mapping-within-30s/153898 "2018-10-25T03:33:03Z")

</div>

hi, guys failed to process cluster event (put-mapping) within 30s problem often happened in my cluster. My es cluster was used for log management, lots of index created everyday and I use dynamic mapping adjust to doc…

---

## [Does elasticsearch 6.4 perform a search on a replica that is out-of-sync/stale?](https://discuss.elastic.co/t/does-elasticsearch-6-4-perform-a-search-on-a-replica-that-is-out-of-sync-stale/153755)

<div class="topic-metadata">

**Author:** [@ashprakasan](https://discuss.elastic.co/u/ashprakasan)\
**Replies:** 4\
**Last updated:** [October 25, 2018, 6:33am UTC](https://discuss.elastic.co/t/does-elasticsearch-6-4-perform-a-search-on-a-replica-that-is-out-of-sync-stale/153755 "2018-10-25T06:33:55Z")

</div>

We are building an application where we want consistency over availability (in ES store). By consistency, I mean when we perform a search operation, the result should contain all the data that was indexed before this sea…

---

## [HOW much time/downtime is expecte to open/close/updatesettings of an index](https://discuss.elastic.co/t/how-much-time-downtime-is-expecte-to-open-close-updatesettings-of-an-index/153919)

<div class="topic-metadata">

**Author:** [@Niharika\_Singh](https://discuss.elastic.co/u/Niharika_Singh)\
**Replies:** 3\
**Last updated:** [October 25, 2018, 6:19am UTC](https://discuss.elastic.co/t/how-much-time-downtime-is-expecte-to-open-close-updatesettings-of-an-index/153919 "2018-10-25T06:19:56Z")

</div>

Hi, I am trying to update the setting of one my index wondering how much downtime is expected for the complete process where I need to close the index first then perform update and then reopen the indices.

---

## [Help with writing a search query](https://discuss.elastic.co/t/help-with-writing-a-search-query/153808)

<div class="topic-metadata">

**Author:** [@ProxyMasterMerger](https://discuss.elastic.co/u/ProxyMasterMerger)\
**Replies:** 4\
**Last updated:** [October 25, 2018, 6:19am UTC](https://discuss.elastic.co/t/help-with-writing-a-search-query/153808 "2018-10-25T06:19:10Z")

</div>

Hello all, nooby here. I'm trying to write a search query but I'm having some problems. I have an index called Categories. It has the following fields: title, tags (which is just a big string with keywords) and total, a…

---

## [Failed installing elasticsearch](https://discuss.elastic.co/t/failed-installing-elasticsearch/153231)

<div class="topic-metadata">

**Author:** [@Patrick\_Doyle](https://discuss.elastic.co/u/Patrick_Doyle)\
**Replies:** 2\
**Last updated:** [October 25, 2018, 6:00am UTC](https://discuss.elastic.co/t/failed-installing-elasticsearch/153231 "2018-10-25T06:00:26Z")

</div>

I am following the guide here https://logz.io/blog/elasticsearch-tutorial/ on a brand new ubuntu 18.04 AWS EC2 instance. I ran the following commands: wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sud…

---

## [The best way to achieve CSV imports?](https://discuss.elastic.co/t/the-best-way-to-achieve-csv-imports/153417)

<div class="topic-metadata">

**Author:** [@Nick\_Harper](https://discuss.elastic.co/u/Nick_Harper)\
**Replies:** 2\
**Last updated:** [October 25, 2018, 5:52am UTC](https://discuss.elastic.co/t/the-best-way-to-achieve-csv-imports/153417 "2018-10-25T05:52:14Z")

</div>

Hi I currently use Sphinx and import hundreds of product feeds into this. I am just trying to get this working with Elastic Search but I need to figure out the best way to: I have mapped the product ID to the Elastic…

---

## [IdP Recommendations for SAML Auth](https://discuss.elastic.co/t/idp-recommendations-for-saml-auth/153619)

<div class="topic-metadata">

**Author:** [@dcam](https://discuss.elastic.co/u/dcam)\
**Replies:** 3\
**Last updated:** [October 25, 2018, 2:26am UTC](https://discuss.elastic.co/t/idp-recommendations-for-saml-auth/153619 "2018-10-25T02:26:08Z")

</div>

We are planning to move from Basic Auth to SAML Authentication. Do you have any recomendations about which framework to use as SAML Client? PingFederate Keycloak SAML Passport etc We would like to build the client in…

---

## [ES vulnerability CVE-2018-3831](https://discuss.elastic.co/t/es-vulnerability-cve-2018-3831/153883)

<div class="topic-metadata">

**Author:** [@naysw01](https://discuss.elastic.co/u/naysw01)\
**Replies:** 1\
**Last updated:** [October 25, 2018, 1:52am UTC](https://discuss.elastic.co/t/es-vulnerability-cve-2018-3831/153883 "2018-10-25T01:52:54Z")

</div>

Is CVE-2018-3831(Elasticsearch Alerting and Monitoring in versions before 6.4.1 or 5.6.12 have an information disclosure issue when secrets are configured via the API) applicable to standard elasticsearch or just elastic…

---

## [Can not access to params.\_source in script\_score](https://discuss.elastic.co/t/can-not-access-to-params-source-in-script-score/153851)

<div class="topic-metadata">

**Author:** [@wgkoro](https://discuss.elastic.co/u/wgkoro)\
**Replies:** 3\
**Last updated:** [October 25, 2018, 1:37am UTC](https://discuss.elastic.co/t/can-not-access-to-params-source-in-script-score/153851 "2018-10-25T01:37:02Z")

</div>

Hi. newbie here. I'm trying to write script\_score with params.\_source, but it returns null pointer exception. (I want to access nested data) Query is like this. GET /users/\_search { "query": { "function\_score":…

---

## [How to solve field in mapping but already used in other types](https://discuss.elastic.co/t/how-to-solve-field-in-mapping-but-already-used-in-other-types/43067)

<div class="topic-metadata">

**Author:** [@szcountryboy](https://discuss.elastic.co/u/szcountryboy)\
**Replies:** 7\
**Last updated:** [October 24, 2018, 11:10pm UTC](https://discuss.elastic.co/t/how-to-solve-field-in-mapping-but-already-used-in-other-types/43067 "2018-10-24T23:10:04Z")

</div>

I also run topbeat, packbeat, transfer to logstash, accept the data on the ES side, reported the following error \[2016-03-01 02:33:49,810\]\[DEBUG\]\[action.bulk \] \[node-1\] \[logstash-2016.02.29\]\[4\] failed to e…

---

## [Getting the max results 50000](https://discuss.elastic.co/t/getting-the-max-results-50000/153877)

<div class="topic-metadata">

**Author:** [@shani\_angarkadu](https://discuss.elastic.co/u/shani_angarkadu)\
**Replies:** 3\
**Last updated:** [October 24, 2018, 10:22pm UTC](https://discuss.elastic.co/t/getting-the-max-results-50000/153877 "2018-10-24T22:22:38Z")

</div>

Hi set up the index.max\_result\_window to 50,000 , but the response time has dramatically increased. Is there any settings I need add to increase the speed as well?

---

## [How to inner join 3 index](https://discuss.elastic.co/t/how-to-inner-join-3-index/153421)

<div class="topic-metadata">

**Author:** [@Gian\_Carlo\_Menotti](https://discuss.elastic.co/u/Gian_Carlo_Menotti)\
**Replies:** 8\
**Last updated:** [October 24, 2018, 7:10pm UTC](https://discuss.elastic.co/t/how-to-inner-join-3-index/153421 "2018-10-24T19:10:28Z")

</div>

Hi, i need to inner join 3 index in elastic for crate 1, is this possible? where can i found documentation, the 3 tables are in already in elastic the results should be something like this Select a.IdEntry, b.ItemCode…

---

## [Amazon\_s3\_exception. Forbidden; Request](https://discuss.elastic.co/t/amazon-s3-exception-forbidden-request/153029)

<div class="topic-metadata">

**Author:** [@scch](https://discuss.elastic.co/u/scch)\
**Replies:** 4\
**Last updated:** [October 24, 2018, 4:49pm UTC](https://discuss.elastic.co/t/amazon-s3-exception-forbidden-request/153029 "2018-10-24T16:49:15Z")

</div>

Hello, when i am trying to create \_snapshot repository on my s3 bucket.. i am getting below forbidden error. { "error": { "root\_cause": \[ { "type": "amazon\_s3\_exception", "reason": "amazon\_s3\_exception: Forbidden…

---

## [How to remove /n characters from index](https://discuss.elastic.co/t/how-to-remove-n-characters-from-index/153828)

<div class="topic-metadata">

**Author:** [@anveshdd](https://discuss.elastic.co/u/anveshdd)\
**Replies:** 3\
**Last updated:** [October 24, 2018, 4:17pm UTC](https://discuss.elastic.co/t/how-to-remove-n-characters-from-index/153828 "2018-10-24T16:17:38Z")

</div>

Hi, I am working on ES 6.3.X and I am using a external web crawler to crawl the data and when I check the index it has a lot of new line characters. Is there any suggestions to avoid the new line characters. …

---

## [Rollover Failing](https://discuss.elastic.co/t/rollover-failing/153676)

<div class="topic-metadata">

**Author:** [@titan1978](https://discuss.elastic.co/u/titan1978)\
**Replies:** 6\
**Last updated:** [October 24, 2018, 4:17pm UTC](https://discuss.elastic.co/t/rollover-failing/153676 "2018-10-24T16:17:34Z")

</div>

Getting a failure - Rollover API complains that I have multiple aliases in my template but I created only one in the template. If i DONT use templates, the rollover works absolutely fine. ----- This is my current elasti…

---

## [How to compare 2 number fields in the same document](https://discuss.elastic.co/t/how-to-compare-2-number-fields-in-the-same-document/153688)

<div class="topic-metadata">

**Author:** [@Philip\_Romero](https://discuss.elastic.co/u/Philip_Romero)\
**Replies:** 2\
**Last updated:** [October 24, 2018, 3:35pm UTC](https://discuss.elastic.co/t/how-to-compare-2-number-fields-in-the-same-document/153688 "2018-10-24T15:35:56Z")

</div>

I'm trying to set up what I feel should be a very simple watcher process, but I am new to building queries and having a very hard time. I'd like to compare the "actual" value to the "typical" value from a machine learnin…

---

## [Char\_filter how to replace backslashes with slashes](https://discuss.elastic.co/t/char-filter-how-to-replace-backslashes-with-slashes/153785)

<div class="topic-metadata">

**Author:** [@16318a22907f3cbfa04b](https://discuss.elastic.co/u/16318a22907f3cbfa04b)\
**Replies:** 2\
**Last updated:** [October 24, 2018, 3:10pm UTC](https://discuss.elastic.co/t/char-filter-how-to-replace-backslashes-with-slashes/153785 "2018-10-24T15:10:41Z")

</div>

"analysis": { "char\_filter": { "replace\_bad\_slash": { "type": "mapping", "mappings": \[ "\\\\ =\> /" \] } }, "normalizer": { "my\_normalizer":…

---

## [X-pack - SAML issue - ELK 6.4](https://discuss.elastic.co/t/x-pack-saml-issue-elk-6-4/153235)

<div class="topic-metadata">

**Author:** [@Galambos\_Robert](https://discuss.elastic.co/u/Galambos_Robert)\
**Replies:** 6\
**Last updated:** [October 24, 2018, 3:09pm UTC](https://discuss.elastic.co/t/x-pack-saml-issue-elk-6-4/153235 "2018-10-24T15:09:59Z")

</div>

Hello I'm testing the ELK 6.4 version on stage env ( Ubuntu 16.04.5 LTS ) , i have 1LS with redis , 2 ES as data nodes and 1 Kib with ES as master. SSL setup went ok but but further I need to integrate it with SAML on A…

---

## [Created ML Job with bucket span 15m and 1d](https://discuss.elastic.co/t/created-ml-job-with-bucket-span-15m-and-1d/152839)

<div class="topic-metadata">

**Author:** [@shiv94](https://discuss.elastic.co/u/shiv94)\
**Replies:** 10\
**Last updated:** [October 24, 2018, 3:01pm UTC](https://discuss.elastic.co/t/created-ml-job-with-bucket-span-15m-and-1d/152839 "2018-10-24T15:01:20Z")

</div>

Hi All, I have created ML job of multi metric with bucket span of 15m and used the function Max(A), Max(B). Splitting it by hostname and also created other Job with bucket span of 1d. I would like to know how exactly bu…

---

## [Error 503 while trying to create a S3 snapshot repo](https://discuss.elastic.co/t/error-503-while-trying-to-create-a-s3-snapshot-repo/153831)

<div class="topic-metadata">

**Author:** [@dr01](https://discuss.elastic.co/u/dr01)\
**Replies:** 0\
**Last updated:** [October 24, 2018, 2:33pm UTC](https://discuss.elastic.co/t/error-503-while-trying-to-create-a-s3-snapshot-repo/153831 "2018-10-24T14:33:41Z")

</div>

I get a HTTP 503 error whenever I try to create a snapshot repository on an Amazon S3 bucket: \[root@myserver ~\]# curl -XPUT 'https://myes.example.org:9200/\_snapshot/s3\_repository' -H 'Content-Type: application/json' -d …

---

## [Different purposes MASTER/DATA/COORDINATING](https://discuss.elastic.co/t/different-purposes-master-data-coordinating/153411)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 11\
**Last updated:** [October 24, 2018, 2:12pm UTC](https://discuss.elastic.co/t/different-purposes-master-data-coordinating/153411 "2018-10-24T14:12:43Z")

</div>

hi all, currently I have a cluster configured in this way: SCENARIO 1: 3 MASTER 6 DATA My Filebeat clients send messages directly to DATA nodes. is it correct or not? Is it correct to think that MASTER nodes should…

---

## [Different results between filter and terms within unique count](https://discuss.elastic.co/t/different-results-between-filter-and-terms-within-unique-count/153703)

<div class="topic-metadata">

**Author:** [@haries\_fajar\_nugroho](https://discuss.elastic.co/u/haries_fajar_nugroho)\
**Replies:** 2\
**Last updated:** [October 24, 2018, 1:54pm UTC](https://discuss.elastic.co/t/different-results-between-filter-and-terms-within-unique-count/153703 "2018-10-24T13:54:59Z")

</div>

Hello, I have questions about results differences between filter and terms (i'm using unique count). By using filter, i get 531 value, the same result compared with the docs that presented (531). But if i use terms, i …

---

## [Deployment health issue: Snapshots out of date elastic](https://discuss.elastic.co/t/deployment-health-issue-snapshots-out-of-date-elastic/153818)

<div class="topic-metadata">

**Author:** [@Manu\_S\_Sithara](https://discuss.elastic.co/u/Manu_S_Sithara)\
**Replies:** 0\
**Last updated:** [October 24, 2018, 1:48pm UTC](https://discuss.elastic.co/t/deployment-health-issue-snapshots-out-of-date-elastic/153818 "2018-10-24T13:48:35Z")

</div>

HI, I have recently upgraded 5.6 to 6.4 . I have taken a manual snapshot and then do the upgradation process. Now I am a getting " Deployment health issue: Snapshots out of date elastic". And the automated Snapshot is n…

---

## [Need to mock elastic search Nest object](https://discuss.elastic.co/t/need-to-mock-elastic-search-nest-object/153809)

<div class="topic-metadata">

**Author:** [@piyush\_kumar](https://discuss.elastic.co/u/piyush_kumar)\
**Replies:** 1\
**Last updated:** [October 24, 2018, 1:43pm UTC](https://discuss.elastic.co/t/need-to-mock-elastic-search-nest-object/153809 "2018-10-24T13:43:59Z")

</div>

var obj = service.Search(new student().Query()); var Name= obj.Aggs.Terms("Name"); I did quick watch in vs2017 and try to create the Nest library object but getting error while assigning the value to Aggregate property…

---

## [Index rollover broken after connectivity issues between nodes in a 3 node ELK cluster](https://discuss.elastic.co/t/index-rollover-broken-after-connectivity-issues-between-nodes-in-a-3-node-elk-cluster/151233)

<div class="topic-metadata">

**Author:** [@Ihjaz](https://discuss.elastic.co/u/Ihjaz)\
**Replies:** 4\
**Last updated:** [October 24, 2018, 1:16pm UTC](https://discuss.elastic.co/t/index-rollover-broken-after-connectivity-issues-between-nodes-in-a-3-node-elk-cluster/151233 "2018-10-24T13:16:23Z")

</div>

Hi, I have a 3 node ELK cluster and I have curator scheduled to run every hour using cronjob to rollover the indices. I have run into this issue where a new index is created by the curator packetbeat-6.2.2-2018.08.06-0…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1505)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1507)
