# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1729 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1730 --- ## [Preventing/Detecting web crawlers with the ELK stack or XPack](https://discuss.elastic.co/t/preventing-detecting-web-crawlers-with-the-elk-stack-or-xpack/126884)
**Author:** [@ChiuWeng](https://discuss.elastic.co/u/ChiuWeng)\ **Replies:** 0\ **Last updated:** [April 5, 2018, 9:09am UTC](https://discuss.elastic.co/t/preventing-detecting-web-crawlers-with-the-elk-stack-or-xpack/126884 "2018-04-05T09:09:26Z")
Hi, I’m still familiarizing myself with the ELK stack, including the Xpack and Beats. My organization is finding ways in detecting and also preventing web crawling activities by competing organizations. I went through … --- ## [Heap settings for 128GB (RAM) server](https://discuss.elastic.co/t/heap-settings-for-128gb-ram-server/126846)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 5\ **Last updated:** [April 5, 2018, 8:11am UTC](https://discuss.elastic.co/t/heap-settings-for-128gb-ram-server/126846 "2018-04-05T08:11:21Z")
What is the recommended RAM settings for 32 core 128 GB RAM. I do understand that it shouldn't be more than 30GB to make sure is below the JVM cutoff for compressed object pointers. --- ## [Elasticsearch phrase mapping](https://discuss.elastic.co/t/elasticsearch-phrase-mapping/126871)
**Author:** [@hatemalimam](https://discuss.elastic.co/u/hatemalimam)\ **Replies:** 0\ **Last updated:** [April 5, 2018, 8:02am UTC](https://discuss.elastic.co/t/elasticsearch-phrase-mapping/126871 "2018-04-05T08:02:33Z")
I have the following phrase: It's never happened to me – Messi Player of Barcelona to Cristiano Ronaldo star of Real Madrid thanks Juve fans for ovation. And a simple elasticsearch document called Player: "firstNa… --- ## [Cross cluster search fails depending on characters used in index name and alias](https://discuss.elastic.co/t/cross-cluster-search-fails-depending-on-characters-used-in-index-name-and-alias/126515)
**Author:** [@YuWatanabe](https://discuss.elastic.co/u/YuWatanabe)\ **Replies:** 2\ **Last updated:** [April 5, 2018, 7:57am UTC](https://discuss.elastic.co/t/cross-cluster-search-fails-depending-on-characters-used-in-index-name-and-alias/126515 "2018-04-05T07:57:05Z")
Hello . Is there any characters that may not be used in index name (or alias name) when using cross cluster search ? I was not able to use hyphen on remote index. Environment 1.2 clusters asia-northeast1-a asia-nor… --- ## [Contains query on text field with keyword analyzer breaking at whitespace](https://discuss.elastic.co/t/contains-query-on-text-field-with-keyword-analyzer-breaking-at-whitespace/126866)
**Author:** [@nmathur](https://discuss.elastic.co/u/nmathur)\ **Replies:** 0\ **Last updated:** [April 5, 2018, 7:40am UTC](https://discuss.elastic.co/t/contains-query-on-text-field-with-keyword-analyzer-breaking-at-whitespace/126866 "2018-04-05T07:40:34Z")
Hello, I need to perform in query on the field with "keyword" analyzer. An exact search is successful and return correct result but contains query always fail. I also needed the keyword to search with lower case so I t… --- ## [Elasticsearch Cluster data node comes out of cluster frequently](https://discuss.elastic.co/t/elasticsearch-cluster-data-node-comes-out-of-cluster-frequently/126856)
**Author:** [@rahmath](https://discuss.elastic.co/u/rahmath)\ **Replies:** 0\ **Last updated:** [April 5, 2018, 6:52am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-data-node-comes-out-of-cluster-frequently/126856 "2018-04-05T06:52:08Z")
We are running ES cluster in AWS Ec2 for past 2 years. But for past two months we are getting "OutOfMemoryError" Error from our data nodes. After this error one or more node went out from cluster and the cluster goes imm… --- ## [Heap size full in magento2 with Elastci suite](https://discuss.elastic.co/t/heap-size-full-in-magento2-with-elastci-suite/126853)
**Author:** [@gouda](https://discuss.elastic.co/u/gouda)\ **Replies:** 0\ **Last updated:** [April 5, 2018, 6:41am UTC](https://discuss.elastic.co/t/heap-size-full-in-magento2-with-elastci-suite/126853 "2018-04-05T06:41:44Z")
when we restarted varnish server and elastic search then No live nodes found error occurred ,so checked elastic log its showing "HEAP Memory Exceed" ?? Please do the needful --- ## [Bulk Insert using helpers](https://discuss.elastic.co/t/bulk-insert-using-helpers/126836)
**Author:** [@Sunil\_Kalyanpur](https://discuss.elastic.co/u/Sunil_Kalyanpur)\ **Replies:** 3\ **Last updated:** [April 5, 2018, 6:31am UTC](https://discuss.elastic.co/t/bulk-insert-using-helpers/126836 "2018-04-05T06:31:09Z")
I'm using Elasticsearch 6.2. This link mentions that \_type would be removed from future versions. Hence, I tried to do a bulk insert without specifying \_type in \_make\_documents function. But, it threw below error. elas… --- ## [Development cluster not responding to query](https://discuss.elastic.co/t/development-cluster-not-responding-to-query/126817)
**Author:** [@jeff.cs](https://discuss.elastic.co/u/jeff.cs)\ **Replies:** 1\ **Last updated:** [April 5, 2018, 2:57am UTC](https://discuss.elastic.co/t/development-cluster-not-responding-to-query/126817 "2018-04-05T02:57:23Z")
SOLVED Sorry for anyone still viewing. Please disregard! The original question is left beneath. The issue is that the post request was being run via Postman, which had a bug that modified our query in an unexpected w… --- ## [Elasticsearch curator installation amazon linux ami](https://discuss.elastic.co/t/elasticsearch-curator-installation-amazon-linux-ami/126793)
**Author:** [@Jathin](https://discuss.elastic.co/u/Jathin)\ **Replies:** 1\ **Last updated:** [April 4, 2018, 10:10pm UTC](https://discuss.elastic.co/t/elasticsearch-curator-installation-amazon-linux-ami/126793 "2018-04-04T22:10:58Z")
Trying to install curator on amazon linux ami using RHEL7 yum repo and it fails with below error. Can you please help me to install it. And is RHEL7 the right repo? yum install elasticsearch-curator Loaded plugins: p… --- ## [Trying to understand 'timed out when collecting data'](https://discuss.elastic.co/t/trying-to-understand-timed-out-when-collecting-data/113979)
**Author:** [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Replies:** 8\ **Last updated:** [April 4, 2018, 9:19pm UTC](https://discuss.elastic.co/t/trying-to-understand-timed-out-when-collecting-data/113979 "2018-04-04T21:19:08Z")
Hello, I'm trying to understand a strange behaviour that started recently. I'm getting messages like the following: \[2018-01-03T17:26:35,615\]\[ERROR\]\[o.e.x.m.c.c.ClusterStatsCollector\] \[node-name\] collector \[cluster\_st… --- ## [ES 5.6.8 Bulk Update Api Error: \_id must not be empty](https://discuss.elastic.co/t/es-5-6-8-bulk-update-api-error-id-must-not-be-empty/123175)
**Author:** [@Sayantan](https://discuss.elastic.co/u/Sayantan)\ **Replies:** 1\ **Last updated:** [April 4, 2018, 9:11pm UTC](https://discuss.elastic.co/t/es-5-6-8-bulk-update-api-error-id-must-not-be-empty/123175 "2018-04-04T21:11:58Z")
Any idea why even though \_id is present, unless I am not spotting something obvious. Request {"update":{"\_index":"test","\_type":"doc","\_id":"cat friskie"}} {"doc":{"weight":1.0,"term":"cat friskie"},"doc\_as\_upsert":tr… --- ## [How set up ELK stack in a virtual server](https://discuss.elastic.co/t/how-set-up-elk-stack-in-a-virtual-server/126820)
**Author:** [@exorcista](https://discuss.elastic.co/u/exorcista)\ **Replies:** 0\ **Last updated:** [April 4, 2018, 8:55pm UTC](https://discuss.elastic.co/t/how-set-up-elk-stack-in-a-virtual-server/126820 "2018-04-04T20:55:45Z")
Is there a guide to install ELK in a virtual server? Thanks! --- ## [Elasticsearch Dynamic template not working as required](https://discuss.elastic.co/t/elasticsearch-dynamic-template-not-working-as-required/126476)
**Author:** [@silent\_phantom](https://discuss.elastic.co/u/silent_phantom)\ **Replies:** 5\ **Last updated:** [April 4, 2018, 8:53pm UTC](https://discuss.elastic.co/t/elasticsearch-dynamic-template-not-working-as-required/126476 "2018-04-04T20:53:16Z")
I want to have an elasticsearch schema that has some pre defined fields including an object type field. I want to have all the fields inside that object type field to be string by default. I have the following mappings … --- ## [Export forecast data](https://discuss.elastic.co/t/export-forecast-data/124875)
**Author:** [@Oscarlf](https://discuss.elastic.co/u/Oscarlf)\ **Replies:** 3\ **Last updated:** [April 4, 2018, 8:07pm UTC](https://discuss.elastic.co/t/export-forecast-data/124875 "2018-04-04T20:07:24Z")
Hi everyone! Is there any possibility of exporting the data reflected in a forecast scenario? I can see it and the comparison in the Single Metric Viewer, but I would like to use it or manage it to do some other calcula… --- ## [Decreasing shards](https://discuss.elastic.co/t/decreasing-shards/126800)
**Author:** [@s\_yash](https://discuss.elastic.co/u/s_yash)\ **Replies:** 2\ **Last updated:** [April 4, 2018, 7:36pm UTC](https://discuss.elastic.co/t/decreasing-shards/126800 "2018-04-04T19:36:45Z")
Currently all our indices are created daily with number of shards is 5(default). I would like to change number of shards to 1 for newly created indices. Can an index co exist with different number of shards. example: lo… --- ## [Index Naming](https://discuss.elastic.co/t/index-naming/126584)
**Author:** [@mmethe](https://discuss.elastic.co/u/mmethe)\ **Replies:** 6\ **Last updated:** [April 4, 2018, 7:14pm UTC](https://discuss.elastic.co/t/index-naming/126584 "2018-04-04T19:14:27Z")
How do I get my index named properly? I have an index appearing as: %{\[@metadata\]\[beat\]}-2018.04.03 While my beats appear properly as: winlogbeat-2017.12.19 winlogbeat-2017.12.20 My conf: input { beats { port =\> … --- ## [Need to perform the analyze the data and index the data from analyze phase into separate index](https://discuss.elastic.co/t/need-to-perform-the-analyze-the-data-and-index-the-data-from-analyze-phase-into-separate-index/126805)
**Author:** [@gopalkec24](https://discuss.elastic.co/u/gopalkec24)\ **Replies:** 0\ **Last updated:** [April 4, 2018, 6:45pm UTC](https://discuss.elastic.co/t/need-to-perform-the-analyze-the-data-and-index-the-data-from-analyze-phase-into-separate-index/126805 "2018-04-04T18:45:47Z")
Hi, I am new to Elastic search. I have full text document content in my index. I need to look for particular pattern like telephone number and Take pattern text from document and its document ID. These identified fie… --- ## [How are strings mapped?](https://discuss.elastic.co/t/how-are-strings-mapped/126787)
**Author:** [@Tony\_Chirillo](https://discuss.elastic.co/u/Tony_Chirillo)\ **Replies:** 3\ **Last updated:** [April 4, 2018, 6:10pm UTC](https://discuss.elastic.co/t/how-are-strings-mapped/126787 "2018-04-04T18:10:50Z")
In ES 6.2.2, how are string mapped by default? Are they still mapped as both as both text and keyword by default, or did that change? --- ## [Find documents in an aggregation of a certain size](https://discuss.elastic.co/t/find-documents-in-an-aggregation-of-a-certain-size/126258)
**Author:** [@esUser2](https://discuss.elastic.co/u/esUser2)\ **Replies:** 4\ **Last updated:** [April 4, 2018, 5:37pm UTC](https://discuss.elastic.co/t/find-documents-in-an-aggregation-of-a-certain-size/126258 "2018-04-04T17:37:49Z")
I want to do a query that returns documents that belong to an aggregation with a specific size. For example, if I have a field called "category" and do a term aggregation I will get buckets. I want to return documents t… --- ## [Sum results from top\_hits aggregation](https://discuss.elastic.co/t/sum-results-from-top-hits-aggregation/126782)
**Author:** [@alfred.bez](https://discuss.elastic.co/u/alfred.bez)\ **Replies:** 0\ **Last updated:** [April 4, 2018, 4:12pm UTC](https://discuss.elastic.co/t/sum-results-from-top-hits-aggregation/126782 "2018-04-04T16:12:03Z")
Hi guys, I'm trying to sum data from an top\_hits result and I need some help. First, here's my data: {"clientId":1, "gender": "male", "dateTime":"2017-06-06 17:54:38", "phoneIsValid":1}, {"clientId":1, "gender": "male"… --- ## [Elastic Problem](https://discuss.elastic.co/t/elastic-problem/126777)
**Author:** [@Xareni\_Bonilla](https://discuss.elastic.co/u/Xareni_Bonilla)\ **Replies:** 1\ **Last updated:** [April 4, 2018, 3:52pm UTC](https://discuss.elastic.co/t/elastic-problem/126777 "2018-04-04T15:52:24Z")
Hello: My elasticsearch dies when making a very large data request, what can I do? --- ## [Python client : put\_script](https://discuss.elastic.co/t/python-client-put-script/126740)
**Author:** [@Gemma\_Cabero](https://discuss.elastic.co/u/Gemma_Cabero)\ **Replies:** 1\ **Last updated:** [April 4, 2018, 3:45pm UTC](https://discuss.elastic.co/t/python-client-put-script/126740 "2018-04-04T15:45:12Z")
Hi, I'm upgrading our elastic search code to 6.2 and on the python client we use the following API: http://elasticsearch-py.readthedocs.io/en/master/api.html, particularly "put\_script". Whereas before we would be able t… --- ## [Painless If doc\['field'\].value in List](https://discuss.elastic.co/t/painless-if-doc-field-value-in-list/126598)
**Author:** [@MPurcell](https://discuss.elastic.co/u/MPurcell)\ **Replies:** 6\ **Last updated:** [April 4, 2018, 3:25pm UTC](https://discuss.elastic.co/t/painless-if-doc-field-value-in-list/126598 "2018-04-04T15:25:39Z")
Hey quick question. I have a script/painless section in a bool-must section of my code. Basically I want to check if the classification number, which could be = 17, 18, 19, 20, or 21 is either 18, 19, or 20. For some rea… --- ## [Machine learning jobs not reflecting new data](https://discuss.elastic.co/t/machine-learning-jobs-not-reflecting-new-data/126283)
**Author:** [@David\_Tomasheski](https://discuss.elastic.co/u/David_Tomasheski)\ **Replies:** 4\ **Last updated:** [April 4, 2018, 3:16pm UTC](https://discuss.elastic.co/t/machine-learning-jobs-not-reflecting-new-data/126283 "2018-04-04T15:16:46Z")
I have a few machine learning jobs running all on the same index pattern. They are single metric doc count jobs. I am getting new data in but my count in the Single Metric Viewer flat lines to 0. I have no idea what I'm … --- ## [Hearthbeat dashbaord in kibana](https://discuss.elastic.co/t/hearthbeat-dashbaord-in-kibana/126758)
**Author:** [@Ninoslav](https://discuss.elastic.co/u/Ninoslav)\ **Replies:** 1\ **Last updated:** [April 4, 2018, 3:15pm UTC](https://discuss.elastic.co/t/hearthbeat-dashbaord-in-kibana/126758 "2018-04-04T15:15:42Z")
Hi gys, In my current setup, i have 2 CPU-s, 8GB RAM, no cluster. I have installed hearthbeat packet, to monitor the system performance of my Elastic stack, but when i try to load dashboard i get an error: The reques… --- ## [I am installing the new ES and i keep receiving these errors on start. main ERROR Null object returned for RollingFile in Appenders](https://discuss.elastic.co/t/i-am-installing-the-new-es-and-i-keep-receiving-these-errors-on-start-main-error-null-object-returned-for-rollingfile-in-appenders/125002)
**Author:** [@KKB](https://discuss.elastic.co/u/KKB)\ **Replies:** 9\ **Last updated:** [April 4, 2018, 2:07pm UTC](https://discuss.elastic.co/t/i-am-installing-the-new-es-and-i-keep-receiving-these-errors-on-start-main-error-null-object-returned-for-rollingfile-in-appenders/125002 "2018-04-04T14:07:26Z")
Hi, I am installing the new ES and i keep receiving these errors on start. main ERROR Null object returned for RollingFile in Appenders. I trouble shoot by all the recommendation which had posted in forums relates to t… --- ## [Angular to ElasticSearch Returning 404 Not Found](https://discuss.elastic.co/t/angular-to-elasticsearch-returning-404-not-found/126746)
**Author:** [@chrisruel](https://discuss.elastic.co/u/chrisruel)\ **Replies:** 0\ **Last updated:** [April 4, 2018, 1:31pm UTC](https://discuss.elastic.co/t/angular-to-elasticsearch-returning-404-not-found/126746 "2018-04-04T13:31:00Z")
I am trying to connect to ElasticSearch through Angular following an example provided, but I keep getting a 404 not found error: {"msg":"Not Found","path":"/myindex/\_search", "query":{"q":"something"},"statusCode":4… --- ## [Setup MFA in 6.2 SAML](https://discuss.elastic.co/t/setup-mfa-in-6-2-saml/126602)
**Author:** [@dherrhoy](https://discuss.elastic.co/u/dherrhoy)\ **Replies:** 5\ **Last updated:** [April 4, 2018, 1:23pm UTC](https://discuss.elastic.co/t/setup-mfa-in-6-2-saml/126602 "2018-04-04T13:23:35Z")
I am working on setting up SAML in ES 6.2, which will use Shibboleth and InCommon federation. I have gotten something working for SSO and now want to get MFA (multifactor authentication going). I do have MFA working wi… --- ## [Date time format](https://discuss.elastic.co/t/date-time-format/126743)
**Author:** [@Senthiles](https://discuss.elastic.co/u/Senthiles)\ **Replies:** 0\ **Last updated:** [April 4, 2018, 12:59pm UTC](https://discuss.elastic.co/t/date-time-format/126743 "2018-04-04T12:59:20Z")
how to retrieve timestamp with date time format in elastic search [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1728) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1730)