# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1437 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1438 --- ## [OutOfMemory error](https://discuss.elastic.co/t/outofmemory-error/162608)
**Author:** [@pranav24](https://discuss.elastic.co/u/pranav24)\ **Replies:** 11\ **Last updated:** [January 3, 2019, 10:25am UTC](https://discuss.elastic.co/t/outofmemory-error/162608 "2019-01-03T10:25:17Z")
Hi, I'm facing the issue that my Elasticsearch data nodes shutdown automatically for some searches. Elasticsearch version - 6.3.2 Ram - 8gb Heap size - 1gb Documents - 7000(max) This is the error -\> at java.lang.Ou… --- ## [Document Date changes after being indexed into Elasticsearch](https://discuss.elastic.co/t/document-date-changes-after-being-indexed-into-elasticsearch/162770)
**Author:** [@Ong](https://discuss.elastic.co/u/Ong)\ **Replies:** 2\ **Last updated:** [January 3, 2019, 10:13am UTC](https://discuss.elastic.co/t/document-date-changes-after-being-indexed-into-elasticsearch/162770 "2019-01-03T10:13:42Z")
, I have a database and an Elasticsearch setup. Documents are written to the database first and are then indexed into ES. I noticed that the date field in ES is different from that in the database. The date field in E… --- ## [Failed to execute on node while the cluster running about 20 minutes later](https://discuss.elastic.co/t/failed-to-execute-on-node-while-the-cluster-running-about-20-minutes-later/162751)
**Author:** [@liming8519](https://discuss.elastic.co/u/liming8519)\ **Replies:** 3\ **Last updated:** [January 3, 2019, 9:35am UTC](https://discuss.elastic.co/t/failed-to-execute-on-node-while-the-cluster-running-about-20-minutes-later/162751 "2019-01-03T09:35:18Z")
Hi, i'm new using Elastic, I'm facing the issue that my Elasticsearch master nodes got ReceiveTimeoutTransportException after running about 20 minutes. Elasticsearch version - 6.3.2 Ram - 8gb Heap size - 4gb Document… --- ## [Multiples snapshot repositories](https://discuss.elastic.co/t/multiples-snapshot-repositories/162705)
**Author:** [@Joao\_Claudio](https://discuss.elastic.co/u/Joao_Claudio)\ **Replies:** 2\ **Last updated:** [January 3, 2019, 9:00am UTC](https://discuss.elastic.co/t/multiples-snapshot-repositories/162705 "2019-01-03T09:00:03Z")
Greetings, I already have a S3 bucket with one repository with my snapshots of one my elasticsearch cluster. But I have another cluster and I would like to use this S3 to register another snapshot repo. Its is possible? … --- ## [Unable to fetch data from kibana\_settings collector / NoShardsAvailableException](https://discuss.elastic.co/t/unable-to-fetch-data-from-kibana-settings-collector-noshardsavailableexception/162763)
**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\ **Replies:** 0\ **Last updated:** [January 3, 2019, 8:27am UTC](https://discuss.elastic.co/t/unable-to-fetch-data-from-kibana-settings-collector-noshardsavailableexception/162763 "2019-01-03T08:27:37Z")
I am setting up a 7 node cluster with 3 Masters / 3 Data / 1 Coordinating node The cluster is deployed on AWS with ec2 discovery plugin. The nodes are using Amazon Linux 2 and the ES/Kibana versions are 6.4.2 kibana.y… --- ## [Elastic Search and Nest Learning](https://discuss.elastic.co/t/elastic-search-and-nest-learning/162553)
**Author:** [@Hamidnch](https://discuss.elastic.co/u/Hamidnch)\ **Replies:** 2\ **Last updated:** [January 3, 2019, 7:15am UTC](https://discuss.elastic.co/t/elastic-search-and-nest-learning/162553 "2019-01-03T07:15:06Z")
Hi. Where can I find step by step learning Elastic Search and Nest for people very beginner? From zero until 100. thanks. --- ## [Is there any necessary to set node type of an es cluster which only has three nodes?](https://discuss.elastic.co/t/is-there-any-necessary-to-set-node-type-of-an-es-cluster-which-only-has-three-nodes/162735)
**Author:** [@PhilZhang](https://discuss.elastic.co/u/PhilZhang)\ **Replies:** 2\ **Last updated:** [January 3, 2019, 5:08am UTC](https://discuss.elastic.co/t/is-there-any-necessary-to-set-node-type-of-an-es-cluster-which-only-has-three-nodes/162735 "2019-01-03T05:08:02Z")
I set up an elasticsearch cluster which has only three nodes, should I set one as master node and other two as data nodes? And do I have to add more nodes for coordinate and ingest? PS. I will use this cluster in a pro… --- ## [Hardware Recommendations for Shipping IIS Logs](https://discuss.elastic.co/t/hardware-recommendations-for-shipping-iis-logs/162739)
**Author:** [@Machina\_X\_Machina](https://discuss.elastic.co/u/Machina_X_Machina)\ **Replies:** 0\ **Last updated:** [January 3, 2019, 5:01am UTC](https://discuss.elastic.co/t/hardware-recommendations-for-shipping-iis-logs/162739 "2019-01-03T05:01:46Z")
Hi there. I'm going to deploy new IIS Log monitoring system with elasticsearch + Hadoop. The Elasticsearch Cluster would be for storing Microsoft IIS Log. And Hadoop would backup the expired elasticsearch indices(over … --- ## [ES master node.How to set the size of heap space?](https://discuss.elastic.co/t/es-master-node-how-to-set-the-size-of-heap-space/162732)
**Author:** [@xyx](https://discuss.elastic.co/u/xyx)\ **Replies:** 2\ **Last updated:** [January 3, 2019, 4:22am UTC](https://discuss.elastic.co/t/es-master-node-how-to-set-the-size-of-heap-space/162732 "2019-01-03T04:22:09Z")
ES master node.How to set the size of heap space? Can I set it to 1G,I think it is enough.What do you think? --- ## [Error in Index Aliases documentation?](https://discuss.elastic.co/t/error-in-index-aliases-documentation/162727)
**Author:** [@memelet](https://discuss.elastic.co/u/memelet)\ **Replies:** 1\ **Last updated:** [January 3, 2019, 3:09am UTC](https://discuss.elastic.co/t/error-in-index-aliases-documentation/162727 "2019-01-03T03:09:59Z")
In the docs it has this example (Aliases API | Elasticsearch Guide \[8.11\] | Elastic) POST /\_aliases { "actions" : \[ { "add" : { "index" : "test", "alias" : "alia… --- ## [What are Elasticsearch querying guarantees?](https://discuss.elastic.co/t/what-are-elasticsearch-querying-guarantees/162706)
**Author:** [@aaronloesattv](https://discuss.elastic.co/u/aaronloesattv)\ **Replies:** 2\ **Last updated:** [January 2, 2019, 9:20pm UTC](https://discuss.elastic.co/t/what-are-elasticsearch-querying-guarantees/162706 "2019-01-02T21:20:54Z")
We're looking into extending our use of Elasticsearch into a new use cases and I wanted to get some clarity on what Elasticsearch can and cannot do. The one particular area I am concerned with is the data retrieval guara… --- ## [Running as guest executable on Azure Service Fabric standalone cluster](https://discuss.elastic.co/t/running-as-guest-executable-on-azure-service-fabric-standalone-cluster/162431)
**Author:** [@Ran\_Raines\_Moshe](https://discuss.elastic.co/u/Ran_Raines_Moshe)\ **Replies:** 1\ **Last updated:** [January 2, 2019, 9:11pm UTC](https://discuss.elastic.co/t/running-as-guest-executable-on-azure-service-fabric-standalone-cluster/162431 "2019-01-02T21:11:58Z")
Hi, If I would like to run "elasticsearch-service-x64.exe" directly as executable, and not as windows service, without using "elasticsearch.bat", what should I do? I would like to run it on a standalone cluster of Azur… --- ## [How to query and return whether a result has at least one child?](https://discuss.elastic.co/t/how-to-query-and-return-whether-a-result-has-at-least-one-child/162713)
**Author:** [@Caleb\_Ott](https://discuss.elastic.co/u/Caleb_Ott)\ **Replies:** 1\ **Last updated:** [January 2, 2019, 9:02pm UTC](https://discuss.elastic.co/t/how-to-query-and-return-whether-a-result-has-at-least-one-child/162713 "2019-01-02T21:02:35Z")
Hello, I have a type (document) which has a child type (document\_partials). Not all documents have a document\_partial, but some do. I want a query that lets me search against my document type and returns if it has a chi… --- ## [Elasticsearch Proxy Security Policy With Nginx](https://discuss.elastic.co/t/elasticsearch-proxy-security-policy-with-nginx/162623)
**Author:** [@Todd](https://discuss.elastic.co/u/Todd)\ **Replies:** 1\ **Last updated:** [January 2, 2019, 8:00pm UTC](https://discuss.elastic.co/t/elasticsearch-proxy-security-policy-with-nginx/162623 "2019-01-02T20:00:14Z")
Hello everyone， Now, I want to set a proxy before ES by openresty + lua to provide users with a query entry,like Playing HTTP Tricks with Nginx. I have limited some restful API,like /\_search API need limit the size … --- ## [Helpers.bulk not inserting any data](https://discuss.elastic.co/t/helpers-bulk-not-inserting-any-data/162702)
**Author:** [@Samvid\_Kulkarni](https://discuss.elastic.co/u/Samvid_Kulkarni)\ **Replies:** 0\ **Last updated:** [January 2, 2019, 6:56pm UTC](https://discuss.elastic.co/t/helpers-bulk-not-inserting-any-data/162702 "2019-01-02T18:56:22Z")
i am trying to insert data into elasticsearch using elasticsearch-python-dsl api. I am getting data from one index, then i am performing operations on it and then inserting it into another index. below is my code. clie… --- ## [Querying the distinct values from ES index](https://discuss.elastic.co/t/querying-the-distinct-values-from-es-index/162666)
**Author:** [@chetansk](https://discuss.elastic.co/u/chetansk)\ **Replies:** 9\ **Last updated:** [January 2, 2019, 6:28pm UTC](https://discuss.elastic.co/t/querying-the-distinct-values-from-es-index/162666 "2019-01-02T18:28:21Z")
Hi, I am using ES version 1.4.0. I would like to retrieve the unique values from a field in ES index which can be expressed in SQL format as follows: SELECT (DISTINCT UserName) FROM UsersTable; I have tried to use agg… --- ## [5 of 30 shards failed in Elastic 5.5.1](https://discuss.elastic.co/t/5-of-30-shards-failed-in-elastic-5-5-1/162373)
**Author:** [@carrolp](https://discuss.elastic.co/u/carrolp)\ **Replies:** 14\ **Last updated:** [January 2, 2019, 6:06pm UTC](https://discuss.elastic.co/t/5-of-30-shards-failed-in-elastic-5-5-1/162373 "2019-01-02T18:06:37Z")
My project is hitting a '5 of 30 shards failed' error when searching from Kibana. This is very similar to these postings: https://discuss.elastic.co/t/courier-fetch-3-out-of-33-shards-failed/122094 https://discuss… --- ## [Pulling relevant info out of logs in watcher alerts](https://discuss.elastic.co/t/pulling-relevant-info-out-of-logs-in-watcher-alerts/162374)
**Author:** [@Chris\_Meyer](https://discuss.elastic.co/u/Chris_Meyer)\ **Replies:** 5\ **Last updated:** [January 2, 2019, 5:12pm UTC](https://discuss.elastic.co/t/pulling-relevant-info-out-of-logs-in-watcher-alerts/162374 "2019-01-02T17:12:02Z")
Hello, Is there a way to pull information out of logs similar to {{ctx.payload.hits.total}}? Say I am building a report on account lockouts with the goal to send an email if an account gets locked out. "message": "A u… --- ## [How do I build results dinamically from a Dataframe? (Apache Spark)](https://discuss.elastic.co/t/how-do-i-build-results-dinamically-from-a-dataframe-apache-spark/162366)
**Author:** [@yeikel](https://discuss.elastic.co/u/yeikel)\ **Replies:** 2\ **Last updated:** [January 2, 2019, 4:48pm UTC](https://discuss.elastic.co/t/how-do-i-build-results-dinamically-from-a-dataframe-apache-spark/162366 "2019-01-02T16:48:57Z")
I have a Dataframe containing a list of cities as following : val cities = sc.parallelize(Seq("New York")).toDF() Now , for each city , I would like to query Elastic and build a set of results similar to the followi… --- ## [Unable to insert data into ES through spark-submit - works with pyspark](https://discuss.elastic.co/t/unable-to-insert-data-into-es-through-spark-submit-works-with-pyspark/159261)
**Author:** [@rohitgcs](https://discuss.elastic.co/u/rohitgcs)\ **Replies:** 4\ **Last updated:** [January 2, 2019, 4:40pm UTC](https://discuss.elastic.co/t/unable-to-insert-data-into-es-through-spark-submit-works-with-pyspark/159261 "2019-01-02T16:40:39Z")
This is the line I use: .write.options(\*\*es\_write\_conf).mode("append").format("org.elasticsearch.spark.sql").save(esPath) When I run it in a shell launching it with pyspark -jars /usr/lib/spark/jars/elasticsearch-hadoo… --- ## [Elastic stack backup](https://discuss.elastic.co/t/elastic-stack-backup/161935)
**Author:** [@DineshTripathi](https://discuss.elastic.co/u/DineshTripathi)\ **Replies:** 10\ **Last updated:** [January 2, 2019, 4:39pm UTC](https://discuss.elastic.co/t/elastic-stack-backup/161935 "2019-01-02T16:39:58Z")
Hello, After reading various doc's and discussions about Elastic stack backup, I understand the following and would like someone to validate please :- Elasticseach index backup using snapshot feature which will keep s… --- ## [Indexing JSON with nested fields](https://discuss.elastic.co/t/indexing-json-with-nested-fields/161941)
**Author:** [@Buntu\_Dev](https://discuss.elastic.co/u/Buntu_Dev)\ **Replies:** 1\ **Last updated:** [January 2, 2019, 4:38pm UTC](https://discuss.elastic.co/t/indexing-json-with-nested-fields/161941 "2019-01-02T16:38:55Z")
I've a nested json data with nested fields that I want to extract and construct a Scala Map. Heres the sample JSON: "nested\_field": \[ { "airport": "sfo", "score": 1.0 }, { "airport": "phx", "score… --- ## [Unable to find prebuilt jar for Spark 1.6](https://discuss.elastic.co/t/unable-to-find-prebuilt-jar-for-spark-1-6/161865)
**Author:** [@enricoP](https://discuss.elastic.co/u/enricoP)\ **Replies:** 1\ **Last updated:** [January 2, 2019, 4:31pm UTC](https://discuss.elastic.co/t/unable-to-find-prebuilt-jar-for-spark-1-6/161865 "2019-01-02T16:31:23Z")
Hi, I'm trying to use elasticsearch-hadoop in Spark 1.6 (right now It's the only avaible version in our CDH cluster) and I'm having issues with java.lang.ClassNotFoundException using the main jar elasticsearch-hadoop-6.… --- ## [Remove mappings, patterns, templates that I dont need](https://discuss.elastic.co/t/remove-mappings-patterns-templates-that-i-dont-need/162686)
**Author:** [@swright-eti](https://discuss.elastic.co/u/swright-eti)\ **Replies:** 0\ **Last updated:** [January 2, 2019, 4:09pm UTC](https://discuss.elastic.co/t/remove-mappings-patterns-templates-that-i-dont-need/162686 "2019-01-02T16:09:43Z")
There appears to be so much information in Elasticsearch that I dont need. Or at least I dont think that I do. For instance if I take a look at one of my Filebeat indexes GET /filebeat-6.5.3-2019.01.01 I see dynamic temp… --- ## [Error comes while close jobs in machine learning](https://discuss.elastic.co/t/error-comes-while-close-jobs-in-machine-learning/162139)
**Author:** [@Maulish\_Shah](https://discuss.elastic.co/u/Maulish_Shah)\ **Replies:** 1\ **Last updated:** [January 2, 2019, 3:43pm UTC](https://discuss.elastic.co/t/error-comes-while-close-jobs-in-machine-learning/162139 "2019-01-02T15:43:50Z")
currently i started using 14 day trial version to understand the concept of machine learning in elasticsearch but found some problem while closing the created jobs PUT \_xpack/ml/calendars/planned-outagesq/jobs/jobid1 #c… --- ## [Elasticsearch Task API does not cancel tasks](https://discuss.elastic.co/t/elasticsearch-task-api-does-not-cancel-tasks/157751)
**Author:** [@RockD](https://discuss.elastic.co/u/RockD)\ **Replies:** 3\ **Last updated:** [January 2, 2019, 2:43pm UTC](https://discuss.elastic.co/t/elasticsearch-task-api-does-not-cancel-tasks/157751 "2019-01-02T14:43:25Z")
Hi I'm currently having problem with my cluster, trying debuging certain documents that where indexed, I made a query with script in it, and queue various request of that search. The problem is that now I'm trying to c… --- ## [Cannot connect to ES on localhost:9200 on Windows 2008 R2 Server](https://discuss.elastic.co/t/cannot-connect-to-es-on-localhost-9200-on-windows-2008-r2-server/162470)
**Author:** [@sid\_nikhil](https://discuss.elastic.co/u/sid_nikhil)\ **Replies:** 8\ **Last updated:** [January 2, 2019, 2:00pm UTC](https://discuss.elastic.co/t/cannot-connect-to-es-on-localhost-9200-on-windows-2008-r2-server/162470 "2019-01-02T14:00:02Z")
the below image shows kibana and ES are running (I am using OS : Windows 2008 R2 Server) But i cannot connect to ES on localhost:9200 Please check my logs and config files here , if they are fine Kibana.yml Elastic … --- ## [Is it possible to use partial (wild card )search along with fuzzy match?](https://discuss.elastic.co/t/is-it-possible-to-use-partial-wild-card-search-along-with-fuzzy-match/162663)
**Author:** [@ruchi.dalal](https://discuss.elastic.co/u/ruchi.dalal)\ **Replies:** 0\ **Last updated:** [January 2, 2019, 1:56pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-partial-wild-card-search-along-with-fuzzy-match/162663 "2019-01-02T13:56:55Z")
We have a requirement where we want to do a wildcard kind of search along with fuzzy search. So consider a field with below values : aero123 aero1 dynaaero dynaaeromatic If user searches for any of these : aero , ae… --- ## [NoSuchFileException: ingest-geoip after adding volumes to docker-compose file](https://discuss.elastic.co/t/nosuchfileexception-ingest-geoip-after-adding-volumes-to-docker-compose-file/162661)
**Author:** [@Bilal](https://discuss.elastic.co/u/Bilal)\ **Replies:** 0\ **Last updated:** [January 2, 2019, 1:31pm UTC](https://discuss.elastic.co/t/nosuchfileexception-ingest-geoip-after-adding-volumes-to-docker-compose-file/162661 "2019-01-02T13:31:57Z")
I want to add some local files to docker using volumes, after adding this line to docker-compose.yml file: volumes: - /home/myUsername/elasticsearch/config:/usr/share/elasticsearch/config I got this error when runnin… --- ## [Most efficient sorting on nested values](https://discuss.elastic.co/t/most-efficient-sorting-on-nested-values/162653)
**Author:** [@scarabas](https://discuss.elastic.co/u/scarabas)\ **Replies:** 0\ **Last updated:** [January 2, 2019, 12:44pm UTC](https://discuss.elastic.co/t/most-efficient-sorting-on-nested-values/162653 "2019-01-02T12:44:53Z")
I am sorting results from Elasticsearch (5.1.1) based on a calculation of values in nested key/value structures. The sorting has to: find values from given keys across multiple nested structures multiply those values … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1436) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1438)