# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1862 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1863 --- ## [Can Elasticsearch automatically remove data?](https://discuss.elastic.co/t/can-elasticsearch-automatically-remove-data/110364)
**Author:** [@mannoj87](https://discuss.elastic.co/u/mannoj87)\ **Replies:** 3\ **Last updated:** [December 7, 2017, 7:52pm UTC](https://discuss.elastic.co/t/can-elasticsearch-automatically-remove-data/110364 "2017-12-07T19:52:00Z")
Can Elasticsearch automatically remove data? I'm using ES 2.3. We have 26nodes in a cluster with three Master nodes and rest are data nodes. There will huge writes happening through out the day. We see in one of the … --- ## [Memory requirements for mobile app](https://discuss.elastic.co/t/memory-requirements-for-mobile-app/110657)
**Author:** [@mackrispi](https://discuss.elastic.co/u/mackrispi)\ **Replies:** 3\ **Last updated:** [December 7, 2017, 6:48pm UTC](https://discuss.elastic.co/t/memory-requirements-for-mobile-app/110657 "2017-12-07T18:48:48Z")
Hello, I would really like to ask you for a little help … As a startup project,paid from my own pocket, I would like to integrate fulltext search capabilities into my mobile app. I use Mysql 5.7.19 on CentOS inside Am… --- ## [Elasticsearch cluster in Docker Swarm](https://discuss.elastic.co/t/elasticsearch-cluster-in-docker-swarm/110723)
**Author:** [@muhaha](https://discuss.elastic.co/u/muhaha)\ **Replies:** 0\ **Last updated:** [December 7, 2017, 5:34pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-in-docker-swarm/110723 "2017-12-07T17:34:57Z")
Hello, Its better to deploy 3 services with 1 replica connected to cluster, or deploy 1 service with 3 replicas? There are minimum informations about elasticsearch cluster in docker. I dont know how to aproach to this … --- ## [Is there a way to cat only yellow shards in haproxy.cfg?](https://discuss.elastic.co/t/is-there-a-way-to-cat-only-yellow-shards-in-haproxy-cfg/108916)
**Author:** [@rogue](https://discuss.elastic.co/u/rogue)\ **Replies:** 4\ **Last updated:** [December 7, 2017, 5:32pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-cat-only-yellow-shards-in-haproxy-cfg/108916 "2017-12-07T17:32:56Z")
Hello fellas! I would like to have yellow shards for one of my backend configs. Right now I have this one: backend blabla mode tcp balance roundrobin option httpchk get /\_cat/indices http-check expect rstring \\b… --- ## [Understand and using relationships without mapping types (6.0)](https://discuss.elastic.co/t/understand-and-using-relationships-without-mapping-types-6-0/109863)
**Author:** [@Malik\_Rumi](https://discuss.elastic.co/u/Malik_Rumi)\ **Replies:** 5\ **Last updated:** [December 7, 2017, 5:26pm UTC](https://discuss.elastic.co/t/understand-and-using-relationships-without-mapping-types-6-0/109863 "2017-12-07T17:26:34Z")
RE: Removal of mapping types https://www.elastic.co/guide/en/elasticsearch/reference/current/removal-of-types.html It looks like the proposed solution is to use a "common key" - my term. Such a common key can tie a use… --- ## [If one node fail, could another one succeed to receive data?](https://discuss.elastic.co/t/if-one-node-fail-could-another-one-succeed-to-receive-data/110714)
**Author:** [@f26227279](https://discuss.elastic.co/u/f26227279)\ **Replies:** 4\ **Last updated:** [December 7, 2017, 4:38pm UTC](https://discuss.elastic.co/t/if-one-node-fail-could-another-one-succeed-to-receive-data/110714 "2017-12-07T16:38:25Z")
Hi everyone, this is my cluster structure: \[image\] I use node1 to receive data from logstash. But I am worry about that if node1 failed, could node2 or node3 succeed to node1 to receive the data from logstash, otherwi… --- ## [Curator snapshot](https://discuss.elastic.co/t/curator-snapshot/110612)
**Author:** [@Chelambarasan\_CR](https://discuss.elastic.co/u/Chelambarasan_CR)\ **Replies:** 5\ **Last updated:** [December 7, 2017, 4:17pm UTC](https://discuss.elastic.co/t/curator-snapshot/110612 "2017-12-07T16:17:22Z")
Hi , I am new to curator and trying to take a snapshot with curator. Below is the action file i used actions: 1: action: snapshot options: repository: backup name: migsnap ignore\_unavailable: True include\_globa… --- ## [Health Check URL](https://discuss.elastic.co/t/health-check-url/110673)
**Author:** [@Jerjef](https://discuss.elastic.co/u/Jerjef)\ **Replies:** 4\ **Last updated:** [December 7, 2017, 4:15pm UTC](https://discuss.elastic.co/t/health-check-url/110673 "2017-12-07T16:15:16Z")
I have Elasticsearch 6.0.0.1 installed and operating fine, but none of the URL functions are working for me. For example, I enter http://:9200/\_ cat/health?v into a web browser (with the applicable IP address of course… --- ## [Elasticsearch autocomplete- sorting words by their relevance to a keyword](https://discuss.elastic.co/t/elasticsearch-autocomplete-sorting-words-by-their-relevance-to-a-keyword/110603)
**Author:** [@arafath](https://discuss.elastic.co/u/arafath)\ **Replies:** 3\ **Last updated:** [December 7, 2017, 4:13pm UTC](https://discuss.elastic.co/t/elasticsearch-autocomplete-sorting-words-by-their-relevance-to-a-keyword/110603 "2017-12-07T16:13:07Z")
I'm currently working on a search using elasticsearch. We have a very large amount of users. Here is the elasticsearch mapping : PUT /example\_index/\_mapping/users { "properties": { "user\_autocomplete": { "ty… --- ## [Nested doc match only one doc and query term](https://discuss.elastic.co/t/nested-doc-match-only-one-doc-and-query-term/110711)
**Author:** [@tinman](https://discuss.elastic.co/u/tinman)\ **Replies:** 0\ **Last updated:** [December 7, 2017, 4:03pm UTC](https://discuss.elastic.co/t/nested-doc-match-only-one-doc-and-query-term/110711 "2017-12-07T16:03:59Z")
Slight background: ES version: 5.5, Use case: a part will have a list of attributes and each attribute as the mapping below shows has name/value combo. Mapping: { "parts": { "mappings": { "basic": { … --- ## [ES2.0.2 - Heap near 100% and eventually Elasticsearch locks up](https://discuss.elastic.co/t/es2-0-2-heap-near-100-and-eventually-elasticsearch-locks-up/108462)
**Author:** [@Brian\_Albright](https://discuss.elastic.co/u/Brian_Albright)\ **Replies:** 7\ **Last updated:** [December 7, 2017, 3:49pm UTC](https://discuss.elastic.co/t/es2-0-2-heap-near-100-and-eventually-elasticsearch-locks-up/108462 "2017-12-07T15:49:01Z")
Hello! First post so apologies if i'm leaving something important out. We are running into some problems weekly-ish where the heap utilization floats near 100% after a while, and eventually crashes Elaticsearch, requir… --- ## [How to replace string without regexp inside Painless inline script for AWS ElasticSearch?](https://discuss.elastic.co/t/how-to-replace-string-without-regexp-inside-painless-inline-script-for-aws-elasticsearch/110707)
**Author:** [@KIVagant](https://discuss.elastic.co/u/KIVagant)\ **Replies:** 0\ **Last updated:** [December 7, 2017, 3:37pm UTC](https://discuss.elastic.co/t/how-to-replace-string-without-regexp-inside-painless-inline-script-for-aws-elasticsearch/110707 "2017-12-07T15:37:34Z")
This is a copy from the StackOverflow question: The type of the "level" field in the document was changed from "keyword" to "short" and I'm trying to reindex exist data to be able to use it in Kibana charts. Old data c… --- ## [DANGLING\_INDEX\_IMPORTED as reason of unassigned shards](https://discuss.elastic.co/t/dangling-index-imported-as-reason-of-unassigned-shards/110640)
**Author:** [@vsevolodk](https://discuss.elastic.co/u/vsevolodk)\ **Replies:** 2\ **Last updated:** [December 7, 2017, 3:16pm UTC](https://discuss.elastic.co/t/dangling-index-imported-as-reason-of-unassigned-shards/110640 "2017-12-07T15:16:34Z")
Hello. Can you please give more detailed description about this reason DANGLING\_INDEX\_IMPORTED In documentation I see next Unassigned as a result of importing a dangling index. but I don't understand what does it mean… --- ## [X-pack\\..\\elasticsearch-env.bat"' is not recognized as an internal or external command](https://discuss.elastic.co/t/x-pack-elasticsearch-env-bat-is-not-recognized-as-an-internal-or-external-command/110641)
**Author:** [@mrba](https://discuss.elastic.co/u/mrba)\ **Replies:** 9\ **Last updated:** [December 7, 2017, 3:13pm UTC](https://discuss.elastic.co/t/x-pack-elasticsearch-env-bat-is-not-recognized-as-an-internal-or-external-command/110641 "2017-12-07T15:13:41Z")
Hello everyone, I am trying to install the x\_pack on elasticsearch i've followed every instructions in this guide I set up the elasticsearch.yml file as it says , I restart elasticsearch and in one line I get this: \[… --- ## ["type": "illegal\_argument\_exception", "reason": "\[field\_sort\] unknown field \[title\], parser not found"](https://discuss.elastic.co/t/type-illegal-argument-exception-reason-field-sort-unknown-field-title-parser-not-found/110681)
**Author:** [@psksatish](https://discuss.elastic.co/u/psksatish)\ **Replies:** 1\ **Last updated:** [December 7, 2017, 2:37pm UTC](https://discuss.elastic.co/t/type-illegal-argument-exception-reason-field-sort-unknown-field-title-parser-not-found/110681 "2017-12-07T14:37:03Z")
{ "query":{ "bool": { "must": { "bool": { "should": \[ { "range": { "createdOn": { "gte": "1481049000000", "lte": "1512671399000" } } } \], "must\_not": \[ { "match": { "deleteFlag": "1" } } \] } }, "f… --- ## [Compare the number of indexes](https://discuss.elastic.co/t/compare-the-number-of-indexes/109726)
**Author:** [@EloaCardoso](https://discuss.elastic.co/u/EloaCardoso)\ **Replies:** 9\ **Last updated:** [December 7, 2017, 9:51am UTC](https://discuss.elastic.co/t/compare-the-number-of-indexes/109726 "2017-12-07T09:51:21Z")
Is there a way to compare the number of indexes created today with the number of indexes that existed already using a search operation with query? --- ## [Elasticsearch Java Security Manager: somaxconn read permissions](https://discuss.elastic.co/t/elasticsearch-java-security-manager-somaxconn-read-permissions/110511)
**Author:** [@ize0j10](https://discuss.elastic.co/u/ize0j10)\ **Replies:** 7\ **Last updated:** [December 7, 2017, 2:05pm UTC](https://discuss.elastic.co/t/elasticsearch-java-security-manager-somaxconn-read-permissions/110511 "2017-12-07T14:05:14Z")
Hi, I am experiencing a Java Security Manager issue when running Elasticsearch with the official docker image in Version 5.6.4 setting log level to DEBUG. Elasticsearch throws an exception during start: Dec 06 09:14… --- ## [Ingest attachment java ES](https://discuss.elastic.co/t/ingest-attachment-java-es/110351)
**Author:** [@Chelambarasan\_CR](https://discuss.elastic.co/u/Chelambarasan_CR)\ **Replies:** 5\ **Last updated:** [December 7, 2017, 1:51pm UTC](https://discuss.elastic.co/t/ingest-attachment-java-es/110351 "2017-12-07T13:51:21Z")
Hi , I am using ES 5.6.3 and a custom application to index the file system content. In my index type, some fields needs to be stored as normal fields and file content needs to use ingest attachment pipeline. PUT \_ing… --- ## [Restclient fails with concurrent.TimeoutException Exception](https://discuss.elastic.co/t/restclient-fails-with-concurrent-timeoutexception-exception/109736)
**Author:** [@vyas.radhakrishnan](https://discuss.elastic.co/u/vyas.radhakrishnan)\ **Replies:** 4\ **Last updated:** [December 7, 2017, 12:58pm UTC](https://discuss.elastic.co/t/restclient-fails-with-concurrent-timeoutexception-exception/109736 "2017-12-07T12:58:00Z")
Indexing is failing with following exception . I am using Elastic Search REST client 5.6.4 and Elastic Server 5.6.4. I saw a similar post , but no resolution given . can i get some pointers ? Caused by: java.util.concu… --- ## [Get bulk data from elasticsearch](https://discuss.elastic.co/t/get-bulk-data-from-elasticsearch/110489)
**Author:** [@ajit](https://discuss.elastic.co/u/ajit)\ **Replies:** 3\ **Last updated:** [December 7, 2017, 12:49pm UTC](https://discuss.elastic.co/t/get-bulk-data-from-elasticsearch/110489 "2017-12-07T12:49:38Z")
I am using scroll API to fetch data from elasticsearch. I have 400000 records in elasticsearch. And it is taking 2min. to fetch from elasticsearch. How can I reduce this time from minutes to seconds. I have attached my … --- ## [Issues with Audit Log](https://discuss.elastic.co/t/issues-with-audit-log/108322)
**Author:** [@admlko](https://discuss.elastic.co/u/admlko)\ **Replies:** 7\ **Last updated:** [December 7, 2017, 12:27pm UTC](https://discuss.elastic.co/t/issues-with-audit-log/108322 "2017-12-07T12:27:38Z")
Hi, I was reading about some problems with auditing already in spring and was hoping that it would be fixed by now, but no cigar. Because we are running Elastic stack as a log management / SIEM system, it is extremely … --- ## [Get x-pack 6.0.1 java doc link](https://discuss.elastic.co/t/get-x-pack-6-0-1-java-doc-link/110662)
**Author:** [@Gaurav22.Kumar](https://discuss.elastic.co/u/Gaurav22.Kumar)\ **Replies:** 1\ **Last updated:** [December 7, 2017, 12:05pm UTC](https://discuss.elastic.co/t/get-x-pack-6-0-1-java-doc-link/110662 "2017-12-07T12:05:27Z")
Please provide me java doc link for x-pack 6.0.1 .I need to explore java api for alerting and machine learning. If possible ,guide us to java doc link. --- ## [BulkProcessor performance problem](https://discuss.elastic.co/t/bulkprocessor-performance-problem/110070)
**Author:** [@soner](https://discuss.elastic.co/u/soner)\ **Replies:** 2\ **Last updated:** [December 7, 2017, 11:46am UTC](https://discuss.elastic.co/t/bulkprocessor-performance-problem/110070 "2017-12-07T11:46:06Z")
Hi all, I'm using Elasticsearch for my thesis to develop a new index pruning algorithm and making benchmarking different index pruning methodologies. Hardware: I'm using Elasticsearch 6.0 on MacBBook Pro (CPU 2.6 GHz … --- ## [Nodes keep disconnecting from cluster at random](https://discuss.elastic.co/t/nodes-keep-disconnecting-from-cluster-at-random/109592)
**Author:** [@Paul\_Zaltsman](https://discuss.elastic.co/u/Paul_Zaltsman)\ **Replies:** 7\ **Last updated:** [December 7, 2017, 11:19am UTC](https://discuss.elastic.co/t/nodes-keep-disconnecting-from-cluster-at-random/109592 "2017-12-07T11:19:45Z")
Hi, i have an issue with a 5.5.2 ES cluster. We see a lot of disconnects between our nodes. Even sending a simple \_nodes query causes random disconnections. In this example. Only the node i've asked answered. Rest fail… --- ## [BucketPath to ScriptedMetric not working?](https://discuss.elastic.co/t/bucketpath-to-scriptedmetric-not-working/109904)
**Author:** [@SparkyRih](https://discuss.elastic.co/u/SparkyRih)\ **Replies:** 3\ **Last updated:** [December 7, 2017, 10:36am UTC](https://discuss.elastic.co/t/bucketpath-to-scriptedmetric-not-working/109904 "2017-12-07T10:36:26Z")
I'm trying to get a ScriptedMetric in a BucketScript, that should be possible right? This is my query (in NEST) .ScriptedMetric("Urgency-Level", sm =\> sm .InitScript(i =\> i.Inline("params.\_agg.data = \[\]").Lang("painle… --- ## [Created and modified date](https://discuss.elastic.co/t/created-and-modified-date/110604)
**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\ **Replies:** 1\ **Last updated:** [December 7, 2017, 9:23am UTC](https://discuss.elastic.co/t/created-and-modified-date/110604 "2017-12-07T09:23:16Z")
Hi I need to store created datetime and modified datetime for index. While getting data how I can read that? Thanks Aneesh --- ## [Need to Create dashboard Using Data in elastic search](https://discuss.elastic.co/t/need-to-create-dashboard-using-data-in-elastic-search/110617)
**Author:** [@Ramakrishna](https://discuss.elastic.co/u/Ramakrishna)\ **Replies:** 1\ **Last updated:** [December 7, 2017, 9:11am UTC](https://discuss.elastic.co/t/need-to-create-dashboard-using-data-in-elastic-search/110617 "2017-12-07T09:11:06Z")
Is it possible to get the elastic search index to a dashboard using jQuery..? --- ## [Function Scoring in Percolation](https://discuss.elastic.co/t/function-scoring-in-percolation/110635)
**Author:** [@Rahul\_Kulhari](https://discuss.elastic.co/u/Rahul_Kulhari)\ **Replies:** 0\ **Last updated:** [December 7, 2017, 8:52am UTC](https://discuss.elastic.co/t/function-scoring-in-percolation/110635 "2017-12-07T08:52:29Z")
When we are running below function score, it is working fine. But if we run same query using percolation on same document, it isn't working. Refer to below query: { "function\_score": { "qu… --- ## [Elasticsearch and Pentaho](https://discuss.elastic.co/t/elasticsearch-and-pentaho/110630)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 2\ **Last updated:** [December 7, 2017, 8:47am UTC](https://discuss.elastic.co/t/elasticsearch-and-pentaho/110630 "2017-12-07T08:47:29Z")
Is it possible to query Elasticsearch from Pentaho? I know this more relevant question in the Pentaho forum, but just would like to know in case if you have any information related to this integration. --- ## [Export .evtx to ES gives strange error in "Properties " field](https://discuss.elastic.co/t/export-evtx-to-es-gives-strange-error-in-properties-field/110626)
**Author:** [@rush](https://discuss.elastic.co/u/rush)\ **Replies:** 0\ **Last updated:** [December 7, 2017, 7:53am UTC](https://discuss.elastic.co/t/export-evtx-to-es-gives-strange-error-in-properties-field/110626 "2017-12-07T07:53:22Z")
Hi Team, I'm new to ES. I'm using a power shell script to export saved Windows Event (syslog events) to Es directly. It work fine but If you check exported data by Kibana , in side event data "properties " field optio… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1861) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1863)