# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1909

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1910

---

## [Find a date range witch donc exist](https://discuss.elastic.co/t/find-a-date-range-witch-donc-exist/105358)

<div class="topic-metadata">

**Author:** [@devozanges](https://discuss.elastic.co/u/devozanges)\
**Replies:** 5\
**Last updated:** [October 26, 2017, 11:25am UTC](https://discuss.elastic.co/t/find-a-date-range-witch-donc-exist/105358 "2017-10-26T11:25:53Z")

</div>

Hi, I'm a new Elasticsearch user (v1.7). I have an index who look like this : // house with occuped planning { "id": "54", "city": "foo", "planning": \[ { …

---

## [How to set ES heap memory in yml file](https://discuss.elastic.co/t/how-to-set-es-heap-memory-in-yml-file/105402)

<div class="topic-metadata">

**Author:** [@sathishkumaru](https://discuss.elastic.co/u/sathishkumaru)\
**Replies:** 4\
**Last updated:** [October 26, 2017, 11:19am UTC](https://discuss.elastic.co/t/how-to-set-es-heap-memory-in-yml-file/105402 "2017-10-26T11:19:52Z")

</div>

how to set ES heap memory in yml file. please give some sample

---

## [Using term position to re-score](https://discuss.elastic.co/t/using-term-position-to-re-score/105415)

<div class="topic-metadata">

**Author:** [@angelcab](https://discuss.elastic.co/u/angelcab)\
**Replies:** 0\
**Last updated:** [October 26, 2017, 11:17am UTC](https://discuss.elastic.co/t/using-term-position-to-re-score/105415 "2017-10-26T11:17:50Z")

</div>

Hi I'm trying to create a script to modify the score of my queries. I want to access the position of a word in the results I am obtaining. For example the word: "global" in the string name= "Global corporation". So I …

---

## [Document Preview and Keymatch Search support in ElasticSearch?](https://discuss.elastic.co/t/document-preview-and-keymatch-search-support-in-elasticsearch/105393)

<div class="topic-metadata">

**Author:** [@gautam\_gro](https://discuss.elastic.co/u/gautam_gro)\
**Replies:** 1\
**Last updated:** [October 26, 2017, 11:13am UTC](https://discuss.elastic.co/t/document-preview-and-keymatch-search-support-in-elasticsearch/105393 "2017-10-26T11:13:08Z")

</div>

Is there any feature within ElasticSearch for Keymatch search and Document Preview? Same features are inbuilt in GSA Google Search Appliance..... Please help?

---

## [Storing Twitter Data - What would be the best choice?](https://discuss.elastic.co/t/storing-twitter-data-what-would-be-the-best-choice/105383)

<div class="topic-metadata">

**Author:** [@DavidK](https://discuss.elastic.co/u/DavidK)\
**Replies:** 1\
**Last updated:** [October 26, 2017, 11:02am UTC](https://discuss.elastic.co/t/storing-twitter-data-what-would-be-the-best-choice/105383 "2017-10-26T11:02:14Z")

</div>

I am currently working on a project involving Twitter Data. The team has been advised not to use Elasticsearch to store tweets because it's not a best practice. (they are thinking to use Amazon RDS...) I've seen that i…

---

## [Search performance on elasticsearch](https://discuss.elastic.co/t/search-performance-on-elasticsearch/105400)

<div class="topic-metadata">

**Author:** [@LakshmiTF](https://discuss.elastic.co/u/LakshmiTF)\
**Replies:** 0\
**Last updated:** [October 26, 2017, 10:14am UTC](https://discuss.elastic.co/t/search-performance-on-elasticsearch/105400 "2017-10-26T10:14:22Z")

</div>

Hi Team, I have a requirement where in a search query results around 10 lacks of documents of elasticsearch. This search query is based on the aggreation. To get count of each bucket, I have iterated the buckets in th…

---

## [Downtime when transporting alias name version in 2.4.2](https://discuss.elastic.co/t/downtime-when-transporting-alias-name-version-in-2-4-2/105397)

<div class="topic-metadata">

**Author:** [@RafaelPosthaus](https://discuss.elastic.co/u/RafaelPosthaus)\
**Replies:** 0\
**Last updated:** [October 26, 2017, 10:08am UTC](https://discuss.elastic.co/t/downtime-when-transporting-alias-name-version-in-2-4-2/105397 "2017-10-26T10:08:19Z")

</div>

I have an application for full text search that uses elasticsearch 2.4.2, I use it with java api. At dawn each day I go back to my indexes, and I transfer the alias to the new index created. But I seem to have a downti…

---

## [How to retrieve field statistics now that \_field\_stats is deprecated](https://discuss.elastic.co/t/how-to-retrieve-field-statistics-now-that-field-stats-is-deprecated/104803)

<div class="topic-metadata">

**Author:** [@Shai\_Erera](https://discuss.elastic.co/u/Shai_Erera)\
**Replies:** 2\
**Last updated:** [October 26, 2017, 9:53am UTC](https://discuss.elastic.co/t/how-to-retrieve-field-statistics-now-that-field-stats-is-deprecated/104803 "2017-10-26T09:53:06Z")

</div>

Hi I read that \_field\_stats is deprecated and that I should use \_field\_caps or min/max aggregations. I use this API today to retrieve field statistics such as sum\_ttf and sum\_docfreq. From \_field\_caps docs, I don't see …

---

## [Spring data elasticsearch or java elasticsearch api is better](https://discuss.elastic.co/t/spring-data-elasticsearch-or-java-elasticsearch-api-is-better/105378)

<div class="topic-metadata">

**Author:** [@LakshmiTF](https://discuss.elastic.co/u/LakshmiTF)\
**Replies:** 0\
**Last updated:** [October 26, 2017, 9:09am UTC](https://discuss.elastic.co/t/spring-data-elasticsearch-or-java-elasticsearch-api-is-better/105378 "2017-10-26T09:09:55Z")

</div>

Hi Team, I am working for an application. This application does CRUD operations to elasticsearch along with search queries. I am using spring data elasticsearch repositories/elasticsearchTemplate for CRUD operations. …

---

## [Disabling Replica Shard Check](https://discuss.elastic.co/t/disabling-replica-shard-check/105023)

<div class="topic-metadata">

**Author:** [@jmukhtar](https://discuss.elastic.co/u/jmukhtar)\
**Replies:** 4\
**Last updated:** [October 26, 2017, 9:37am UTC](https://discuss.elastic.co/t/disabling-replica-shard-check/105023 "2017-10-26T09:37:32Z")

</div>

I am running a single node ES with no replica's and monitoring it via icinga/nagios. I have set the replica shards to 0 via the curl command curl -XPUT 'localhost:9200/\_settings?pretty' -H 'Content-Type: application/jso…

---

## [Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask](https://discuss.elastic.co/t/execution-error-return-code-2-from-org-apache-hadoop-hive-ql-exec-mr-mapredtask/103501)

<div class="topic-metadata">

**Author:** [@sagarsingh20](https://discuss.elastic.co/u/sagarsingh20)\
**Replies:** 5\
**Last updated:** [October 26, 2017, 9:31am UTC](https://discuss.elastic.co/t/execution-error-return-code-2-from-org-apache-hadoop-hive-ql-exec-mr-mapredtask/103501 "2017-10-26T09:31:11Z")

</div>

Hadoop env - 2.6.0-cdh5.11.0 Elastic - 2.4.4 Hive - version 1.1.0-cdh5.11.0 So, i created a basic external table using the query :- CREATE EXTERNAL TABLE testESHIVE (name STRING) STORED BY 'org.elasticsearch.hadoo…

---

## [Increase queue size in AWS elasticsearch](https://discuss.elastic.co/t/increase-queue-size-in-aws-elasticsearch/105019)

<div class="topic-metadata">

**Author:** [@patricia022](https://discuss.elastic.co/u/patricia022)\
**Replies:** 8\
**Last updated:** [October 26, 2017, 8:56am UTC](https://discuss.elastic.co/t/increase-queue-size-in-aws-elasticsearch/105019 "2017-10-26T08:56:26Z")

</div>

I wasn't able to modify queue size in aws elasticsearch I am getting this error { "Message": "Your request: '/\_cluster/settings' payload is not allowed." } Elasticsearch query: PUT \_cluster/settings { "persistent…

---

## [Amount of nodes](https://discuss.elastic.co/t/amount-of-nodes/105368)

<div class="topic-metadata">

**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\
**Replies:** 3\
**Last updated:** [October 26, 2017, 8:39am UTC](https://discuss.elastic.co/t/amount-of-nodes/105368 "2017-10-26T08:39:53Z")

</div>

Hi In the article linked below, I saw that for a daily rollover of indexes and around 5 shards per index my cluster will be hurting after around 6 months unless I have around 15 ES nodes. Here is the quote: "If you r…

---

## [How to show curl request and response from rails application into kibana](https://discuss.elastic.co/t/how-to-show-curl-request-and-response-from-rails-application-into-kibana/105354)

<div class="topic-metadata">

**Author:** [@curious1](https://discuss.elastic.co/u/curious1)\
**Replies:** 0\
**Last updated:** [October 26, 2017, 7:29am UTC](https://discuss.elastic.co/t/how-to-show-curl-request-and-response-from-rails-application-into-kibana/105354 "2017-10-26T07:29:06Z")

</div>

Hello, I am forwarding logs from my rails application to kibana and i have used elastic search and logstash for that . On rails side, i am using filebeat for forwarding logs. I am confused about how to show curl reque…

---

## [XPACK installation](https://discuss.elastic.co/t/xpack-installation/105345)

<div class="topic-metadata">

**Author:** [@Amin1](https://discuss.elastic.co/u/Amin1)\
**Replies:** 2\
**Last updated:** [October 26, 2017, 7:16am UTC](https://discuss.elastic.co/t/xpack-installation/105345 "2017-10-26T07:16:10Z")

</div>

Hello team, I have the following configuration : ingest node --- 3 master node----3 data node------3 one node for kibana how I install Xpack node ? it is necessary to install for all node ? how I config it ?

---

## [How many shards for 60GB daily index?](https://discuss.elastic.co/t/how-many-shards-for-60gb-daily-index/103159)

<div class="topic-metadata">

**Author:** [@slavik57](https://discuss.elastic.co/u/slavik57)\
**Replies:** 12\
**Last updated:** [October 26, 2017, 6:09am UTC](https://discuss.elastic.co/t/how-many-shards-for-60gb-daily-index/103159 "2017-10-26T06:09:06Z")

</div>

I am trying to configure an ELK stack and have timeouts when performing queries from kibana. After researching for a while I couldn't find a good answer to my question, how many shards should I use... We use ELK to col…

---

## [Fscrawler missing the field file.extension when indexing through Rest API](https://discuss.elastic.co/t/fscrawler-missing-the-field-file-extension-when-indexing-through-rest-api/105334)

<div class="topic-metadata">

**Author:** [@Suresh\_Nataraj](https://discuss.elastic.co/u/Suresh_Nataraj)\
**Replies:** 2\
**Last updated:** [October 26, 2017, 6:05am UTC](https://discuss.elastic.co/t/fscrawler-missing-the-field-file-extension-when-indexing-through-rest-api/105334 "2017-10-26T06:05:58Z")

</div>

Hi All, I am using scrawler to index some PDF documents into ES . I noticed when I use Rest API , it misses the field file.extension . But it indexes when I Index from filesystem . Any idea why it is missing it ? Thank…

---

## [Adobe Acrobat Reader could not open 'dashboard.pdf'](https://discuss.elastic.co/t/adobe-acrobat-reader-could-not-open-dashboard-pdf/105234)

<div class="topic-metadata">

**Author:** [@pjanzen](https://discuss.elastic.co/u/pjanzen)\
**Replies:** 6\
**Last updated:** [October 26, 2017, 5:41am UTC](https://discuss.elastic.co/t/adobe-acrobat-reader-could-not-open-dashboard-pdf/105234 "2017-10-26T05:41:29Z")

</div>

Hi All, I created a watcher with an email action to generate a dashboard pdf and send that out to an email address. In principal this works however the pdf cannot be opened with the error: Adobe Acrobat Reader could n…

---

## [Not able to Connect to Elasticsearcsearch and Kibana from remote machine](https://discuss.elastic.co/t/not-able-to-connect-to-elasticsearcsearch-and-kibana-from-remote-machine/105182)

<div class="topic-metadata">

**Author:** [@sanju1323](https://discuss.elastic.co/u/sanju1323)\
**Replies:** 3\
**Last updated:** [October 26, 2017, 5:28am UTC](https://discuss.elastic.co/t/not-able-to-connect-to-elasticsearcsearch-and-kibana-from-remote-machine/105182 "2017-10-26T05:28:36Z")

</div>

Hi, I have installed Elasticsearch and Kibana on Linux machine. Locally both are working fine and the ports 9200, 5601 are open and are listening. I have changed the network.host : 0.0.0.0 and transport.host : localho…

---

## [Synonym file support for ElasticSearch 5.x in AWS](https://discuss.elastic.co/t/synonym-file-support-for-elasticsearch-5-x-in-aws/105320)

<div class="topic-metadata">

**Author:** [@gautam\_gro](https://discuss.elastic.co/u/gautam_gro)\
**Replies:** 4\
**Last updated:** [October 26, 2017, 5:17am UTC](https://discuss.elastic.co/t/synonym-file-support-for-elasticsearch-5-x-in-aws/105320 "2017-10-26T05:17:06Z")

</div>

As we know, Elasticsearch supports synonyms through their synonym token filter, which expects a file of all the synonyms to be present at a particular location on the server filesystem. Is there a way I can configure th…

---

## [How to Stop, \_close or re-index in Amazon ES (AWS)](https://discuss.elastic.co/t/how-to-stop-close-or-re-index-in-amazon-es-aws/105322)

<div class="topic-metadata">

**Author:** [@gautam\_gro](https://discuss.elastic.co/u/gautam_gro)\
**Replies:** 3\
**Last updated:** [October 26, 2017, 5:15am UTC](https://discuss.elastic.co/t/how-to-stop-close-or-re-index-in-amazon-es-aws/105322 "2017-10-26T05:15:39Z")

</div>

I want to update mappings of existing index in Amazon ES (AWS). But i am getting error...."Your request 'https://amazon.xx.xxxxxx/testindex/\_close' is not allowed by Amazon ElasticSearch service" Any suggestion?

---

## [Using uax\_url\_email tokenizer and ngram together](https://discuss.elastic.co/t/using-uax-url-email-tokenizer-and-ngram-together/105327)

<div class="topic-metadata">

**Author:** [@sidra\_89](https://discuss.elastic.co/u/sidra_89)\
**Replies:** 1\
**Last updated:** [October 26, 2017, 5:10am UTC](https://discuss.elastic.co/t/using-uax-url-email-tokenizer-and-ngram-together/105327 "2017-10-26T05:10:08Z")

</div>

Hi, i want to use both ngram filter and uax\_url\_email tokenizer on email address. so is there any way to combine two tokenizer into a single custom analyzer ? so that i could search for helloworld@gmail.com as well as…

---

## [Use mapping character filter from file](https://discuss.elastic.co/t/use-mapping-character-filter-from-file/102485)

<div class="topic-metadata">

**Author:** [@MPurcell](https://discuss.elastic.co/u/MPurcell)\
**Replies:** 11\
**Last updated:** [October 26, 2017, 3:22am UTC](https://discuss.elastic.co/t/use-mapping-character-filter-from-file/102485 "2017-10-26T03:22:24Z")

</div>

Hello! I'm looking to use the mapping character filter over a large number of terms. The basic idea is that I'm trying to standardize street addresses based on the USPS list seen here: https://pe.usps.com/text/pub28/28…

---

## [Avoiding repetition when defining mappings](https://discuss.elastic.co/t/avoiding-repetition-when-defining-mappings/105315)

<div class="topic-metadata">

**Author:** [@rretter](https://discuss.elastic.co/u/rretter)\
**Replies:** 0\
**Last updated:** [October 26, 2017, 12:20am UTC](https://discuss.elastic.co/t/avoiding-repetition-when-defining-mappings/105315 "2017-10-26T00:20:53Z")

</div>

I've got a type with many similar fields, and most of them could do quite well letting Elasticsearch apply its dynamic mapping. But let's say I'd prefer to avoid relying on the correctness of dynamic mapping. And I als…

---

## [How to write match query in C# .net for phenetic search](https://discuss.elastic.co/t/how-to-write-match-query-in-c-net-for-phenetic-search/105306)

<div class="topic-metadata">

**Author:** [@timragon](https://discuss.elastic.co/u/timragon)\
**Replies:** 0\
**Last updated:** [October 25, 2017, 10:26pm UTC](https://discuss.elastic.co/t/how-to-write-match-query-in-c-net-for-phenetic-search/105306 "2017-10-25T22:26:38Z")

</div>

How do I write this query written in curl in C# .net code. GET /disney2/character/\_search { "query": { "match": { "name.phonetic": { "query": "Jahnnie Smeeth", "operator": "and" } } } } Here is my index { "…

---

## [Internal building of aggregations](https://discuss.elastic.co/t/internal-building-of-aggregations/105302)

<div class="topic-metadata">

**Author:** [@thampton](https://discuss.elastic.co/u/thampton)\
**Replies:** 0\
**Last updated:** [October 25, 2017, 9:34pm UTC](https://discuss.elastic.co/t/internal-building-of-aggregations/105302 "2017-10-25T21:34:04Z")

</div>

How does Elasticsearch assemble the aggregations? During a search a list of hits are produced for each shard (if I'm understanding how it works). Are the hits for each shard aggregated at that time and then merged late…

---

## [ELK, DImensioning trouble and doubts](https://discuss.elastic.co/t/elk-dimensioning-trouble-and-doubts/105291)

<div class="topic-metadata">

**Author:** [@agonex](https://discuss.elastic.co/u/agonex)\
**Replies:** 1\
**Last updated:** [October 25, 2017, 8:34pm UTC](https://discuss.elastic.co/t/elk-dimensioning-trouble-and-doubts/105291 "2017-10-25T20:34:53Z")

</div>

We need to know more about how dimensioning the ELK cluster because the performance is too badly, make a search in kibana is not possible,very slowly any consult result in timeout also JVM logs indicate OutOfMemory.. , i…

---

## [How to add a elasticsearch datanode within Apache Metron](https://discuss.elastic.co/t/how-to-add-a-elasticsearch-datanode-within-apache-metron/104729)

<div class="topic-metadata">

**Author:** [@freemonj](https://discuss.elastic.co/u/freemonj)\
**Replies:** 6\
**Last updated:** [October 25, 2017, 8:34pm UTC](https://discuss.elastic.co/t/how-to-add-a-elasticsearch-datanode-within-apache-metron/104729 "2017-10-25T20:34:09Z")

</div>

Hello, Can anyone provide a reference on how to add ElasticSearch data nodes to an existing cluster using either of the following: Ambari via command line (CLI) FYI all nodes are already configured for the cluster an…

---

## [Rest High Level Client (5.6.0) stop async threads](https://discuss.elastic.co/t/rest-high-level-client-5-6-0-stop-async-threads/105101)

<div class="topic-metadata">

**Author:** [@ry99](https://discuss.elastic.co/u/ry99)\
**Replies:** 1\
**Last updated:** [October 25, 2017, 7:55pm UTC](https://discuss.elastic.co/t/rest-high-level-client-5-6-0-stop-async-threads/105101 "2017-10-25T19:55:17Z")

</div>

Hi All, I'm just getting started with the Rest High Level Client (5.6.0), and I'm having trouble shutting down my tomcat (8.5) instance because of unhandled threads. I think it's related to the async IO threads for the …

---

## [Relation between shards and nodes](https://discuss.elastic.co/t/relation-between-shards-and-nodes/104562)

<div class="topic-metadata">

**Author:** [@jessepeixoto](https://discuss.elastic.co/u/jessepeixoto)\
**Replies:** 4\
**Last updated:** [October 25, 2017, 7:34pm UTC](https://discuss.elastic.co/t/relation-between-shards-and-nodes/104562 "2017-10-25T19:34:15Z")

</div>

Could anyone please tell me a little about the relation between shards and nodes. If I have 30 nodes, I believe it won't work setting up more than 30 shards per index. In the other hand, if I have 30 nodes, setting up …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1908)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1910)
