# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1017

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1018

---

## [Binary data type](https://discuss.elastic.co/t/binary-data-type/219176)

<div class="topic-metadata">

**Author:** [@assafh](https://discuss.elastic.co/u/assafh)\
**Replies:** 0\
**Last updated:** [February 13, 2020, 9:45am UTC](https://discuss.elastic.co/t/binary-data-type/219176 "2020-02-13T09:45:34Z")

</div>

What is the usage of the Binary data type. It is not searchable or stored by default and I know storing binary data in elastic is a bad idea.

---

## [Looking for an alternative to reindex and collapse](https://discuss.elastic.co/t/looking-for-an-alternative-to-reindex-and-collapse/219173)

<div class="topic-metadata">

**Author:** [@andni233](https://discuss.elastic.co/u/andni233)\
**Replies:** 0\
**Last updated:** [February 13, 2020, 9:38am UTC](https://discuss.elastic.co/t/looking-for-an-alternative-to-reindex-and-collapse/219173 "2020-02-13T09:38:18Z")

</div>

Hello! I have an index that contains a lot of "raw" data, around 40.000 documents. I want to refine this data a bit, and store the refined data in a different index. For this purpose, I came up with this search query t…

---

## [Unable to run elastic stack on docker](https://discuss.elastic.co/t/unable-to-run-elastic-stack-on-docker/219144)

<div class="topic-metadata">

**Author:** [@y0y0z](https://discuss.elastic.co/u/y0y0z)\
**Replies:** 4\
**Last updated:** [February 13, 2020, 9:08am UTC](https://discuss.elastic.co/t/unable-to-run-elastic-stack-on-docker/219144 "2020-02-13T09:08:58Z")

</div>

i create a specification for the stack using docker-compose: # docker-compose.yml version: '3.7' services: elasticsearch: container\_name: elasticsearch image: elasticsearch:7.6.0 ports: - "9200:9200"…

---

## [Limit audit logs to a certain number of days](https://discuss.elastic.co/t/limit-audit-logs-to-a-certain-number-of-days/219153)

<div class="topic-metadata">

**Author:** [@soumendra](https://discuss.elastic.co/u/soumendra)\
**Replies:** 1\
**Last updated:** [February 13, 2020, 8:59am UTC](https://discuss.elastic.co/t/limit-audit-logs-to-a-certain-number-of-days/219153 "2020-02-13T08:59:48Z")

</div>

We have the following configuration in our elasticsearch.yml file. Is there any way we can limit the audit logs to be stored only for the last 2 weeks. xpack.security.audit.enabled: true xpack.security.audit.outputs: \[ …

---

## [Re-point index to a new copy](https://discuss.elastic.co/t/re-point-index-to-a-new-copy/219118)

<div class="topic-metadata">

**Author:** [@vinodj](https://discuss.elastic.co/u/vinodj)\
**Replies:** 2\
**Last updated:** [February 13, 2020, 8:54am UTC](https://discuss.elastic.co/t/re-point-index-to-a-new-copy/219118 "2020-02-13T08:54:18Z")

</div>

I have a master branch in my code repository. To enable code search we use elastic search. Any time a new branch is created it needs to be made searchable, which mean indexing that branch of code. Since when the branch i…

---

## [How to get all datas from postman API to elastic search using PHP](https://discuss.elastic.co/t/how-to-get-all-datas-from-postman-api-to-elastic-search-using-php/219139)

<div class="topic-metadata">

**Author:** [@venkat2280](https://discuss.elastic.co/u/venkat2280)\
**Replies:** 0\
**Last updated:** [February 13, 2020, 7:23am UTC](https://discuss.elastic.co/t/how-to-get-all-datas-from-postman-api-to-elastic-search-using-php/219139 "2020-02-13T07:23:36Z")

</div>

I got the json values in elasticsearch by using the below code: use Elasticsearch\\ClientBuilder; require 'vendor/autoload.php'; $client = ClientBuilder::create()-\>build(); $params = \[ 'index' =\> 'my\_index', 'id' =\>…

---

## [Elasticsearch.yml Email configuration](https://discuss.elastic.co/t/elasticsearch-yml-email-configuration/216754)

<div class="topic-metadata">

**Author:** [@Ali\_Coluk](https://discuss.elastic.co/u/Ali_Coluk)\
**Replies:** 5\
**Last updated:** [February 13, 2020, 8:03am UTC](https://discuss.elastic.co/t/elasticsearch-yml-email-configuration/216754 "2020-02-13T08:03:02Z")

</div>

Hello everyone, I am trying to configure Watcher and send an email and/or slack messages. To do this I know that I need to configure the elasticsearch.yml file and add an email sender. But after my configuration, as you…

---

## [Long-term, low query logs storage in Elasticsearch 5.6 Cluster - what are the risks of using more than 50% of RAM to heap?](https://discuss.elastic.co/t/long-term-low-query-logs-storage-in-elasticsearch-5-6-cluster-what-are-the-risks-of-using-more-than-50-of-ram-to-heap/218870)

<div class="topic-metadata">

**Author:** [@heapheaphurray](https://discuss.elastic.co/u/heapheaphurray)\
**Replies:** 4\
**Last updated:** [February 13, 2020, 7:54am UTC](https://discuss.elastic.co/t/long-term-low-query-logs-storage-in-elasticsearch-5-6-cluster-what-are-the-risks-of-using-more-than-50-of-ram-to-heap/218870 "2020-02-13T07:54:22Z")

</div>

Hello! We are trying to optimize our ES 5.6 cluster to use less heap memory. We have 19Tb of data, 9bln of rows in ~560 shards on 2 warm, 4 cold data nodes, which are only rarely queried. Memory is scarce resource in o…

---

## [Usage of coordinator node for indexing](https://discuss.elastic.co/t/usage-of-coordinator-node-for-indexing/219034)

<div class="topic-metadata">

**Author:** [@1fe60245fe160bc0f8ab](https://discuss.elastic.co/u/1fe60245fe160bc0f8ab)\
**Replies:** 7\
**Last updated:** [February 13, 2020, 7:43am UTC](https://discuss.elastic.co/t/usage-of-coordinator-node-for-indexing/219034 "2020-02-13T07:43:39Z")

</div>

Hi all, I've read that the best practice for querying/searching is to use a coordinator node, which makes sense to me (a node that's not busy on disk operations for indexing and uses memory for gather phase of searches)…

---

## [Auto expand replicas](https://discuss.elastic.co/t/auto-expand-replicas/219140)

<div class="topic-metadata">

**Author:** [@royal\_man](https://discuss.elastic.co/u/royal_man)\
**Replies:** 0\
**Last updated:** [February 13, 2020, 7:26am UTC](https://discuss.elastic.co/t/auto-expand-replicas/219140 "2020-02-13T07:26:14Z")

</div>

I am trying to implement a scale up of elasticsearch cluster by increasing data nodes. Data nodes: 10 nodes 1 node: 2 shards (index1 and index2) Index1: 10 Primary and 0 replica Index2: 1 Primary and 9 Replica I wan…

---

## [I don't know why do not match the keyword are searched](https://discuss.elastic.co/t/i-dont-know-why-do-not-match-the-keyword-are-searched/218886)

<div class="topic-metadata">

**Author:** [@fuzes](https://discuss.elastic.co/u/fuzes)\
**Replies:** 2\
**Last updated:** [February 13, 2020, 6:55am UTC](https://discuss.elastic.co/t/i-dont-know-why-do-not-match-the-keyword-are-searched/218886 "2020-02-13T06:55:30Z")

</div>

following is my mapping "tags" : { "properties" : { "zh-TW" : { "type" : "text", "fields" : { "keyword" : { "type" : "keyword", …

---

## [What does "index": "no" do? Is there any alternative of this?](https://discuss.elastic.co/t/what-does-index-no-do-is-there-any-alternative-of-this/219122)

<div class="topic-metadata">

**Author:** [@prasad98](https://discuss.elastic.co/u/prasad98)\
**Replies:** 2\
**Last updated:** [February 13, 2020, 6:13am UTC](https://discuss.elastic.co/t/what-does-index-no-do-is-there-any-alternative-of-this/219122 "2020-02-13T06:13:01Z")

</div>

Hi, I'm currently working on the elasticsearch migration from v2.4 to v7.5. In v2.4, there is field property like this: custom\_key\_field: { "type": "text", "index": "no" } What does "index": "no" means? Is it …

---

## [Elasticsearch aggs filter with condition](https://discuss.elastic.co/t/elasticsearch-aggs-filter-with-condition/216372)

<div class="topic-metadata">

**Author:** [@Noctis17](https://discuss.elastic.co/u/Noctis17)\
**Replies:** 3\
**Last updated:** [February 13, 2020, 2:25am UTC](https://discuss.elastic.co/t/elasticsearch-aggs-filter-with-condition/216372 "2020-02-13T02:25:43Z")

</div>

Elasticsearch v 7.5 Hello and good day! I have an index named articles , and has the following sample contents: { "\_id" : 1, "title" : "Title 1" "cms" : \[ { "cli\_id" : 0, "cmx\_…

---

## [Is this possible to refer multiple buckets\_path in \`moving\_fn\` aggregation?](https://discuss.elastic.co/t/is-this-possible-to-refer-multiple-buckets-path-in-moving-fn-aggregation/219101)

<div class="topic-metadata">

**Author:** [@seyoongit](https://discuss.elastic.co/u/seyoongit)\
**Replies:** 0\
**Last updated:** [February 13, 2020, 1:11am UTC](https://discuss.elastic.co/t/is-this-possible-to-refer-multiple-buckets-path-in-moving-fn-aggregation/219101 "2020-02-13T01:11:17Z")

</div>

official doc introduces moving\_fn syntax as below. { "moving\_fn": { "buckets\_path": "the\_sum", "window": 10, "script": "MovingFunctions.min(values)" } } then, is this possible to refer m…

---

## [Auto Filter by Brand](https://discuss.elastic.co/t/auto-filter-by-brand/219097)

<div class="topic-metadata">

**Author:** [@Cannon\_Moyer](https://discuss.elastic.co/u/Cannon_Moyer)\
**Replies:** 0\
**Last updated:** [February 13, 2020, 12:07am UTC](https://discuss.elastic.co/t/auto-filter-by-brand/219097 "2020-02-13T00:07:41Z")

</div>

I'm running ES 7.3. have a query where a user can search a list of machines by two fields, brand and name . I am using an ngram search on the name fields so that similar matches will be found. I want my query to work…

---

## [Jvm Heap Size & Indexing Perfmance Problem](https://discuss.elastic.co/t/jvm-heap-size-indexing-perfmance-problem/219089)

<div class="topic-metadata">

**Author:** [@Wisem4n](https://discuss.elastic.co/u/Wisem4n)\
**Replies:** 0\
**Last updated:** [February 12, 2020, 10:11pm UTC](https://discuss.elastic.co/t/jvm-heap-size-indexing-perfmance-problem/219089 "2020-02-12T22:11:49Z")

</div>

Hi, I use elasticsearch 7.2 on a single node computer. Computer features: 64 gb ram 2 tb hdd (the disk which ES installed is 500 gb) 8 cores cpu Win10 OS My ES configurations&features -106 indices -106 shards -0 …

---

## [Running Elasticsearch using docker-compose Exception in thread "main"](https://discuss.elastic.co/t/running-elasticsearch-using-docker-compose-exception-in-thread-main/219082)

<div class="topic-metadata">

**Author:** [@Kosodrom](https://discuss.elastic.co/u/Kosodrom)\
**Replies:** 0\
**Last updated:** [February 12, 2020, 9:13pm UTC](https://discuss.elastic.co/t/running-elasticsearch-using-docker-compose-exception-in-thread-main/219082 "2020-02-12T21:13:00Z")

</div>

Hi guys, I'm trying to spin up an elastic cluster using docker compose according to this documentation: https://www.elastic.co/guide/en/elastic-stack-get-started/current/get-started-docker.html I created the described …

---

## [Is it wasteful to configure text as keyword with "fields": keyword?](https://discuss.elastic.co/t/is-it-wasteful-to-configure-text-as-keyword-with-fields-keyword/218883)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 3\
**Last updated:** [February 12, 2020, 9:05pm UTC](https://discuss.elastic.co/t/is-it-wasteful-to-configure-text-as-keyword-with-fields-keyword/218883 "2020-02-12T21:05:50Z")

</div>

With a mapping below. "EventType" : { "type" : "keyword", "fields" : { "keyword" : { "type" : "keyword", "ignore\_above" : 256 } } The reason why we are doing thi…

---

## [Date Histogram buckets using top\_hits of terms over last 30 days](https://discuss.elastic.co/t/date-histogram-buckets-using-top-hits-of-terms-over-last-30-days/217679)

<div class="topic-metadata">

**Author:** [@duo\_jc](https://discuss.elastic.co/u/duo_jc)\
**Replies:** 1\
**Last updated:** [February 12, 2020, 8:44pm UTC](https://discuss.elastic.co/t/date-histogram-buckets-using-top-hits-of-terms-over-last-30-days/217679 "2020-02-12T20:44:17Z")

</div>

Hello Elasticsearch, I'm having an issue finding the right combination of aggregations to achieve a query I'm looking for. Essentially what I need to do is take the most recent document by ID over the last 30 days and t…

---

## [Terms Aggregation, but over a time period?](https://discuss.elastic.co/t/terms-aggregation-but-over-a-time-period/217275)

<div class="topic-metadata">

**Author:** [@erin\_verbeck](https://discuss.elastic.co/u/erin_verbeck)\
**Replies:** 4\
**Last updated:** [February 12, 2020, 8:33pm UTC](https://discuss.elastic.co/t/terms-aggregation-but-over-a-time-period/217275 "2020-02-12T20:33:11Z")

</div>

Hi everyone! I am trying to create a query that searches and identifies when a specific term reaches a threshold over a given period of time. My first thought is to construct a search that will, for example, bring back t…

---

## [Security index error - everything working fine](https://discuss.elastic.co/t/security-index-error-everything-working-fine/218046)

<div class="topic-metadata">

**Author:** [@Sergio\_Peral\_Aguiler](https://discuss.elastic.co/u/Sergio_Peral_Aguiler)\
**Replies:** 2\
**Last updated:** [February 12, 2020, 7:26pm UTC](https://discuss.elastic.co/t/security-index-error-everything-working-fine/218046 "2020-02-12T19:26:07Z")

</div>

Hi all, Recently I moved the path.data to a different folder, keeping permissions and everything, changing the option in elasticsearch.yml and it worked as expected and everything working fine. However, in the Elastics…

---

## [Retention of audit logs](https://discuss.elastic.co/t/retention-of-audit-logs/219062)

<div class="topic-metadata">

**Author:** [@szemlyanoy](https://discuss.elastic.co/u/szemlyanoy)\
**Replies:** 0\
**Last updated:** [February 12, 2020, 6:42pm UTC](https://discuss.elastic.co/t/retention-of-audit-logs/219062 "2020-02-12T18:42:22Z")

</div>

Hi, The goal is to archive audit logs on daily basis and recycle archives older than n days. So far I haven't found correct property for audit\_rolling appender to get this working. This is what I have appender.audit\_…

---

## [Nest authentication with IAM](https://discuss.elastic.co/t/nest-authentication-with-iam/218866)

<div class="topic-metadata">

**Author:** [@David\_Greenwell](https://discuss.elastic.co/u/David_Greenwell)\
**Replies:** 2\
**Last updated:** [February 12, 2020, 6:36pm UTC](https://discuss.elastic.co/t/nest-authentication-with-iam/218866 "2020-02-12T18:36:19Z")

</div>

Is there a way to connect to an AWS elasticsearch pool that is set up with an IAM role/user but still be able to use the NEST api for C#? Are there any other utilites to do this in C#?

---

## [How to reduce multiple conditions in ES](https://discuss.elastic.co/t/how-to-reduce-multiple-conditions-in-es/219052)

<div class="topic-metadata">

**Author:** [@Ramesh\_balasubramani](https://discuss.elastic.co/u/Ramesh_balasubramani)\
**Replies:** 0\
**Last updated:** [February 12, 2020, 5:29pm UTC](https://discuss.elastic.co/t/how-to-reduce-multiple-conditions-in-es/219052 "2020-02-12T17:29:39Z")

</div>

GET /logs\*/\_search { "from":0, "query":{ "bool":{ "filter":\[ { "range":{ "@timestamp":{ "gte":"2020-02-10T11:13:19.7684961Z", …

---

## [TermsAggregation : sort by score to get relavant document on top - Please help](https://discuss.elastic.co/t/termsaggregation-sort-by-score-to-get-relavant-document-on-top-please-help/218782)

<div class="topic-metadata">

**Author:** [@Chetan\_Ramaiah](https://discuss.elastic.co/u/Chetan_Ramaiah)\
**Replies:** 3\
**Last updated:** [February 12, 2020, 5:04pm UTC](https://discuss.elastic.co/t/termsaggregation-sort-by-score-to-get-relavant-document-on-top-please-help/218782 "2020-02-12T17:04:53Z")

</div>

I have an index which contain documents with same employee name and email address but varies with other information such as meetings attended and amount spent. { "emp\_name" : "Raju", "emp\_email" : "raju@abc.com", …

---

## [Rally does not have control over the configuration of the benchmarked Elasticsearch cluster](https://discuss.elastic.co/t/rally-does-not-have-control-over-the-configuration-of-the-benchmarked-elasticsearch-cluster/218682)

<div class="topic-metadata">

**Author:** [@frankfoti](https://discuss.elastic.co/u/frankfoti)\
**Replies:** 3\
**Last updated:** [February 12, 2020, 4:58pm UTC](https://discuss.elastic.co/t/rally-does-not-have-control-over-the-configuration-of-the-benchmarked-elasticsearch-cluster/218682 "2020-02-12T16:58:08Z")

</div>

Just connfigured our first successful race but confused why we are getting this message. Note we are pointing to a ES Cloud cluster. ffoti@rally:~$ ~/.local/bin/esrally --pipeline=benchmark-only --track-path /mnt1/benc…

---

## [Failover Mapping](https://discuss.elastic.co/t/failover-mapping/219024)

<div class="topic-metadata">

**Author:** [@tomx1](https://discuss.elastic.co/u/tomx1)\
**Replies:** 1\
**Last updated:** [February 12, 2020, 4:58pm UTC](https://discuss.elastic.co/t/failover-mapping/219024 "2020-02-12T16:58:00Z")

</div>

Hey, we are using elasticsearch primarily to index our logging data. Unfortunaley due to the many systems we are maintaining, we can't really guarantee that every "device" is logging it's events the same way. For exampl…

---

## [How to modify the setting parameters of the index](https://discuss.elastic.co/t/how-to-modify-the-setting-parameters-of-the-index/218722)

<div class="topic-metadata">

**Author:** [@k3v8ns](https://discuss.elastic.co/u/k3v8ns)\
**Replies:** 1\
**Last updated:** [February 12, 2020, 4:42pm UTC](https://discuss.elastic.co/t/how-to-modify-the-setting-parameters-of-the-index/218722 "2020-02-12T16:42:05Z")

</div>

i want to modify all index settings config in index\_settings. rally version: 1.3.0 cmd: esrally race --track=geonames --track-params=index\_settings: \["index.number\_of\_shards:1","index.number\_of\_replicas:1"\] or es…

---

## [Cant understand example from documentation](https://discuss.elastic.co/t/cant-understand-example-from-documentation/218937)

<div class="topic-metadata">

**Author:** [@linuxfan84](https://discuss.elastic.co/u/linuxfan84)\
**Replies:** 1\
**Last updated:** [February 12, 2020, 4:19pm UTC](https://discuss.elastic.co/t/cant-understand-example-from-documentation/218937 "2020-02-12T16:19:21Z")

</div>

Hi all. I am studying Elasticsearch and I really like it. But I cant inderstand following example from documentation (From here - https://www.elastic.co/guide/en/elasticsearch/reference/7.2/query-dsl-intervals-query.htm…

---

## [Implementation of a Complex Conditional Query](https://discuss.elastic.co/t/implementation-of-a-complex-conditional-query/218909)

<div class="topic-metadata">

**Author:** [@AkankshaKunwar](https://discuss.elastic.co/u/AkankshaKunwar)\
**Replies:** 1\
**Last updated:** [February 12, 2020, 4:12pm UTC](https://discuss.elastic.co/t/implementation-of-a-complex-conditional-query/218909 "2020-02-12T16:12:41Z")

</div>

Hello Everyone , I am new to the implementation of such complex query and need help, Kindly do the favour. In our Database we have documnets having IP address as a field ( with other additional information), Now I want …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1016)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1018)
