# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1429

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1430

---

## [Explicit mapping not carried over on daily index creation](https://discuss.elastic.co/t/explicit-mapping-not-carried-over-on-daily-index-creation/163822)

<div class="topic-metadata">

**Author:** [@MH\_V](https://discuss.elastic.co/u/MH_V)\
**Replies:** 2\
**Last updated:** [January 11, 2019, 1:01am UTC](https://discuss.elastic.co/t/explicit-mapping-not-carried-over-on-daily-index-creation/163822 "2019-01-11T01:01:01Z")

</div>

I am trying to visualize a wait\_time field. In order to do so, I turned it into a long: curl -H 'Content-Type:application/json' -s -X POST 'localhost:9200/logstash-\*/\_mapping/doc?pretty' -d '{ "properties": { "wait\_t…

---

## [Repository Fuctionality](https://discuss.elastic.co/t/repository-fuctionality/163626)

<div class="topic-metadata">

**Author:** [@srgeek1](https://discuss.elastic.co/u/srgeek1)\
**Replies:** 3\
**Last updated:** [January 10, 2019, 9:21pm UTC](https://discuss.elastic.co/t/repository-fuctionality/163626 "2019-01-10T21:21:34Z")

</div>

Setup: If I create repository and put daily snapshot in it then on the 31st day start deleting the oldest snap and continue to do this day after day without end. Each day create a new snapshot and delete the oldest on…

---

## [Elasticsearch manual election](https://discuss.elastic.co/t/elasticsearch-manual-election/163802)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 2\
**Last updated:** [January 10, 2019, 8:45pm UTC](https://discuss.elastic.co/t/elasticsearch-manual-election/163802 "2019-01-10T20:45:02Z")

</div>

My cluster has 5 master eligible nodes. Is there a way to manually elect different master node from rest of master eligible nodes in cluster, by stopping master node, elasticsearch will automatically elects master node,…

---

## [Rollup API in Xpack Basic?](https://discuss.elastic.co/t/rollup-api-in-xpack-basic/163757)

<div class="topic-metadata">

**Author:** [@Zerobot](https://discuss.elastic.co/u/Zerobot)\
**Replies:** 3\
**Last updated:** [January 10, 2019, 8:08pm UTC](https://discuss.elastic.co/t/rollup-api-in-xpack-basic/163757 "2019-01-10T20:08:02Z")

</div>

Hello! Is Rollup API available for the basic license? Also does Basic license have some limitations of nodes or use-cases (personal use vs business use)?

---

## [Aggregations query timeout and cancellation](https://discuss.elastic.co/t/aggregations-query-timeout-and-cancellation/163791)

<div class="topic-metadata">

**Author:** [@Ivan\_Bokii](https://discuss.elastic.co/u/Ivan_Bokii)\
**Replies:** 1\
**Last updated:** [January 10, 2019, 6:23pm UTC](https://discuss.elastic.co/t/aggregations-query-timeout-and-cancellation/163791 "2019-01-10T18:23:52Z")

</div>

Hi guys, Setting a timeout property on a search query seems to not have any effect. I know that queries timeouts are not very precise due to the problem of time out checks during execution, but the query below successfu…

---

## [Nested object retrieval in ElasticSearch query](https://discuss.elastic.co/t/nested-object-retrieval-in-elasticsearch-query/163389)

<div class="topic-metadata">

**Author:** [@gn\_dev](https://discuss.elastic.co/u/gn_dev)\
**Replies:** 0\
**Last updated:** [January 8, 2019, 3:23pm UTC](https://discuss.elastic.co/t/nested-object-retrieval-in-elasticsearch-query/163389 "2019-01-08T15:23:46Z")

</div>

Hi, I'm new in ElasticSearch and I have a few questions regarding nested object retrieval when a specific condition is matched. I have a tree-like structure as follow: { "id": 4, "sora": \[ { …

---

## [Elasticsearch.Net.ElasticsearchClientException: The remote server returned an error: (413) Request Entity Too Large](https://discuss.elastic.co/t/elasticsearch-net-elasticsearchclientexception-the-remote-server-returned-an-error-413-request-entity-too-large/163786)

<div class="topic-metadata">

**Author:** [@franckepeixoto](https://discuss.elastic.co/u/franckepeixoto)\
**Replies:** 3\
**Last updated:** [January 10, 2019, 6:03pm UTC](https://discuss.elastic.co/t/elasticsearch-net-elasticsearchclientexception-the-remote-server-returned-an-error-413-request-entity-too-large/163786 "2019-01-10T18:03:22Z")

</div>

dear, i do trying sent a bulk size 1GB, but ... (i need help) Elasticsearch.Net.ElasticsearchClientException: The remote server returned an error: (413) Request Entity Too Large.. Call: Status code 413 from: POST /\_b…

---

## [Aggregate t-digest data](https://discuss.elastic.co/t/aggregate-t-digest-data/163780)

<div class="topic-metadata">

**Author:** [@Haohui\_Wang](https://discuss.elastic.co/u/Haohui_Wang)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 4:06pm UTC](https://discuss.elastic.co/t/aggregate-t-digest-data/163780 "2019-01-10T16:06:59Z")

</div>

I'd like to use ES to aggregate percentile data. Due to the size of the data, it is unfeasible to send all the raw data to ES. I'd like to generate t-digest on each agents remotely and then have the agents send the t-d…

---

## [Inconsistent search scoring between shards](https://discuss.elastic.co/t/inconsistent-search-scoring-between-shards/163686)

<div class="topic-metadata">

**Author:** [@Pyppe](https://discuss.elastic.co/u/Pyppe)\
**Replies:** 7\
**Last updated:** [January 10, 2019, 4:00pm UTC](https://discuss.elastic.co/t/inconsistent-search-scoring-between-shards/163686 "2019-01-10T16:00:24Z")

</div>

We have reindexed one big index \[shards=1, size=220GB, documents=110M\] to multiple nodes (9 shards & 3 nodes) using Elasticsearch 6.5.4 with java 1.8.0\_191 However, now we are seeing that when doing a search the scoring…

---

## [SearchContextMissingException No search context found for id on bulk query](https://discuss.elastic.co/t/searchcontextmissingexception-no-search-context-found-for-id-on-bulk-query/163537)

<div class="topic-metadata">

**Author:** [@jmngpt](https://discuss.elastic.co/u/jmngpt)\
**Replies:** 1\
**Last updated:** [January 10, 2019, 3:34pm UTC](https://discuss.elastic.co/t/searchcontextmissingexception-no-search-context-found-for-id-on-bulk-query/163537 "2019-01-10T15:34:01Z")

</div>

I'm experiencing an issue on 5.6.4 during a bulk search composed of several match queries, over an index that is not being written to. Almost all queries in the batch end up timing out (after 1h), and I can't grasp the …

---

## [Check some condition for every document in buckets](https://discuss.elastic.co/t/check-some-condition-for-every-document-in-buckets/160770)

<div class="topic-metadata">

**Author:** [@\_Sergey](https://discuss.elastic.co/u/_Sergey)\
**Replies:** 3\
**Last updated:** [January 10, 2019, 3:17pm UTC](https://discuss.elastic.co/t/check-some-condition-for-every-document-in-buckets/160770 "2019-01-10T15:17:19Z")

</div>

Hello all, Can you advise/help about: I use input chain in my Watcher. And I want to compare first, second, third etc.. doc\_count of document from first input with first, second. third etc... doc\_count of document for…

---

## [Getting max bytes length exceeded exception error, how to fix and prevent?](https://discuss.elastic.co/t/getting-max-bytes-length-exceeded-exception-error-how-to-fix-and-prevent/163755)

<div class="topic-metadata">

**Author:** [@JimP](https://discuss.elastic.co/u/JimP)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 2:11pm UTC](https://discuss.elastic.co/t/getting-max-bytes-length-exceeded-exception-error-how-to-fix-and-prevent/163755 "2019-01-10T14:11:19Z")

</div>

How can I fix this, please? Also, using Logstash, and is there a way to prevent this going forward? Elasticsearch 6.3.2 Logstash 6.3.2 \[2019-01-10T08:17:20,763\]\[DEBUG\]\[o.e.a.s.TransportSearchAction\] \[lmpau0629\] \[3259…

---

## [Selecting only specific data in a nested field](https://discuss.elastic.co/t/selecting-only-specific-data-in-a-nested-field/163714)

<div class="topic-metadata">

**Author:** [@LoZio](https://discuss.elastic.co/u/LoZio)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 10:58am UTC](https://discuss.elastic.co/t/selecting-only-specific-data-in-a-nested-field/163714 "2019-01-10T10:58:21Z")

</div>

Hi, I have a nested field from a survey where a user can select several nations, so it may be empty, contain a single nation or several nations. Basically an array from 0 to n elements from logstash parse. I can easily …

---

## [Special character processing](https://discuss.elastic.co/t/special-character-processing/162310)

<div class="topic-metadata">

**Author:** [@aabababba](https://discuss.elastic.co/u/aabababba)\
**Replies:** 0\
**Last updated:** [December 28, 2018, 7:42am UTC](https://discuss.elastic.co/t/special-character-processing/162310 "2018-12-28T07:42:39Z")

</div>

"message": """Dec 27 18:57:40 elk01 logstash: "loglevel" =\> "ERROR",""", How to filter this record? "query": "message:(\\"error\\") AND NOT message:(\\"\\\\"loglevel\\\\" \\\\=\\\\\> \\\\"ERROR\\\\"\\")", use this not work.

---

## [Assign weightage for every document on the basis of sum of all document](https://discuss.elastic.co/t/assign-weightage-for-every-document-on-the-basis-of-sum-of-all-document/163723)

<div class="topic-metadata">

**Author:** [@bharatbhushan](https://discuss.elastic.co/u/bharatbhushan)\
**Replies:** 3\
**Last updated:** [January 10, 2019, 1:46pm UTC](https://discuss.elastic.co/t/assign-weightage-for-every-document-on-the-basis-of-sum-of-all-document/163723 "2019-01-10T13:46:35Z")

</div>

HI all, Please help me out below mentioned problem. I want to give weightage for every document on the basis of sum of point value in a elasticsearch query. Suppose i have 3 document and then i want to get sum of all…

---

## [Add day to datetime field](https://discuss.elastic.co/t/add-day-to-datetime-field/162711)

<div class="topic-metadata">

**Author:** [@jpaz93](https://discuss.elastic.co/u/jpaz93)\
**Replies:** 12\
**Last updated:** [January 10, 2019, 1:42pm UTC](https://discuss.elastic.co/t/add-day-to-datetime-field/162711 "2019-01-10T13:42:45Z")

</div>

Hello, I need help with the following: I need to add days to a datetime field I have different indices with datetime fields: "created\_at": "2018-12-21 15:29:53", "created\_at": "2018-12-21 15:32:11", "created\_at": "…

---

## [Why I have results without actual value](https://discuss.elastic.co/t/why-i-have-results-without-actual-value/163536)

<div class="topic-metadata">

**Author:** [@dao](https://discuss.elastic.co/u/dao)\
**Replies:** 3\
**Last updated:** [January 10, 2019, 1:31pm UTC](https://discuss.elastic.co/t/why-i-have-results-without-actual-value/163536 "2019-01-10T13:31:31Z")

</div>

Hello, I'd like to understand the reasons why the actual field can be not present in the anomaly results (see at the end of the post). Here is the scenario: I create a job with a daily datafeed. I start it with no end.…

---

## [ElasticSearch Duplicates finding](https://discuss.elastic.co/t/elasticsearch-duplicates-finding/163737)

<div class="topic-metadata">

**Author:** [@raghunadh.parlapalli](https://discuss.elastic.co/u/raghunadh.parlapalli)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 1:08pm UTC](https://discuss.elastic.co/t/elasticsearch-duplicates-finding/163737 "2019-01-10T13:08:48Z")

</div>

Hi, Does some one has ideas on how to find duplicate documents in elasticsearch? and using elasticsearch REST api's or Python or PHP scripting or Kibana?

---

## [Creating Dashboards in Kibana from a Relational database](https://discuss.elastic.co/t/creating-dashboards-in-kibana-from-a-relational-database/163731)

<div class="topic-metadata">

**Author:** [@karan\_gupta](https://discuss.elastic.co/u/karan_gupta)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 12:11pm UTC](https://discuss.elastic.co/t/creating-dashboards-in-kibana-from-a-relational-database/163731 "2019-01-10T12:11:41Z")

</div>

Currently the data for which I want to create visualizations is stored in as a relational database(MySQL). To kick start things, I connected Mysql to elasticsearch using JDBC connector, transferred 1 'table' from MySQL …

---

## [Logging directly to elasticsearch](https://discuss.elastic.co/t/logging-directly-to-elasticsearch/163702)

<div class="topic-metadata">

**Author:** [@yash\_sachdeva](https://discuss.elastic.co/u/yash_sachdeva)\
**Replies:** 7\
**Last updated:** [January 10, 2019, 11:41am UTC](https://discuss.elastic.co/t/logging-directly-to-elasticsearch/163702 "2019-01-10T11:41:49Z")

</div>

Hi Team, I would like to send pre-formatted json logs directly to elastic search? I would like to avoid logstash/filebeat as I do not need any further parsing. Also, I see in a previous post you have recommended not to a…

---

## [Accessing parent aggregation or inject aggregation into other aggregation](https://discuss.elastic.co/t/accessing-parent-aggregation-or-inject-aggregation-into-other-aggregation/163712)

<div class="topic-metadata">

**Author:** [@Marc\_Zahn](https://discuss.elastic.co/u/Marc_Zahn)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 10:56am UTC](https://discuss.elastic.co/t/accessing-parent-aggregation-or-inject-aggregation-into-other-aggregation/163712 "2019-01-10T10:56:07Z")

</div>

Hi, I am not sure if this is already solved but I could not find it. In the index there docs (cards) which contain a question\_id (uuid) and a numeric rating. I have a query which looks like this: { "size": 0,…

---

## [Why index\_patterns add join datatype, but show string in kibana](https://discuss.elastic.co/t/why-index-patterns-add-join-datatype-but-show-string-in-kibana/163642)

<div class="topic-metadata">

**Author:** [@cythwell](https://discuss.elastic.co/u/cythwell)\
**Replies:** 18\
**Last updated:** [January 10, 2019, 10:31am UTC](https://discuss.elastic.co/t/why-index-patterns-add-join-datatype-but-show-string-in-kibana/163642 "2019-01-10T10:31:26Z")

</div>

I add a join datatype for parent-child relationship { "mappings" : { "test\_data" : { "properties" : { "levelStatus" : { "type" : "join", "relations" : { "user" : "unique", "unique" : "report" } } My point is …

---

## [How to fetch specific data from message text and add it in new field](https://discuss.elastic.co/t/how-to-fetch-specific-data-from-message-text-and-add-it-in-new-field/163704)

<div class="topic-metadata">

**Author:** [@Ani](https://discuss.elastic.co/u/Ani)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 10:27am UTC](https://discuss.elastic.co/t/how-to-fetch-specific-data-from-message-text-and-add-it-in-new-field/163704 "2019-01-10T10:27:26Z")

</div>

We are using this below grok pattern : grok { match =\> { message =\> "^%{TIMESTAMP\_ISO8601:timestamp\_match}\\s\*%{WORD:system}\\s\*%{LOGLEVEL:loglevel}\\s\*%{SYSLOGHOST:session\_id}\\s\*%{SYSLOGHOST:req\_id}\\s\*%{WORD:user}\\s\*%{W…

---

## [Update Elasticsearch 1.0 -\> 6.4](https://discuss.elastic.co/t/update-elasticsearch-1-0-6-4/163673)

<div class="topic-metadata">

**Author:** [@Dmitrij](https://discuss.elastic.co/u/Dmitrij)\
**Replies:** 4\
**Last updated:** [January 10, 2019, 10:24am UTC](https://discuss.elastic.co/t/update-elasticsearch-1-0-6-4/163673 "2019-01-10T10:24:54Z")

</div>

Hello. I need advice - how to do it. I have an elasticsearch 1.0 on my test server. I want to upgrade to version 6.4. It is important to keep the server working. How should I do this with minimal losses? Update one by on…

---

## [Elasticsearch free disk space at restart](https://discuss.elastic.co/t/elasticsearch-free-disk-space-at-restart/163692)

<div class="topic-metadata">

**Author:** [@Jean\_Carlo](https://discuss.elastic.co/u/Jean_Carlo)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 9:37am UTC](https://discuss.elastic.co/t/elasticsearch-free-disk-space-at-restart/163692 "2019-01-10T09:37:34Z")

</div>

I got a machine with 6.7GB if data, once a restart my cluster, the data says drop from 6.7 to 3.7GB root@node001:~# du -sch /data/elastic/nodes/0/indices/\* 6,7G /data/elastic/nodes/0/indices/1fTFvrmHRh2mrKNpMncsPA 6,7…

---

## [Indexing in Curator](https://discuss.elastic.co/t/indexing-in-curator/163669)

<div class="topic-metadata">

**Author:** [@Shafiq](https://discuss.elastic.co/u/Shafiq)\
**Replies:** 4\
**Last updated:** [January 10, 2019, 9:30am UTC](https://discuss.elastic.co/t/indexing-in-curator/163669 "2019-01-10T09:30:31Z")

</div>

Hi There, I’m new to Elasticsearch and trying to create new index in Elasticsearch using curator 5.6.0. im getting error “Schema error: extra keys not allowed @ data\['action’\]” Below is the action file configuration a…

---

## [Elasticsearch scripted metric aggregation](https://discuss.elastic.co/t/elasticsearch-scripted-metric-aggregation/163662)

<div class="topic-metadata">

**Author:** [@cxfcxf](https://discuss.elastic.co/u/cxfcxf)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 6:29am UTC](https://discuss.elastic.co/t/elasticsearch-scripted-metric-aggregation/163662 "2019-01-10T06:29:34Z")

</div>

(1)when i use scripted metric aggregation,in mapscript source,I put a java.util.set as a map-value,elasticsearch throws an exception {size": 0, "aggs": { "collision": { "scripted\_metric": { "init\_script": { "source…

---

## [Source code advise about how to store and query Nested datatype](https://discuss.elastic.co/t/source-code-advise-about-how-to-store-and-query-nested-datatype/163670)

<div class="topic-metadata">

**Author:** [@Kun\_Qian](https://discuss.elastic.co/u/Kun_Qian)\
**Replies:** 0\
**Last updated:** [January 10, 2019, 7:33am UTC](https://discuss.elastic.co/t/source-code-advise-about-how-to-store-and-query-nested-datatype/163670 "2019-01-10T07:33:45Z")

</div>

I know "Indexing 1 document with 100 nested fields actually indexes 101 documents ...". Now I want to know what structure the Nested Datatype stores in source code, which class in source show the detail? Would anyone giv…

---

## [How to find out how a query is matched?](https://discuss.elastic.co/t/how-to-find-out-how-a-query-is-matched/163649)

<div class="topic-metadata">

**Author:** [@NewHere](https://discuss.elastic.co/u/NewHere)\
**Replies:** 2\
**Last updated:** [January 10, 2019, 6:49am UTC](https://discuss.elastic.co/t/how-to-find-out-how-a-query-is-matched/163649 "2019-01-10T06:49:42Z")

</div>

Say I have a field "Message" and some indexed values "quick brown fox", "foxy brownie" in documents. Is there an API in Elasticsearch that I can use to ask question like How have we matched "brown fox" in "Message" of al…

---

## [SSL/TLS with basic license](https://discuss.elastic.co/t/ssl-tls-with-basic-license/163645)

<div class="topic-metadata">

**Author:** [@Marc4](https://discuss.elastic.co/u/Marc4)\
**Replies:** 1\
**Last updated:** [January 10, 2019, 6:06am UTC](https://discuss.elastic.co/t/ssl-tls-with-basic-license/163645 "2019-01-10T06:06:24Z")

</div>

Hi - Can we have a security features (for both http and transport) with basic license? I am experimenting with version 6.5.4; Thanks, Marc

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1428)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1430)
