# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1340

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1341

---

## [About Rollup](https://discuss.elastic.co/t/about-rollup/174931)

<div class="topic-metadata">

**Author:** [@iQIYI](https://discuss.elastic.co/u/iQIYI)\
**Replies:** 3\
**Last updated:** [April 8, 2019, 6:28am UTC](https://discuss.elastic.co/t/about-rollup/174931 "2019-04-08T06:28:04Z")

</div>

Hello, I have some question about rollup API. Can anybody help me? I already have about 100 daily indices. now I want to try rollup API, but I want to rollup from now on, can this be achieved? As data growing, the ro…

---

## [Design approach for Many Small Sized but very different indices?](https://discuss.elastic.co/t/design-approach-for-many-small-sized-but-very-different-indices/175714)

<div class="topic-metadata">

**Author:** [@avacados](https://discuss.elastic.co/u/avacados)\
**Replies:** 5\
**Last updated:** [April 8, 2019, 6:19am UTC](https://discuss.elastic.co/t/design-approach-for-many-small-sized-but-very-different-indices/175714 "2019-04-08T06:19:00Z")

</div>

With removal of 'type' in mapping from 6.x release, On Dynamic Application Development Platform Project, I required many indices need to be created. All Indices have documents which don't have many similarities. For ex…

---

## [Snapshot documents older than specific date](https://discuss.elastic.co/t/snapshot-documents-older-than-specific-date/175762)

<div class="topic-metadata">

**Author:** [@joubeh](https://discuss.elastic.co/u/joubeh)\
**Replies:** 2\
**Last updated:** [April 8, 2019, 6:11am UTC](https://discuss.elastic.co/t/snapshot-documents-older-than-specific-date/175762 "2019-04-08T06:11:14Z")

</div>

Hello, first of all I'm using ELK 6.4.2 and i was wondering if is it possible to take snapshot for specific documents in the index using date, what I'm trying to do is to take only first 2 weeks of documents from the in…

---

## [Change score function to return number of matches of search term in the documents](https://discuss.elastic.co/t/change-score-function-to-return-number-of-matches-of-search-term-in-the-documents/175759)

<div class="topic-metadata">

**Author:** [@Harsha\_Yerasi](https://discuss.elastic.co/u/Harsha_Yerasi)\
**Replies:** 0\
**Last updated:** [April 8, 2019, 5:51am UTC](https://discuss.elastic.co/t/change-score-function-to-return-number-of-matches-of-search-term-in-the-documents/175759 "2019-04-08T05:51:25Z")

</div>

Hi, I have gone through the default scoring function that elasticsearch uses. score(q,d) = queryNorm(q) \* coord(q,d) \* SUM ( tf(t in d), idf(t)², t.getBoost…

---

## [Comparison between two objects with in the nested array of each document in elastic search using script](https://discuss.elastic.co/t/comparison-between-two-objects-with-in-the-nested-array-of-each-document-in-elastic-search-using-script/175682)

<div class="topic-metadata">

**Author:** [@anubhav100](https://discuss.elastic.co/u/anubhav100)\
**Replies:** 0\
**Last updated:** [April 6, 2019, 5:32pm UTC](https://discuss.elastic.co/t/comparison-between-two-objects-with-in-the-nested-array-of-each-document-in-elastic-search-using-script/175682 "2019-04-06T17:32:57Z")

</div>

Hi, I have a Scenario in elasticsearch where i need to compare two objects which lies inside a nested array with in a document in elastic search, i have json like this stored in elastic search "\_index": "index", "\_type…

---

## [Setup Elastic search cluster for production](https://discuss.elastic.co/t/setup-elastic-search-cluster-for-production/175689)

<div class="topic-metadata">

**Author:** [@syedsfayaz](https://discuss.elastic.co/u/syedsfayaz)\
**Replies:** 7\
**Last updated:** [April 8, 2019, 3:53am UTC](https://discuss.elastic.co/t/setup-elastic-search-cluster-for-production/175689 "2019-04-08T03:53:53Z")

</div>

Hi I am trying to setup elastic search cluster for production. I have approximately 500 vms which we will be monitoring. I am expecting 2gig data every day. I will be installing Metric beats and files beats on servers. …

---

## [.keyword in query dsl](https://discuss.elastic.co/t/keyword-in-query-dsl/174350)

<div class="topic-metadata">

**Author:** [@RubenStudent](https://discuss.elastic.co/u/RubenStudent)\
**Replies:** 1\
**Last updated:** [April 8, 2019, 2:02am UTC](https://discuss.elastic.co/t/keyword-in-query-dsl/174350 "2019-04-08T02:02:30Z")

</div>

Dear ES staff I am developing a plugin to connect to a local Elasticsearch cluster. I have to programmatically construct ES queries with to Query DSL and have problems with the keyword an text data type. I have done som…

---

## [Json\_parse\_exception - Unexpected character (''' (code 39)): was expecting double-quote to start field name](https://discuss.elastic.co/t/json-parse-exception-unexpected-character-code-39-was-expecting-double-quote-to-start-field-name/174284)

<div class="topic-metadata">

**Author:** [@waqashamid](https://discuss.elastic.co/u/waqashamid)\
**Replies:** 1\
**Last updated:** [April 8, 2019, 1:52am UTC](https://discuss.elastic.co/t/json-parse-exception-unexpected-character-code-39-was-expecting-double-quote-to-start-field-name/174284 "2019-04-08T01:52:25Z")

</div>

I have a curl request which is: curl -XGET "http://localhost:9200/\_search" -H 'Content-Type: application/json' -d' { "query": { "range": { "created": { "gte": "2016-01-01", "lte": "2018-01-01", "format": "yyyy-MM-dd" } …

---

## [How to setting ECS（Elastic Common Schema） true in Elasticsearch 6.7](https://discuss.elastic.co/t/how-to-setting-ecs-elastic-common-schema-true-in-elasticsearch-6-7/175315)

<div class="topic-metadata">

**Author:** [@taku333](https://discuss.elastic.co/u/taku333)\
**Replies:** 2\
**Last updated:** [April 8, 2019, 1:29am UTC](https://discuss.elastic.co/t/how-to-setting-ecs-elastic-common-schema-true-in-elasticsearch-6-7/175315 "2019-04-08T01:29:24Z")

</div>

Hi ! When I did the following, a warning occurred. In Elasticsearch 6.7, is there a way to configure using ECS ​​(Elastic Common Schema)? Is it impossible to wait until Elasticsearch 7.0? ◆POST POST \_ingest/pipeline…

---

## [Filebeat to Logstash, Logstash to Elasticsearch](https://discuss.elastic.co/t/filebeat-to-logstash-logstash-to-elasticsearch/174281)

<div class="topic-metadata">

**Author:** [@erdo](https://discuss.elastic.co/u/erdo)\
**Replies:** 1\
**Last updated:** [April 8, 2019, 1:23am UTC](https://discuss.elastic.co/t/filebeat-to-logstash-logstash-to-elasticsearch/174281 "2019-04-08T01:23:57Z")

</div>

I am using two different servers and my Filebeat server sends logs to the Logstash server without changing anything. Then Logstash server parse incoming files and forward it to the elastic. However, in elastic logs i can…

---

## [Suggester stops working](https://discuss.elastic.co/t/suggester-stops-working/175739)

<div class="topic-metadata">

**Author:** [@stp\_ra](https://discuss.elastic.co/u/stp_ra)\
**Replies:** 1\
**Last updated:** [April 7, 2019, 11:45pm UTC](https://discuss.elastic.co/t/suggester-stops-working/175739 "2019-04-07T23:45:14Z")

</div>

I have an autocomplete service that seems to work for a couple of days then after a few days of usage returns: \`{ "error" : { "root\_cause" : \[ { "type" : "parsing\_exception", "reason" : "Unkn…

---

## [Painless - How to return "missing value"?](https://discuss.elastic.co/t/painless-how-to-return-missing-value/175730)

<div class="topic-metadata">

**Author:** [@bures](https://discuss.elastic.co/u/bures)\
**Replies:** 1\
**Last updated:** [April 7, 2019, 9:20pm UTC](https://discuss.elastic.co/t/painless-how-to-return-missing-value/175730 "2019-04-07T21:20:26Z")

</div>

Please, is there a way to return "missing value" from Painless script (in Field context)? I'm trying to create a scripted field that has value only if a condition holds for another field in the document. Thanks.

---

## [Recommended Approach to address index pattern](https://discuss.elastic.co/t/recommended-approach-to-address-index-pattern/175687)

<div class="topic-metadata">

**Author:** [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\
**Replies:** 3\
**Last updated:** [April 7, 2019, 8:57pm UTC](https://discuss.elastic.co/t/recommended-approach-to-address-index-pattern/175687 "2019-04-07T20:57:25Z")

</div>

Dear Experts, I have a legacy index created a few years ago before I better understood index management and looking for a recommendation to address the problem. I am looking at the least impactful way/time intensive wa…

---

## [Integer Vs Long field comparison](https://discuss.elastic.co/t/integer-vs-long-field-comparison/175726)

<div class="topic-metadata">

**Author:** [@varvind](https://discuss.elastic.co/u/varvind)\
**Replies:** 0\
**Last updated:** [April 7, 2019, 6:29pm UTC](https://discuss.elastic.co/t/integer-vs-long-field-comparison/175726 "2019-04-07T18:29:00Z")

</div>

We are running a multi-tenant elastic search cluster, with tenant per index. To provide a better client experience and to avoid migration pains later, I am trying to compare Integer Vs. Long field storage. I am trying to…

---

## [Custom Match Score](https://discuss.elastic.co/t/custom-match-score/175725)

<div class="topic-metadata">

**Author:** [@Ashish\_Modi](https://discuss.elastic.co/u/Ashish_Modi)\
**Replies:** 0\
**Last updated:** [April 7, 2019, 6:27pm UTC](https://discuss.elastic.co/t/custom-match-score/175725 "2019-04-07T18:27:08Z")

</div>

Hi All, We have a requirement in which we take input from user and match it against our fields in elastic search. At the moment it is a free text search and user can type anything. What we have done is basically while i…

---

## [Python elasticsearch-dsl bulk insert will not work as a cron job otherwise it works fine](https://discuss.elastic.co/t/python-elasticsearch-dsl-bulk-insert-will-not-work-as-a-cron-job-otherwise-it-works-fine/175722)

<div class="topic-metadata">

**Author:** [@steelliberty](https://discuss.elastic.co/u/steelliberty)\
**Replies:** 1\
**Last updated:** [April 7, 2019, 6:14pm UTC](https://discuss.elastic.co/t/python-elasticsearch-dsl-bulk-insert-will-not-work-as-a-cron-job-otherwise-it-works-fine/175722 "2019-04-07T18:14:51Z")

</div>

Hi -- I have an automated search and insert program based on elasticsearch-dsl.py and scrapy using the python elasticsearch pipeline for bulk insert into es. It runs flawlessly when I start it as root, but when I try t…

---

## [Pagination currentpage now working in ReactiveList](https://discuss.elastic.co/t/pagination-currentpage-now-working-in-reactivelist/175403)

<div class="topic-metadata">

**Author:** [@hasith\_thenuwara](https://discuss.elastic.co/u/hasith_thenuwara)\
**Replies:** 2\
**Last updated:** [April 7, 2019, 3:39pm UTC](https://discuss.elastic.co/t/pagination-currentpage-now-working-in-reactivelist/175403 "2019-04-07T15:39:59Z")

</div>

I need to change pagination currentpage in reactvieList but when i use RangeSlider , currentpage not change according my value. without RangeSlider work as expected. react={{ and: \[ 'pricecompId',\]}} pricecompid is t…

---

## [6.7 xpack-sql throws "Rule execution limit %d reached"](https://discuss.elastic.co/t/6-7-xpack-sql-throws-rule-execution-limit-d-reached/175122)

<div class="topic-metadata">

**Author:** [@kaihong](https://discuss.elastic.co/u/kaihong)\
**Replies:** 3\
**Last updated:** [April 7, 2019, 3:34pm UTC](https://discuss.elastic.co/t/6-7-xpack-sql-throws-rule-execution-limit-d-reached/175122 "2019-04-07T15:34:40Z")

</div>

ERROR: { "error": { "root\_cause": \[ { "type": "rule\_execution\_exception", "reason": "Rule execution limit %d reached" } \], "type": "rule\_execution\_exception", "reason": "Rul…

---

## [Elasticsearch with Java -: Use scroll API for queries written in JSON format](https://discuss.elastic.co/t/elasticsearch-with-java-use-scroll-api-for-queries-written-in-json-format/175363)

<div class="topic-metadata">

**Author:** [@Aditya\_Srivastava](https://discuss.elastic.co/u/Aditya_Srivastava)\
**Replies:** 5\
**Last updated:** [April 7, 2019, 1:15pm UTC](https://discuss.elastic.co/t/elasticsearch-with-java-use-scroll-api-for-queries-written-in-json-format/175363 "2019-04-07T13:15:17Z")

</div>

I have a query taken from kibana in JSON format. I have a java code where I am able to fire this same query using RestClient which is working fine. Now the data being fetched is huge and so I want to use the scroll API …

---

## [Elasticsearch(6.5) HIgh level java rest client Delete an index by name is not working](https://discuss.elastic.co/t/elasticsearch-6-5-high-level-java-rest-client-delete-an-index-by-name-is-not-working/174939)

<div class="topic-metadata">

**Author:** [@Aswini\_Kumar\_Rout](https://discuss.elastic.co/u/Aswini_Kumar_Rout)\
**Replies:** 18\
**Last updated:** [April 5, 2019, 6:19am UTC](https://discuss.elastic.co/t/elasticsearch-6-5-high-level-java-rest-client-delete-an-index-by-name-is-not-working/174939 "2019-04-05T06:19:23Z")

</div>

I can delete an document by passing the index name , type and id like this- DeleteRequest deleteRequest = new DeleteRequest(data.getIndexName(),data.getType(),data.getUniqueId()); DeleteResponse deleteResponse = clie…

---

## [ES 5.6 Spiky load that I cannot correlate with any search/indexing services](https://discuss.elastic.co/t/es-5-6-spiky-load-that-i-cannot-correlate-with-any-search-indexing-services/175710)

<div class="topic-metadata">

**Author:** [@Lasse\_Vang\_Gravesen](https://discuss.elastic.co/u/Lasse_Vang_Gravesen)\
**Replies:** 0\
**Last updated:** [April 7, 2019, 11:01am UTC](https://discuss.elastic.co/t/es-5-6-spiky-load-that-i-cannot-correlate-with-any-search-indexing-services/175710 "2019-04-07T11:01:39Z")

</div>

Have anyone seen this kind of behaviour before with their load: There is no obvious correlation between any of the indexing or search services that would be causing this, 99% of the time that is the 'normal' cpu usage…

---

## [How do i import stack of Excel/CSV sheets to Elasticsearch?](https://discuss.elastic.co/t/how-do-i-import-stack-of-excel-csv-sheets-to-elasticsearch/175693)

<div class="topic-metadata">

**Author:** [@Niranga\_Jayakody](https://discuss.elastic.co/u/Niranga_Jayakody)\
**Replies:** 2\
**Last updated:** [April 7, 2019, 7:42am UTC](https://discuss.elastic.co/t/how-do-i-import-stack-of-excel-csv-sheets-to-elasticsearch/175693 "2019-04-07T07:42:39Z")

</div>

Im new to elasticsearch and i have 100's of excel/csv sheets that need to be imported to elasticsearch. All of these files has a Primary column name as "Mobile Number" and other different attributes. I need to impor…

---

## [Question about sub-field:value query](https://discuss.elastic.co/t/question-about-sub-field-value-query/175501)

<div class="topic-metadata">

**Author:** [@jasony](https://discuss.elastic.co/u/jasony)\
**Replies:** 1\
**Last updated:** [April 7, 2019, 2:57am UTC](https://discuss.elastic.co/t/question-about-sub-field-value-query/175501 "2019-04-07T02:57:22Z")

</div>

Hello, I am currently working on snapshots for some indices in my cluster. I am planning to store \_status query result into an index in elasticsearch after the snapshot job is completed. a part of \_status results are a…

---

## [Unable to load geoip in elasticsearch/logstash](https://discuss.elastic.co/t/unable-to-load-geoip-in-elasticsearch-logstash/175529)

<div class="topic-metadata">

**Author:** [@bharat1](https://discuss.elastic.co/u/bharat1)\
**Replies:** 27\
**Last updated:** [April 7, 2019, 1:44am UTC](https://discuss.elastic.co/t/unable-to-load-geoip-in-elasticsearch-logstash/175529 "2019-04-07T01:44:04Z")

</div>

Dear All, I am new to ELK stack. I am unable to add/load geoip details into my elasticsearch/logstash. I have installed ELK 6.7 version + filebeat & metricbeat, I tried using /usr/share/elasticsearch/bin/elasticsearch-…

---

## [Joining two sql tables in elasticsearch](https://discuss.elastic.co/t/joining-two-sql-tables-in-elasticsearch/175685)

<div class="topic-metadata">

**Author:** [@dkuiate1](https://discuss.elastic.co/u/dkuiate1)\
**Replies:** 1\
**Last updated:** [April 6, 2019, 8:13pm UTC](https://discuss.elastic.co/t/joining-two-sql-tables-in-elasticsearch/175685 "2019-04-06T20:13:52Z")

</div>

Hello i'm new to elasticsearch. I'm trying to join data that i imported from two sql tables and i do not really understand how to do that. These are my config files to import data: input { jdbc { jdbc\_driver\_library …

---

## [Lowercase analyzer and aggregation sort](https://discuss.elastic.co/t/lowercase-analyzer-and-aggregation-sort/175657)

<div class="topic-metadata">

**Author:** [@Michele\_Caccia](https://discuss.elastic.co/u/Michele_Caccia)\
**Replies:** 4\
**Last updated:** [April 6, 2019, 6:22pm UTC](https://discuss.elastic.co/t/lowercase-analyzer-and-aggregation-sort/175657 "2019-04-06T18:22:11Z")

</div>

Hello everybody, I think I'm wrong using Elastic custom analyzer (version 1.7 :frowning: ). I use a lowercase analyzer to sort a field in case insensitive way. I found a problem when I analyze the aggregations (I need …

---

## [Index elastic search source pentaho](https://discuss.elastic.co/t/index-elastic-search-source-pentaho/175683)

<div class="topic-metadata">

**Author:** [@Gharbi\_Hachem](https://discuss.elastic.co/u/Gharbi_Hachem)\
**Replies:** 0\
**Last updated:** [April 6, 2019, 6:04pm UTC](https://discuss.elastic.co/t/index-elastic-search-source-pentaho/175683 "2019-04-06T18:04:51Z")

</div>

Hello, How can i read index json with pentaho?

---

## [Elasticsearch SearchSourceBuilder.size](https://discuss.elastic.co/t/elasticsearch-searchsourcebuilder-size/175601)

<div class="topic-metadata">

**Author:** [@Dv\_Thiyanesh](https://discuss.elastic.co/u/Dv_Thiyanesh)\
**Replies:** 7\
**Last updated:** [April 6, 2019, 5:19pm UTC](https://discuss.elastic.co/t/elasticsearch-searchsourcebuilder-size/175601 "2019-04-06T17:19:25Z")

</div>

I am using java High level client API to fetch data, when using searchsourcebuilder by default it takes default 10 documents but i have more than 1,00,000 documents for this i am using searchSourceBuilder.from() and sear…

---

## [Slack configure URL with parameters](https://discuss.elastic.co/t/slack-configure-url-with-parameters/175680)

<div class="topic-metadata">

**Author:** [@krlos](https://discuss.elastic.co/u/krlos)\
**Replies:** 0\
**Last updated:** [April 6, 2019, 5:08pm UTC](https://discuss.elastic.co/t/slack-configure-url-with-parameters/175680 "2019-04-06T17:08:45Z")

</div>

Hello! i'm trying to configure elasticsearch for send to slack channel: my url is like: https://someslackurl.slack.com/slack\_webhook/services/XXXXXXXX/XXXXXXXX/Xxxxxxxx?authentication=8dOnF9XxXYyzZ as you can see i…

---

## [Performance of Rest client vs Transport client](https://discuss.elastic.co/t/performance-of-rest-client-vs-transport-client/171790)

<div class="topic-metadata">

**Author:** [@jwistrom](https://discuss.elastic.co/u/jwistrom)\
**Replies:** 9\
**Last updated:** [April 6, 2019, 12:26pm UTC](https://discuss.elastic.co/t/performance-of-rest-client-vs-transport-client/171790 "2019-04-06T12:26:25Z")

</div>

Hi We have a cluster running Elasticsearch 6.5.3 and we are using the same version for the java client library. Since we replaced the transport client in favor of the high level rest client, we are experiencing a major …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1339)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1341)
