# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1727 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1728 --- ## [FileBeat - Kibana - ES Issue](https://discuss.elastic.co/t/filebeat-kibana-es-issue/127109)
**Author:** [@Ashish\_Modi](https://discuss.elastic.co/u/Ashish_Modi)\ **Replies:** 4\ **Last updated:** [April 6, 2018, 4:03pm UTC](https://discuss.elastic.co/t/filebeat-kibana-es-issue/127109 "2018-04-06T16:03:41Z")
We have filebeat on our linux box which periodically sends logs to elastic search and from there kibana is used to display them. In the scenario our application generates two types of logs: Type 1 - {"data": "some strin… --- ## [Es response with field name with dots to bind in hive](https://discuss.elastic.co/t/es-response-with-field-name-with-dots-to-bind-in-hive/127019)
**Author:** [@Suktae\_Choi](https://discuss.elastic.co/u/Suktae_Choi)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 3:11pm UTC](https://discuss.elastic.co/t/es-response-with-field-name-with-dots-to-bind-in-hive/127019 "2018-04-06T15:11:19Z")
I tired to bind this response to hive and got failed. { "took":3068, "timed\_out":false, "\_shards":{ "total":348, "successful":348, "skipped":0, "failed":0 }, "hits":{ … --- ## [New Primary Shards On Same Node](https://discuss.elastic.co/t/new-primary-shards-on-same-node/126974)
**Author:** [@praveen.vemuri](https://discuss.elastic.co/u/praveen.vemuri)\ **Replies:** 2\ **Last updated:** [April 6, 2018, 2:41pm UTC](https://discuss.elastic.co/t/new-primary-shards-on-same-node/126974 "2018-04-06T14:41:31Z")
We have a 200 node cluster with multiple instances on same node. say host1-node1, host1-node2, host1-node3. when we do a rolling upgrade. as we disable shard allocation. we don't have any issues with shards distribution… --- ## [Keeping Indices for over a year](https://discuss.elastic.co/t/keeping-indices-for-over-a-year/126438)
**Author:** [@kmroz](https://discuss.elastic.co/u/kmroz)\ **Replies:** 2\ **Last updated:** [April 6, 2018, 2:39pm UTC](https://discuss.elastic.co/t/keeping-indices-for-over-a-year/126438 "2018-04-06T14:39:40Z")
We are looking for a solution to keep indices that are roughly 7gb per day in size for about a year. Keeping it locally on disk isn't going to work for us . My one idea is the back it up to s3 then have a separate cluste… --- ## [ES 6.x...how to get list of percolator queries in an index?](https://discuss.elastic.co/t/es-6-x-how-to-get-list-of-percolator-queries-in-an-index/126987)
**Author:** [@andywilliams](https://discuss.elastic.co/u/andywilliams)\ **Replies:** 2\ **Last updated:** [April 6, 2018, 2:35pm UTC](https://discuss.elastic.co/t/es-6-x-how-to-get-list-of-percolator-queries-in-an-index/126987 "2018-04-06T14:35:56Z")
How does one get a list of percolator documents, say with field query in an index? Since ES 6.x, percolators are kept in same index as those documents they are querying, so I would have assumed I could get all percolato… --- ## [Insensitive searching](https://discuss.elastic.co/t/insensitive-searching/126616)
**Author:** [@olenderhub](https://discuss.elastic.co/u/olenderhub)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 2:30pm UTC](https://discuss.elastic.co/t/insensitive-searching/126616 "2018-04-06T14:30:15Z")
Good morning, I am struggling with insensitive searching (elasticsearch version 2.4.6). Currently, I am using Ruby on Rails and using wrapper for Elasticsearch. My configuration is: (record has a string for example: "… --- ## [Can't start elasticsearch service](https://discuss.elastic.co/t/cant-start-elasticsearch-service/127099)
**Author:** [@Abdesslem\_Jerbi](https://discuss.elastic.co/u/Abdesslem_Jerbi)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 2:06pm UTC](https://discuss.elastic.co/t/cant-start-elasticsearch-service/127099 "2018-04-06T14:06:49Z")
Hi all, i work on ubuntu VM ,and i cant start service ES;;i followed all the steps for installation Synchronizing state of elasticsearch.service with SysV init with /lib/systemd/systemd-sysv-install... Executing /lib/… --- ## [Is it possible to use DeleteByQueryRequest with RestHighLevelClient?](https://discuss.elastic.co/t/is-it-possible-to-use-deletebyqueryrequest-with-resthighlevelclient/126201)
**Author:** [@agazzarini](https://discuss.elastic.co/u/agazzarini)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 1:20pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-deletebyqueryrequest-with-resthighlevelclient/126201 "2018-04-06T13:20:06Z")
I'm not able to find some example and I even didn't get the point if such thing is possible or I should switch to low level client (and in this case I'm wondering what the role of org.elasticsearch.index.reindex.DeleteBy… --- ## [Averaging more than 10,000 results](https://discuss.elastic.co/t/averaging-more-than-10-000-results/126552)
**Author:** [@cohenran](https://discuss.elastic.co/u/cohenran)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 12:51pm UTC](https://discuss.elastic.co/t/averaging-more-than-10-000-results/126552 "2018-04-06T12:51:16Z")
I have millions of records. I want to get the average of a specific field, but can only return less that 10,000 rows. Is the average returned is the real average of the millions of rows, or the average of the returned r… --- ## [Performance difference between Java High Level REST Client vs Low Level REST Client](https://discuss.elastic.co/t/performance-difference-between-java-high-level-rest-client-vs-low-level-rest-client/125775)
**Author:** [@mhmtnlr](https://discuss.elastic.co/u/mhmtnlr)\ **Replies:** 3\ **Last updated:** [April 6, 2018, 12:46pm UTC](https://discuss.elastic.co/t/performance-difference-between-java-high-level-rest-client-vs-low-level-rest-client/125775 "2018-04-06T12:46:56Z")
Hello, I was doing a performance test on my system. In my test, Java High-Level Client makes ~800 RPS for a simple get request. When I change the implementation and use Java Low-Level Client, it reaches to ~1750 RPS. Wh… --- ## [Strange size difference in shards since upgrading to 6.2](https://discuss.elastic.co/t/strange-size-difference-in-shards-since-upgrading-to-6-2/126238)
**Author:** [@kstoney](https://discuss.elastic.co/u/kstoney)\ **Replies:** 3\ **Last updated:** [April 6, 2018, 12:31pm UTC](https://discuss.elastic.co/t/strange-size-difference-in-shards-since-upgrading-to-6-2/126238 "2018-04-06T12:31:51Z")
Hi, We recently upgraded from 6.1 to 6.2 and we're noticing that some shards are getting disproportionately big. Take these two, shard 0 from the same index, different nodes. 16gig on one, 6 gig on the other? |metric… --- ## [Migrating simple parent child to 6.x using a join type field](https://discuss.elastic.co/t/migrating-simple-parent-child-to-6-x-using-a-join-type-field/127088)
**Author:** [@Gemma\_Cabero](https://discuss.elastic.co/u/Gemma_Cabero)\ **Replies:** 0\ **Last updated:** [April 6, 2018, 12:04pm UTC](https://discuss.elastic.co/t/migrating-simple-parent-child-to-6-x-using-a-join-type-field/127088 "2018-04-06T12:04:54Z")
After a few of days of investigation and reading different links and documentation I'm feeling a bit defeated on how to migrate a simple parent child relationship defined in 2.x to 6.x. As I understand going foward singl… --- ## [Missing result using scroll in java API](https://discuss.elastic.co/t/missing-result-using-scroll-in-java-api/127063)
**Author:** [@kchrusciel](https://discuss.elastic.co/u/kchrusciel)\ **Replies:** 9\ **Last updated:** [April 6, 2018, 11:52am UTC](https://discuss.elastic.co/t/missing-result-using-scroll-in-java-api/127063 "2018-04-06T11:52:31Z")
Hi, I use Java API to works with ES. When I start using scroll API like that: SearchResponse response = client.prepareSearch() .setIndices(indexName) .setTypes(ty… --- ## [Elasaticsearch 650 million records optimization](https://discuss.elastic.co/t/elasaticsearch-650-million-records-optimization/126397)
**Author:** [@palaniichukdmytro](https://discuss.elastic.co/u/palaniichukdmytro)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 11:40am UTC](https://discuss.elastic.co/t/elasaticsearch-650-million-records-optimization/126397 "2018-04-06T11:40:41Z")
I try to figure out what solution is best for elasticsearch if my records will scale up to 658 million records per year. Actually now I have one index for all my records with 2 shards and 0 replicas. Also, I noticed that… --- ## [Mapping for text and date field that should be null-able and sort-able](https://discuss.elastic.co/t/mapping-for-text-and-date-field-that-should-be-null-able-and-sort-able/126932)
**Author:** [@nmathur](https://discuss.elastic.co/u/nmathur)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 11:33am UTC](https://discuss.elastic.co/t/mapping-for-text-and-date-field-that-should-be-null-able-and-sort-able/126932 "2018-04-06T11:33:20Z")
Hello All, I have some very important allow null fields in my database .. few are text fields and few date fields.... I am facing issue with elasticsearch mapping. When I set allow null to the properties then sorting d… --- ## [HPROF Created on ES 6.2.2](https://discuss.elastic.co/t/hprof-created-on-es-6-2-2/126967)
**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\ **Replies:** 2\ **Last updated:** [April 6, 2018, 10:29am UTC](https://discuss.elastic.co/t/hprof-created-on-es-6-2-2/126967 "2018-04-06T10:29:32Z")
Hi, I installed ELK 6.2 version and allocated -Xms1g as heap space and 370 GB space left out in the drive. Not sure what queries had been passed thru Kibana, Elastic Search stopped abruptly and created a HPROF file, I t… --- ## [Elastic shield for ssl](https://discuss.elastic.co/t/elastic-shield-for-ssl/126084)
**Author:** [@visha\_viji](https://discuss.elastic.co/u/visha_viji)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 10:25am UTC](https://discuss.elastic.co/t/elastic-shield-for-ssl/126084 "2018-04-06T10:25:37Z")
Is there any way to use shield with out user authentication for ssl setup --- ## [Elasticsearch with x-pack installation](https://discuss.elastic.co/t/elasticsearch-with-x-pack-installation/127035)
**Author:** [@Gaurav\_Agarwal](https://discuss.elastic.co/u/Gaurav_Agarwal)\ **Replies:** 15\ **Last updated:** [April 6, 2018, 10:24am UTC](https://discuss.elastic.co/t/elasticsearch-with-x-pack-installation/127035 "2018-04-06T10:24:32Z")
\[2018-04-06T06:15:12,473\]\[INFO \]\[o.e.p.PluginsService \] \[1e85IX5\] loaded module \[aggs-matrix-stats\] \[2018-04-06T06:15:12,473\]\[INFO \]\[o.e.p.PluginsService \] \[1e85IX5\] loaded module \[ingest-common\] \[2018-04-06T06… --- ## [Looking up the content of the search queue](https://discuss.elastic.co/t/looking-up-the-content-of-the-search-queue/127052)
**Author:** [@Janick\_Brischle](https://discuss.elastic.co/u/Janick_Brischle)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 9:55am UTC](https://discuss.elastic.co/t/looking-up-the-content-of-the-search-queue/127052 "2018-04-06T09:55:01Z")
I have often seen the following output in my elastic logs and i wondered if there is a way to look up the content of the search queue. 2018-04-06T07:32:47,717\]\[WARN \]\[r.suppressed \] path: /.kibana/\_search, p… --- ## [When fielddata eviction occur?](https://discuss.elastic.co/t/when-fielddata-eviction-occur/127044)
**Author:** [@8a98bb2968a03fe24acf](https://discuss.elastic.co/u/8a98bb2968a03fe24acf)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 9:51am UTC](https://discuss.elastic.co/t/when-fielddata-eviction-occur/127044 "2018-04-06T09:51:32Z")
I saw that metric fielddata\_evictions When fielddata eviction occur? --- ## [Read excel file and search in elastic search](https://discuss.elastic.co/t/read-excel-file-and-search-in-elastic-search/127061)
**Author:** [@famo](https://discuss.elastic.co/u/famo)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 9:49am UTC](https://discuss.elastic.co/t/read-excel-file-and-search-in-elastic-search/127061 "2018-04-06T09:49:20Z")
Hi I have a 20 millions rows student document in elastic search and I have excel file with 7000 rows that have students mobile number and I want to find all these students national No and students code in elastic sear… --- ## [Date issue in elasticsearch](https://discuss.elastic.co/t/date-issue-in-elasticsearch/126122)
**Author:** [@aliyesami](https://discuss.elastic.co/u/aliyesami)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 9:35am UTC](https://discuss.elastic.co/t/date-issue-in-elasticsearch/126122 "2018-04-06T09:35:25Z")
I loaded an relation table data into elasticsearch . the max date on relation side is not matching with the max date on elastic side although the total number of records match . SQL\> select max(pur\_trans\_date) from ta… --- ## [Snapshot and restore segments](https://discuss.elastic.co/t/snapshot-and-restore-segments/126064)
**Author:** [@laurentiusoica](https://discuss.elastic.co/u/laurentiusoica)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 9:30am UTC](https://discuss.elastic.co/t/snapshot-and-restore-segments/126064 "2018-04-06T09:30:12Z")
Hello, I have a few questions regarding the ES snapshot feature. I am not able to find a proper answer in the ES documentation so maybe someone could shed some light: does a snapshot include uncommitted segments as we… --- ## [Filter empty terms buckets after aggregation](https://discuss.elastic.co/t/filter-empty-terms-buckets-after-aggregation/127039)
**Author:** [@aurimas](https://discuss.elastic.co/u/aurimas)\ **Replies:** 4\ **Last updated:** [April 6, 2018, 9:00am UTC](https://discuss.elastic.co/t/filter-empty-terms-buckets-after-aggregation/127039 "2018-04-06T09:00:54Z")
I am trying to run a query which returns only network device and interface which have specific utilization. I am using bucket\_selector to filter out value aggregations which does not meat criteria and it almost gives me… --- ## [ElasticSearch.Net 6.0.2 bulk insert](https://discuss.elastic.co/t/elasticsearch-net-6-0-2-bulk-insert/126703)
**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\ **Replies:** 2\ **Last updated:** [April 6, 2018, 8:50am UTC](https://discuss.elastic.co/t/elasticsearch-net-6-0-2-bulk-insert/126703 "2018-04-06T08:50:33Z")
Hi How can I do the bulk insert with ElasticSearch.Net 6.0.2 and NEST 6.0.2 currently with ElasticSearch.Net 5.5.0 and NEST 5.5.0, using following way lstRowsToCache.Add( new … --- ## [Architecture for elastic deployment](https://discuss.elastic.co/t/architecture-for-elastic-deployment/127053)
**Author:** [@Laxman](https://discuss.elastic.co/u/Laxman)\ **Replies:** 0\ **Last updated:** [April 6, 2018, 8:23am UTC](https://discuss.elastic.co/t/architecture-for-elastic-deployment/127053 "2018-04-06T08:23:28Z")
Dear Team, Am new to ELK, I have some doubts about balance architecture. Currently approach in PRD for our application will be active active state.. So both PROD & DR will be active, Now we need to send both PROD & DR l… --- ## [Sizing of an ELK node](https://discuss.elastic.co/t/sizing-of-an-elk-node/126992)
**Author:** [@Henry\_N](https://discuss.elastic.co/u/Henry_N)\ **Replies:** 5\ **Last updated:** [April 6, 2018, 8:20am UTC](https://discuss.elastic.co/t/sizing-of-an-elk-node/126992 "2018-04-06T08:20:19Z")
I have a single ELKnode with 300GB of storage. I downloaded 30GB of load balancer logs to be processed in ELK. I'm expecting 90million requests but so far there's only 27million hits, indexing has stopped and disk usage … --- ## [Deleting documents vs deleting the whole index and rebuilding it periodically](https://discuss.elastic.co/t/deleting-documents-vs-deleting-the-whole-index-and-rebuilding-it-periodically/127018)
**Author:** [@Hooman\_Bahreini](https://discuss.elastic.co/u/Hooman_Bahreini)\ **Replies:** 5\ **Last updated:** [April 6, 2018, 7:43am UTC](https://discuss.elastic.co/t/deleting-documents-vs-deleting-the-whole-index-and-rebuilding-it-periodically/127018 "2018-04-06T07:43:11Z")
I am creating an online shopping website. Users can create advertisements on the website to sell their products... these advertisements get expired or sold after some time... I am keeping all advertisement in MySQL and … --- ## [Slow bool query](https://discuss.elastic.co/t/slow-bool-query/127027)
**Author:** [@BS1](https://discuss.elastic.co/u/BS1)\ **Replies:** 2\ **Last updated:** [April 6, 2018, 7:30am UTC](https://discuss.elastic.co/t/slow-bool-query/127027 "2018-04-06T07:30:31Z")
The following request takes at least 500ms every time we execute it. This is on a an index with 5 primary shards of 1.2GB each. Is there anything in the query that would explain the slowness ? The cluster is otherwise pe… --- ## [Update to rest client instead of transport client](https://discuss.elastic.co/t/update-to-rest-client-instead-of-transport-client/127023)
**Author:** [@ts\_rana](https://discuss.elastic.co/u/ts_rana)\ **Replies:** 1\ **Last updated:** [April 6, 2018, 7:14am UTC](https://discuss.elastic.co/t/update-to-rest-client-instead-of-transport-client/127023 "2018-04-06T07:14:39Z")
Could you please help me to find corresponding API references for update these API to rest or any example ? 1.String\[\] indices = transportClient.admin().indices().prepareGetIndex().addIndices("\_" + tid + "-").execute().… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1726) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1728)