# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1390 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1391 --- ## [Shard is too big because of routing](https://discuss.elastic.co/t/shard-is-too-big-because-of-routing/169000)
**Author:** [@andyhoang](https://discuss.elastic.co/u/andyhoang)\ **Replies:** 0\ **Last updated:** [February 19, 2019, 10:34am UTC](https://discuss.elastic.co/t/shard-is-too-big-because-of-routing/169000 "2019-02-19T10:34:09Z")
Hi guys, I have a problem of one shard contain too many docs. So I have an indice, docs in this indice is routed by some kind of an organization\_id, so we know that all docs from an organization would be in one shard Thi… --- ## [Elastic Search - Scrolling for Not too many documents?](https://discuss.elastic.co/t/elastic-search-scrolling-for-not-too-many-documents/168992)
**Author:** [@Avdhey\_Tiwari](https://discuss.elastic.co/u/Avdhey_Tiwari)\ **Replies:** 1\ **Last updated:** [February 19, 2019, 10:34am UTC](https://discuss.elastic.co/t/elastic-search-scrolling-for-not-too-many-documents/168992 "2019-02-19T10:34:05Z")
We have a use-case where we are querying elastic for an unknown number of results, with very aggressive latency requirements. In 99 percentile of scenarios, the result-set \< page size. In \<= 1 percentile, the results ma… --- ## [Elasticquery](https://discuss.elastic.co/t/elasticquery/168939)
**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\ **Replies:** 8\ **Last updated:** [February 19, 2019, 10:13am UTC](https://discuss.elastic.co/t/elasticquery/168939 "2019-02-19T10:13:54Z")
I have few duplicate documents under a particular index . Is there any way to skip the duplicate entry through elastic query ? I have following documents under a index. Now I want a single document through elastic query… --- ## [Strange issue with bulk(?) interface](https://discuss.elastic.co/t/strange-issue-with-bulk-interface/168661)
**Author:** [@jrandombob](https://discuss.elastic.co/u/jrandombob)\ **Replies:** 11\ **Last updated:** [February 19, 2019, 9:54am UTC](https://discuss.elastic.co/t/strange-issue-with-bulk-interface/168661 "2019-02-19T09:54:29Z")
ElasticSearch 6.3.4 Logstash 6.6.0 I'm in the process of ingesting a large amount of data into an ES index (several billion records), there's a lot of duplication in my input dataset so the first block was imported to … --- ## [Weird error using AWS Elasticsearch with Laravel ES packages](https://discuss.elastic.co/t/weird-error-using-aws-elasticsearch-with-laravel-es-packages/168979)
**Author:** [@megusta420](https://discuss.elastic.co/u/megusta420)\ **Replies:** 3\ **Last updated:** [February 19, 2019, 9:43am UTC](https://discuss.elastic.co/t/weird-error-using-aws-elasticsearch-with-laravel-es-packages/168979 "2019-02-19T09:43:54Z")
Using these packages: Here is my dotenv: ES\_HOST=search-\*\*\*\*-w3skhs3k55\*\*\*\*\*trko6qhjsxq.eu-central-1.es.amazonaws.com ES\_PORT=443 ES\_SCHEME=https I'm getting this error while trying to add an index: {"message… --- ## [Failing shard Recovery](https://discuss.elastic.co/t/failing-shard-recovery/168962)
**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\ **Replies:** 4\ **Last updated:** [February 19, 2019, 9:09am UTC](https://discuss.elastic.co/t/failing-shard-recovery/168962 "2019-02-19T09:09:54Z")
Hi, We're running elasticsearch 5.6.3 and have a shard that is failing recovery or rerouted assignment. The error I'm seeing is this: failed recovery, failure RecoveryFailedException\[\[index-2019.02.12\]\[3\]: Recovery fai… --- ## [MultiSearchResponse - containing responses haven't set a scroll id](https://discuss.elastic.co/t/multisearchresponse-containing-responses-havent-set-a-scroll-id/168968)
**Author:** [@Josef\_Fritzer](https://discuss.elastic.co/u/Josef_Fritzer)\ **Replies:** 0\ **Last updated:** [February 19, 2019, 8:49am UTC](https://discuss.elastic.co/t/multisearchresponse-containing-responses-havent-set-a-scroll-id/168968 "2019-02-19T08:49:23Z")
Hi Guys, I'm currently building a MultiSearchRequest which has two requests included and each of them has set a scroll. Everything works fine, request works, request contains two responses as expected but if I try to ge… --- ## [Trying to start the bitbucket server, but throwing an error stating "BIND TRANSPORT EXCEPTION"](https://discuss.elastic.co/t/trying-to-start-the-bitbucket-server-but-throwing-an-error-stating-bind-transport-exception/168859)
**Author:** [@manoharreddy](https://discuss.elastic.co/u/manoharreddy)\ **Replies:** 3\ **Last updated:** [February 19, 2019, 9:09am UTC](https://discuss.elastic.co/t/trying-to-start-the-bitbucket-server-but-throwing-an-error-stating-bind-transport-exception/168859 "2019-02-19T09:09:41Z")
I'm getting below error. Kindly help me in resolving the same. \[2019-02-18T15:18:21,418\]\[ERROR\]\[o.e.b.Bootstrap \] \[bitbucket\_bundled\] Exception org.elasticsearch.transport.BindTransportException: Failed to bin… --- ## [Unicast\_hosts.txt entries are not getting loaded](https://discuss.elastic.co/t/unicast-hosts-txt-entries-are-not-getting-loaded/168846)
**Author:** [@Rosmi](https://discuss.elastic.co/u/Rosmi)\ **Replies:** 7\ **Last updated:** [February 19, 2019, 8:59am UTC](https://discuss.elastic.co/t/unicast-hosts-txt-entries-are-not-getting-loaded/168846 "2019-02-19T08:59:07Z")
I have a node running in the cluster. Now starting the second node, My application creates unicast\_hosts.txt in conf folder with ipaddress and port entry of the first node. The second node is not reloading the new confi… --- ## [Upgradation of ELK stack and Beats](https://discuss.elastic.co/t/upgradation-of-elk-stack-and-beats/168957)
**Author:** [@cppatel](https://discuss.elastic.co/u/cppatel)\ **Replies:** 1\ **Last updated:** [February 19, 2019, 8:40am UTC](https://discuss.elastic.co/t/upgradation-of-elk-stack-and-beats/168957 "2019-02-19T08:40:37Z")
Hi , I want to upgrade my ELK stack from version 6.2 to version 6.7 . Do I get any document link which sort of shows a comparision between 6.2 & 6.7 . Just want to know Is it worthing to upgrade it to 6.7 or directly … --- ## [Cannot open stream inlined queries need to be marked as such through \`?\` and \`{}\` ES Spark connection](https://discuss.elastic.co/t/cannot-open-stream-inlined-queries-need-to-be-marked-as-such-through-and-es-spark-connection/168956)
**Author:** [@prashantgupta048](https://discuss.elastic.co/u/prashantgupta048)\ **Replies:** 0\ **Last updated:** [February 19, 2019, 7:47am UTC](https://discuss.elastic.co/t/cannot-open-stream-inlined-queries-need-to-be-marked-as-such-through-and-es-spark-connection/168956 "2019-02-19T07:47:22Z")
I am trying to connect elastic search from Spark java code i have set the ssl to true I have provided trust and keystore also in Sparkconf. But am getting below error when am trying to read the data from RDD Caused by:… --- ## [Multiple word synonims does not affect score in query](https://discuss.elastic.co/t/multiple-word-synonims-does-not-affect-score-in-query/168082)
**Author:** [@gennaris](https://discuss.elastic.co/u/gennaris)\ **Replies:** 4\ **Last updated:** [February 19, 2019, 7:36am UTC](https://discuss.elastic.co/t/multiple-word-synonims-does-not-affect-score-in-query/168082 "2019-02-19T07:36:59Z")
Hello, ES newbie here, looking for help in understanding what's wrong. Let's consider this index mapping, where I define some synonims for motobike models : { "settings": { "analysis": { "char\_filter": … --- ## [Why are we told to copy the data folder when upgrading?](https://discuss.elastic.co/t/why-are-we-told-to-copy-the-data-folder-when-upgrading/168951)
**Author:** [@gyau](https://discuss.elastic.co/u/gyau)\ **Replies:** 4\ **Last updated:** [February 19, 2019, 7:32am UTC](https://discuss.elastic.co/t/why-are-we-told-to-copy-the-data-folder-when-upgrading/168951 "2019-02-19T07:32:46Z")
I was reading the snapshot and restore section from the documentation and it said that it isn't recommended to just copy and paste the folder because there might be some data loss. It is not possible to back up an Elas… --- ## [Do snapshots backup everything?](https://discuss.elastic.co/t/do-snapshots-backup-everything/168949)
**Author:** [@gyau](https://discuss.elastic.co/u/gyau)\ **Replies:** 1\ **Last updated:** [February 19, 2019, 7:20am UTC](https://discuss.elastic.co/t/do-snapshots-backup-everything/168949 "2019-02-19T07:20:36Z")
I'm new at using this feature, so I'm a quite confused about it. What I understood is that it creates a backup of the ES indices, so does it mean that it creates a backup of all the documents, regardless of how many doc… --- ## [TikaException\[XML parse error\]; nested: SAXParseException while parsing html](https://discuss.elastic.co/t/tikaexception-xml-parse-error-nested-saxparseexception-while-parsing-html/168943)
**Author:** [@Kalpana\_Doraisamy](https://discuss.elastic.co/u/Kalpana_Doraisamy)\ **Replies:** 1\ **Last updated:** [February 19, 2019, 7:00am UTC](https://discuss.elastic.co/t/tikaexception-xml-parse-error-nested-saxparseexception-while-parsing-html/168943 "2019-02-19T07:00:34Z")
Hi, I am getting the following exception when I try the PUT on kibana with ElasticSearch 6.6.0 with ingest-attachment-6.6.0 { "error": { "root\_cause": \[ { "type": "exception", "reason": "java.lang.IllegalArgument… --- ## [Query dsl for elastic](https://discuss.elastic.co/t/query-dsl-for-elastic/168945)
**Author:** [@examin](https://discuss.elastic.co/u/examin)\ **Replies:** 0\ **Last updated:** [February 19, 2019, 6:53am UTC](https://discuss.elastic.co/t/query-dsl-for-elastic/168945 "2019-02-19T06:53:17Z")
I have a field named status, who have values 1,2 or 3 . i need output count( when status = 1)/ count( when status =2) , Group by year. How can i do this using kibana or inside DeVtools of kibana . --- ## [How to connect Kibana to Elasticsearch when http ssl is enabled](https://discuss.elastic.co/t/how-to-connect-kibana-to-elasticsearch-when-http-ssl-is-enabled/167827)
**Author:** [@li\_jessen2016](https://discuss.elastic.co/u/li_jessen2016)\ **Replies:** 20\ **Last updated:** [February 19, 2019, 6:52am UTC](https://discuss.elastic.co/t/how-to-connect-kibana-to-elasticsearch-when-http-ssl-is-enabled/167827 "2019-02-19T06:52:21Z")
Hi, I have set "xpack.security.http.ssl.enabled: true" in elasticsearch.yml. Then I found that I can't connect Kibana to this elasticsearch node. So how to configure Kibana in such a case? --- ## [I need to get top hits of scripted metric aggregation. can anyone suggest me how to do that?](https://discuss.elastic.co/t/i-need-to-get-top-hits-of-scripted-metric-aggregation-can-anyone-suggest-me-how-to-do-that/168936)
**Author:** [@Nitin\_Kumar](https://discuss.elastic.co/u/Nitin_Kumar)\ **Replies:** 0\ **Last updated:** [February 19, 2019, 6:22am UTC](https://discuss.elastic.co/t/i-need-to-get-top-hits-of-scripted-metric-aggregation-can-anyone-suggest-me-how-to-do-that/168936 "2019-02-19T06:22:37Z")
here is my query { "size": 0, "query": { "nested": { "path": "items", "query": { "bool": { "must": \[ { "exists": { "field": "items" } } \] } } } }, "aggs": { "delayed\_m": { "scripted\_metric": { "init… --- ## [Split Processor:](https://discuss.elastic.co/t/split-processor/168773)
**Author:** [@Sharad\_Ananth](https://discuss.elastic.co/u/Sharad_Ananth)\ **Replies:** 2\ **Last updated:** [February 19, 2019, 5:02am UTC](https://discuss.elastic.co/t/split-processor/168773 "2019-02-19T05:02:59Z")
How do I split a field and put the split strings into multiple target fields using split processor in Elasticsearch ? For e.g, I have a logline https://live-integration-msp-edge.connectcdn.net/mm/dash/live/7047/LIVESER… --- ## [Painless script\_exception : ctx.\_source : null\_pointer\_exception](https://discuss.elastic.co/t/painless-script-exception-ctx-source-null-pointer-exception/168885)
**Author:** [@achile](https://discuss.elastic.co/u/achile)\ **Replies:** 3\ **Last updated:** [February 19, 2019, 4:33am UTC](https://discuss.elastic.co/t/painless-script-exception-ctx-source-null-pointer-exception/168885 "2019-02-19T04:33:07Z")
Hello, I am working with version elasticsearch 6.5.4, I added a new field to my existing index and I want to give it a value equal to the sum of some other fields. I used the following query in Kibana but it does not wo… --- ## [Time zone match issue](https://discuss.elastic.co/t/time-zone-match-issue/168916)
**Author:** [@ankit2122](https://discuss.elastic.co/u/ankit2122)\ **Replies:** 1\ **Last updated:** [February 19, 2019, 2:03am UTC](https://discuss.elastic.co/t/time-zone-match-issue/168916 "2019-02-19T02:03:30Z")
Hello Team, my log coming from multiple timezone but when we store on elastic show me multiple time zone is there any way to manage multiple time in sigle time zone --- ## [Updating object field using \_reindex API script not working](https://discuss.elastic.co/t/updating-object-field-using-reindex-api-script-not-working/167653)
**Author:** [@rahulkothanath](https://discuss.elastic.co/u/rahulkothanath)\ **Replies:** 2\ **Last updated:** [February 19, 2019, 1:17am UTC](https://discuss.elastic.co/t/updating-object-field-using-reindex-api-script-not-working/167653 "2019-02-19T01:17:48Z")
I am trying to reindex an index and trying to create new field from two object fields. I am not able to access the field value latitude and it is returning null. code below POST \_reindex { "source": { "index": "a… --- ## [Index freeze/unfreeze](https://discuss.elastic.co/t/index-freeze-unfreeze/168903)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 1\ **Last updated:** [February 18, 2019, 10:49pm UTC](https://discuss.elastic.co/t/index-freeze-unfreeze/168903 "2019-02-18T22:49:52Z")
How do you tell in the api if an index is frozen? Will freeze/unfreeze be added to curator? Thanks --- ## [Pipelines processor and xpack permissions order of evaluation](https://discuss.elastic.co/t/pipelines-processor-and-xpack-permissions-order-of-evaluation/168504)
**Author:** [@leandro](https://discuss.elastic.co/u/leandro)\ **Replies:** 3\ **Last updated:** [February 18, 2019, 10:17pm UTC](https://discuss.elastic.co/t/pipelines-processor-and-xpack-permissions-order-of-evaluation/168504 "2019-02-18T22:17:23Z")
Hi all, I have a pipeline on my cluster to process items from metricbeats. The pipeline is responsible to modify the index based on the original doc. PUT \_ingest/pipeline/metricbeat { "description": "Pipeline to in… --- ## [Google Analytics to Elastic](https://discuss.elastic.co/t/google-analytics-to-elastic/168896)
**Author:** [@Ragnar](https://discuss.elastic.co/u/Ragnar)\ **Replies:** 0\ **Last updated:** [February 18, 2019, 8:16pm UTC](https://discuss.elastic.co/t/google-analytics-to-elastic/168896 "2019-02-18T20:16:34Z")
I'm really surprised that I cannot find a clear answer about how to connect GA to Elastic to build my own dashboard. Cannot find a tutorial, only a Beat for the Real Time API from the community. I would think that I'm no… --- ## [CPU utilization crossing 98% always](https://discuss.elastic.co/t/cpu-utilization-crossing-98-always/168807)
**Author:** [@kamesh\_siva](https://discuss.elastic.co/u/kamesh_siva)\ **Replies:** 1\ **Last updated:** [February 18, 2019, 7:55pm UTC](https://discuss.elastic.co/t/cpu-utilization-crossing-98-always/168807 "2019-02-18T19:55:44Z")
Hi Team, Please suggest.. Observing high CPU utilization on cluster node on one server and queried for nodes hot thread, Below is the response received please help. Because of high CPU, By search is slowing down i mean… --- ## [Near Real Time Analytics With Elasticsearch.js](https://discuss.elastic.co/t/near-real-time-analytics-with-elasticsearch-js/168891)
**Author:** [@moreauap96](https://discuss.elastic.co/u/moreauap96)\ **Replies:** 0\ **Last updated:** [February 18, 2019, 7:30pm UTC](https://discuss.elastic.co/t/near-real-time-analytics-with-elasticsearch-js/168891 "2019-02-18T19:30:32Z")
Good afternoon, I am hoping to find a way to leverage elasticsearch.js (running in the browser) to pull records continuously to support a real time Analytics application I am developing. I can pull data but I was hitti… --- ## [Copy\_to create array of string](https://discuss.elastic.co/t/copy-to-create-array-of-string/168878)
**Author:** [@conradoramalho](https://discuss.elastic.co/u/conradoramalho)\ **Replies:** 0\ **Last updated:** [February 18, 2019, 4:58pm UTC](https://discuss.elastic.co/t/copy-to-create-array-of-string/168878 "2019-02-18T16:58:59Z")
I'm using the copy\_to in two fields: city\_name andneighborhood\_name for the full\_data field, so I need to use a match\_phrase\_prefix, but that does not work. I've set "store": true, in full\_data and I noticed that ful… --- ## [S3 snapshotting timed out requiring Elasticsearch process restart - 6.3.0](https://discuss.elastic.co/t/s3-snapshotting-timed-out-requiring-elasticsearch-process-restart-6-3-0/166205)
**Author:** [@Martin\_Brennan](https://discuss.elastic.co/u/Martin_Brennan)\ **Replies:** 5\ **Last updated:** [February 18, 2019, 4:22pm UTC](https://discuss.elastic.co/t/s3-snapshotting-timed-out-requiring-elasticsearch-process-restart-6-3-0/166205 "2019-02-18T16:22:36Z")
We ran into an issue where we were unable to read or write snapshots to s3. The error is listed below. We mitigated the issue by restarting the Elasticsearch process on the master node. On an independent cluster we also… --- ## [Adding a new nodes in my cluster](https://discuss.elastic.co/t/adding-a-new-nodes-in-my-cluster/168564)
**Author:** [@dihpierrick](https://discuss.elastic.co/u/dihpierrick)\ **Replies:** 8\ **Last updated:** [February 18, 2019, 4:18pm UTC](https://discuss.elastic.co/t/adding-a-new-nodes-in-my-cluster/168564 "2019-02-18T16:18:52Z")
Hello, I've allready look in the doc or in differents topics but can't find the exact answer of my question :disappointed\_relieved: So here is my question : I've an up and running cluster, in which I want to add a new… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1389) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1391)