# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1454 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1455 --- ## [Simple query on two fields with preference to one of them](https://discuss.elastic.co/t/simple-query-on-two-fields-with-preference-to-one-of-them/159235)
**Author:** [@Illidan](https://discuss.elastic.co/u/Illidan)\ **Replies:** 6\ **Last updated:** [December 13, 2018, 5:33am UTC](https://discuss.elastic.co/t/simple-query-on-two-fields-with-preference-to-one-of-them/159235 "2018-12-13T05:33:44Z")
I have a document with two fields; "title" and "description". When performing query, I want to give a significant preference to documents having search term in their "title", e.g. show all documents with term in "title"… --- ## [Storing pre-aggregated data](https://discuss.elastic.co/t/storing-pre-aggregated-data/160667)
**Author:** [@ben.zeghers](https://discuss.elastic.co/u/ben.zeghers)\ **Replies:** 0\ **Last updated:** [December 13, 2018, 4:55am UTC](https://discuss.elastic.co/t/storing-pre-aggregated-data/160667 "2018-12-13T04:55:00Z")
I have a data set that I'd like to add to Elasticsearch so that we can build visualizations with it in Kibana. The problem I am running into is that since the data is pre-aggregated average aggregations I do on this data… --- ## [X-pack for Es-Hadoop](https://discuss.elastic.co/t/x-pack-for-es-hadoop/160663)
**Author:** [@wxm\_imperio](https://discuss.elastic.co/u/wxm_imperio)\ **Replies:** 0\ **Last updated:** [December 13, 2018, 4:11am UTC](https://discuss.elastic.co/t/x-pack-for-es-hadoop/160663 "2018-12-13T04:11:25Z")
es version: 6.2.4 hadoop version: 2.6.0-cdh5.11.1 I want make a mapreduce with es use Es-Hadoop, however can not connect es cluster when I install X-pack for es. // mapreduce conf conf.setBoolean("mapred.map.tasks.spe… --- ## [Updating Elasticsearch in Docker](https://discuss.elastic.co/t/updating-elasticsearch-in-docker/160314)
**Author:** [@r00ting](https://discuss.elastic.co/u/r00ting)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 2:50am UTC](https://discuss.elastic.co/t/updating-elasticsearch-in-docker/160314 "2018-12-13T02:50:25Z")
Hi, Are there any indications for how to properly update Elasticsearch when using it in Docker? I set up a docker environment with named volumes and everything went fine but when using the newest image from Elasticsear… --- ## [What is Indexing Rate(/sec) signifies in ElasticSearch](https://discuss.elastic.co/t/what-is-indexing-rate-sec-signifies-in-elasticsearch/160526)
**Author:** [@Varun\_S](https://discuss.elastic.co/u/Varun_S)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 2:46am UTC](https://discuss.elastic.co/t/what-is-indexing-rate-sec-signifies-in-elasticsearch/160526 "2018-12-13T02:46:43Z")
What is Indexing Rate(/sec) signifies in ElasticSearch? Whether it is number of document that is getting Indexed. Here 1 Document refers to 1 record in the input file? --- ## [Anomoly detection from a medical equipment](https://discuss.elastic.co/t/anomoly-detection-from-a-medical-equipment/160636)
**Author:** [@Ratnadeep\_Saha](https://discuss.elastic.co/u/Ratnadeep_Saha)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 2:32am UTC](https://discuss.elastic.co/t/anomoly-detection-from-a-medical-equipment/160636 "2018-12-13T02:32:18Z")
Hi, I want to have an overview of how elastic stack can help to address below problem. I am having medical equipments in hospitals or pharmacy's at different location, now I want to get notified centrally at my back of… --- ## [Synonyms containing commas](https://discuss.elastic.co/t/synonyms-containing-commas/160504)
**Author:** [@mags107](https://discuss.elastic.co/u/mags107)\ **Replies:** 3\ **Last updated:** [December 13, 2018, 2:18am UTC](https://discuss.elastic.co/t/synonyms-containing-commas/160504 "2018-12-13T02:18:21Z")
When updating a synonym list via the API, not using a synonym text file. We have a synonym list that has values that contain commas causes a json parsing error if the normal escape sequence is used e.g. , Given that the… --- ## [Post-upgrade issues: 6.4.2 ES heap running away (6.5.0 too)](https://discuss.elastic.co/t/post-upgrade-issues-6-4-2-es-heap-running-away-6-5-0-too/151096)
**Author:** [@hollowimage](https://discuss.elastic.co/u/hollowimage)\ **Replies:** 41\ **Last updated:** [December 13, 2018, 2:11am UTC](https://discuss.elastic.co/t/post-upgrade-issues-6-4-2-es-heap-running-away-6-5-0-too/151096 "2018-12-13T02:11:59Z")
I have recently upgraded my cluster from 6.2.3 --\> 6.4.2 (all components: elasticsearch, logstash, kibana) Ever since then, we've been having issues with the heap space running out. I have trimmed down indices all over… --- ## [Definition for "skipped" in "\_shards" as query result](https://discuss.elastic.co/t/definition-for-skipped-in-shards-as-query-result/159841)
**Author:** [@junkoshimane](https://discuss.elastic.co/u/junkoshimane)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 1:54am UTC](https://discuss.elastic.co/t/definition-for-skipped-in-shards-as-query-result/159841 "2018-12-13T01:54:59Z")
Hi all, Regarding "skipped" in "\_shards" as query result, it is defined nowhere even in the following URL. https://www.elastic.co/guide/en/elasticsearch/reference/current/\_the\_search\_api.html { "took" : 5, "timed\_… --- ## [Xpack License uploading Error](https://discuss.elastic.co/t/xpack-license-uploading-error/158897)
**Author:** [@rijinmp](https://discuss.elastic.co/u/rijinmp)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 1:43am UTC](https://discuss.elastic.co/t/xpack-license-uploading-error/158897 "2018-12-13T01:43:12Z")
Hi All , When I am enabling x-pack license , showing this error. Error encountered uploading license: Cannot install a \[PLATINUM\] license unless TLS is configured or security is disabled I am enabled xpack security an… --- ## [Elasticsearch plugin](https://discuss.elastic.co/t/elasticsearch-plugin/160459)
**Author:** [@cecoke](https://discuss.elastic.co/u/cecoke)\ **Replies:** 2\ **Last updated:** [December 12, 2018, 10:00pm UTC](https://discuss.elastic.co/t/elasticsearch-plugin/160459 "2018-12-12T22:00:00Z")
Hi, I built a custom search plugin on Elasticsearch and it works totally fine on single node. But when I try to run it on a cluster of nodes, during search query time I got the following error from remote nodes. java.l… --- ## [Monitor YARN Application jobs](https://discuss.elastic.co/t/monitor-yarn-application-jobs/160443)
**Author:** [@amillion8](https://discuss.elastic.co/u/amillion8)\ **Replies:** 2\ **Last updated:** [December 12, 2018, 9:47pm UTC](https://discuss.elastic.co/t/monitor-yarn-application-jobs/160443 "2018-12-12T21:47:42Z")
Has anyone done YARN application jobs monitoring with Elastic? If so, how did you do that? Thanks, Alex --- ## [Copying stopwords.txt to Elasticsearch could server](https://discuss.elastic.co/t/copying-stopwords-txt-to-elasticsearch-could-server/160609)
**Author:** [@Hooman\_Bahreini](https://discuss.elastic.co/u/Hooman_Bahreini)\ **Replies:** 0\ **Last updated:** [December 12, 2018, 7:13pm UTC](https://discuss.elastic.co/t/copying-stopwords-txt-to-elasticsearch-could-server/160609 "2018-12-12T19:13:45Z")
I have deployed my Elasticsearch server to the cloud, cloud.elastic.co How can I copy my stop\_words.txt, to the config folder on the cloud server? I have seen this document, which explains stop\_words.txt file should … --- ## [Regex Query to extract a number](https://discuss.elastic.co/t/regex-query-to-extract-a-number/160617)
**Author:** [@Arnav\_Bose](https://discuss.elastic.co/u/Arnav_Bose)\ **Replies:** 2\ **Last updated:** [December 12, 2018, 9:20pm UTC](https://discuss.elastic.co/t/regex-query-to-extract-a-number/160617 "2018-12-12T21:20:53Z")
I am new to ES. I have a log message coming and I want to extract some field: {"msg":"Certificate is going to expire in 1088 Regenerate the same","days\_left":1088} I would like to check if the date is less than 60. Is … --- ## [How to improve performance of scan method?](https://discuss.elastic.co/t/how-to-improve-performance-of-scan-method/159425)
**Author:** [@Samvid\_Kulkarni](https://discuss.elastic.co/u/Samvid_Kulkarni)\ **Replies:** 2\ **Last updated:** [December 12, 2018, 9:19pm UTC](https://discuss.elastic.co/t/how-to-improve-performance-of-scan-method/159425 "2018-12-12T21:19:41Z")
I am trying to get data from elasticsearch using elasticsearch-dsl python library. I need to get all the data for last 15 min. Issue is retrieving data is extremely slow. It takes lot of time for 2.2 million hits. Here i… --- ## [Ingestion attachment processor plugin](https://discuss.elastic.co/t/ingestion-attachment-processor-plugin/160585)
**Author:** [@Zamir\_Arif](https://discuss.elastic.co/u/Zamir_Arif)\ **Replies:** 3\ **Last updated:** [December 12, 2018, 9:16pm UTC](https://discuss.elastic.co/t/ingestion-attachment-processor-plugin/160585 "2018-12-12T21:16:21Z")
I have been spending sometime with Elastic search Ingest Attachment Processor Plugin. Here is my data volume : Approximately 100000 xmls Approximately 100000 other docs like word PDF and other Tika supported format. W… --- ## [Elasticsearch SQL and Spark RDD/SQL](https://discuss.elastic.co/t/elasticsearch-sql-and-spark-rdd-sql/158387)
**Author:** [@xzhou](https://discuss.elastic.co/u/xzhou)\ **Replies:** 2\ **Last updated:** [December 12, 2018, 8:58pm UTC](https://discuss.elastic.co/t/elasticsearch-sql-and-spark-rdd-sql/158387 "2018-12-12T20:58:46Z")
Hi, Since Elasticsearch supports SQL (JDBC) interface in v6.5, could Spark (RDD or SQL) read data via JDBC? if it is feasible, how to deal with security on both sides (Elasticsearch, Spark job)? the env is currently c… --- ## [Elasticsearch-hadoop and index.max\_result\_window](https://discuss.elastic.co/t/elasticsearch-hadoop-and-index-max-result-window/158653)
**Author:** [@xzhou](https://discuss.elastic.co/u/xzhou)\ **Replies:** 2\ **Last updated:** [December 12, 2018, 8:49pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-index-max-result-window/158653 "2018-12-12T20:49:57Z")
Hi All, I think elasticsearch-hadoop uses REST API to retrieve data. does "index.max\_result\_window", which is 10k by default, take effect in batch job mode? my spark job needs to retrieve and analyze all data in this ca… --- ## [Support for HDFS 3.1.1 and Hive 3.1](https://discuss.elastic.co/t/support-for-hdfs-3-1-1-and-hive-3-1/159198)
**Author:** [@Muj33b](https://discuss.elastic.co/u/Muj33b)\ **Replies:** 1\ **Last updated:** [December 12, 2018, 8:01pm UTC](https://discuss.elastic.co/t/support-for-hdfs-3-1-1-and-hive-3-1/159198 "2018-12-12T20:01:22Z")
Hi, Which Es-Hadoop connector supports Hdfs 3.1.1 and Hive 3.1? I tried with 6.1.1 and getting problem with timestamp types. Thanks M --- ## [Pyspark - read data from elasticsearch cluster on EMR](https://discuss.elastic.co/t/pyspark-read-data-from-elasticsearch-cluster-on-emr/158454)
**Author:** [@ruxiz](https://discuss.elastic.co/u/ruxiz)\ **Replies:** 3\ **Last updated:** [December 12, 2018, 7:48pm UTC](https://discuss.elastic.co/t/pyspark-read-data-from-elasticsearch-cluster-on-emr/158454 "2018-12-12T19:48:27Z")
I am trying to read data from elasticsearch from pyspark. I was using the elasticsearch-hadoop api in Spark. The es cluster sits on aws emr, which requires credential to sign in. My script is as below: from pyspark im… --- ## [Cannot handle type TimestampWritableV2 Exception when creating index with ES Hadoop connector](https://discuss.elastic.co/t/cannot-handle-type-timestampwritablev2-exception-when-creating-index-with-es-hadoop-connector/158220)
**Author:** [@Muj33b](https://discuss.elastic.co/u/Muj33b)\ **Replies:** 1\ **Last updated:** [December 12, 2018, 7:42pm UTC](https://discuss.elastic.co/t/cannot-handle-type-timestampwritablev2-exception-when-creating-index-with-es-hadoop-connector/158220 "2018-12-12T19:42:21Z")
I am using 6.2.2 and getting the following exception when trying to create an index from Hive table with ES Hadoop connector I am using elasticsearch-hadoop-6.2.4.jar I can't What is the work around? ERROR : FAILED: E… --- ## [How to make 2 Code Points unicode as single word](https://discuss.elastic.co/t/how-to-make-2-code-points-unicode-as-single-word/160600)
**Author:** [@kasiselvamk](https://discuss.elastic.co/u/kasiselvamk)\ **Replies:** 0\ **Last updated:** [December 12, 2018, 6:27pm UTC](https://discuss.elastic.co/t/how-to-make-2-code-points-unicode-as-single-word/160600 "2018-12-12T18:27:42Z")
There are languages, which uses multiple Code Points unicode to represent a single character. how to index such case. https://unicode.org/cldr/utility/list-unicodeset.jsp?a=ல்&g=&i= --- ## [What is the best way to insert/update billion data to ES from API?](https://discuss.elastic.co/t/what-is-the-best-way-to-insert-update-billion-data-to-es-from-api/159740)
**Author:** [@inandi](https://discuss.elastic.co/u/inandi)\ **Replies:** 4\ **Last updated:** [December 12, 2018, 5:22pm UTC](https://discuss.elastic.co/t/what-is-the-best-way-to-insert-update-billion-data-to-es-from-api/159740 "2018-12-12T17:22:00Z")
I am getting millions of data from Google API, Now I want to store it in ES. I know the technique to save data to ES using Logsatsh from JSON file. So should I create a JSON file and then try to save it. Or there is a be… --- ## [Kibana is not opening in my browser](https://discuss.elastic.co/t/kibana-is-not-opening-in-my-browser/160531)
**Author:** [@Paviganesh](https://discuss.elastic.co/u/Paviganesh)\ **Replies:** 3\ **Last updated:** [December 12, 2018, 5:13pm UTC](https://discuss.elastic.co/t/kibana-is-not-opening-in-my-browser/160531 "2018-12-12T17:13:28Z")
Hi team, Can you please help me fix this issue. I had created an EC2 instance in AWS. Installed ELK in Ubuntu 16.04. Configured kibana.yml with localhost and private. Both things not working while I open the browser wit… --- ## [Getting geohash / geoip data from apache](https://discuss.elastic.co/t/getting-geohash-geoip-data-from-apache/160455)
**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\ **Replies:** 13\ **Last updated:** [December 12, 2018, 4:52pm UTC](https://discuss.elastic.co/t/getting-geohash-geoip-data-from-apache/160455 "2018-12-12T16:52:47Z")
Im mining apache2 logs using filebeat. Data is being put into indices 'apache2-' via logstash. If I look at the data using the 'discover' function I can see 'geoip.location.lat/lon' and 'location.lat/lon' but attempts t… --- ## [ES taking long time to refresh](https://discuss.elastic.co/t/es-taking-long-time-to-refresh/160581)
**Author:** [@Yogesh\_BG](https://discuss.elastic.co/u/Yogesh_BG)\ **Replies:** 1\ **Last updated:** [December 12, 2018, 4:41pm UTC](https://discuss.elastic.co/t/es-taking-long-time-to-refresh/160581 "2018-12-12T16:41:52Z")
Hi I am using ES 2.4 I have two nodes one master and one data node. Pumping the traffic heavily. each record is of size 1.6kb and around 6000 such records per sec. After some time when we retrieve the docs it gives old… --- ## [Snapshot restore failure](https://discuss.elastic.co/t/snapshot-restore-failure/160542)
**Author:** [@nuwancs](https://discuss.elastic.co/u/nuwancs)\ **Replies:** 1\ **Last updated:** [December 12, 2018, 4:16pm UTC](https://discuss.elastic.co/t/snapshot-restore-failure/160542 "2018-12-12T16:16:30Z")
Hi Team, I am trying to create and restore snapshots to make a huge data set for my testing purposes. Initially, I created few snapshots and restored them successfully. But suddenly I can't restore newly created indices… --- ## [Facing Issue in converting geoip.location to geo\_point datatype](https://discuss.elastic.co/t/facing-issue-in-converting-geoip-location-to-geo-point-datatype/160404)
**Author:** [@Rakesh\_Thangapandian](https://discuss.elastic.co/u/Rakesh_Thangapandian)\ **Replies:** 3\ **Last updated:** [December 12, 2018, 4:13pm UTC](https://discuss.elastic.co/t/facing-issue-in-converting-geoip-location-to-geo-point-datatype/160404 "2018-12-12T16:13:51Z")
Hi Community Members, I have tried to generate the visualization using coordinate maps in kibana from nginx server logs which is streamed in elasticsearch storage, since i failed in type casting geo\_point datatype prope… --- ## [Rename Field in Index (index, visu, dashboard, etc...)](https://discuss.elastic.co/t/rename-field-in-index-index-visu-dashboard-etc/159881)
**Author:** [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\ **Replies:** 10\ **Last updated:** [December 12, 2018, 4:04pm UTC](https://discuss.elastic.co/t/rename-field-in-index-index-visu-dashboard-etc/159881 "2018-12-12T16:04:38Z")
Hi all, Thanks in advance for the help! I want to rename a field in an index 'everywhere'. By everywhere, I mean that I don't want my graphs and dashboard based on this field to be impacted, I don't know if there is a… --- ## [Extend Elasticsearch Authorization mechanism to existing instances](https://discuss.elastic.co/t/extend-elasticsearch-authorization-mechanism-to-existing-instances/159205)
**Author:** [@Uiidoi12](https://discuss.elastic.co/u/Uiidoi12)\ **Replies:** 8\ **Last updated:** [December 12, 2018, 2:33pm UTC](https://discuss.elastic.co/t/extend-elasticsearch-authorization-mechanism-to-existing-instances/159205 "2018-12-12T14:33:38Z")
Hi, I have a situation where there are existing Elasticsearch instances that uses X-Pack security and need to extend Authorization mechanism in order to change the default behaviour and contact an external service to ob… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1453) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1455)