# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1588 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1589 --- ## [Logstash dns filter and indexing IP input as "ip" type in Elasticsearch](https://discuss.elastic.co/t/logstash-dns-filter-and-indexing-ip-input-as-ip-type-in-elasticsearch/143448)
**Author:** [@dss](https://discuss.elastic.co/u/dss)\ **Replies:** 0\ **Last updated:** [August 8, 2018, 7:59am UTC](https://discuss.elastic.co/t/logstash-dns-filter-and-indexing-ip-input-as-ip-type-in-elasticsearch/143448 "2018-08-08T07:59:09Z")
Greetings, Elastic Stack 6.3.2 I have IP addresses in fields in my data for which I wish to set mappings to index as ip type. For some of those fields, I also enrich the IP address in the document to a reverse DNS name… --- ## [Problem with creating mapping template](https://discuss.elastic.co/t/problem-with-creating-mapping-template/143274)
**Author:** [@Loudone](https://discuss.elastic.co/u/Loudone)\ **Replies:** 6\ **Last updated:** [August 8, 2018, 7:21am UTC](https://discuss.elastic.co/t/problem-with-creating-mapping-template/143274 "2018-08-08T07:21:01Z")
Dear All, I'm trying to create a mapping template like below: PUT \_template/documentum { "index\_patterns":"docu\_\*", "version": 1, "settings": { "index.refresh\_interval" : "5s" }, "mapping": { "doc": { "prop… --- ## [Delete from ..having count(..) \> 1](https://discuss.elastic.co/t/delete-from-having-count-1/143439)
**Author:** [@Anton\_Garakh](https://discuss.elastic.co/u/Anton_Garakh)\ **Replies:** 0\ **Last updated:** [August 8, 2018, 7:17am UTC](https://discuss.elastic.co/t/delete-from-having-count-1/143439 "2018-08-08T07:17:18Z")
Is there any way to perform request like this in ElasticSearch? DELETE FROM ..HAVING COUNT(..) \> 1 --- ## [ES 6.2.3 cluster with Spark 2.3.0 fails with "pipeline with id \[x\] does not exist"](https://discuss.elastic.co/t/es-6-2-3-cluster-with-spark-2-3-0-fails-with-pipeline-with-id-x-does-not-exist/143435)
**Author:** [@kodo65](https://discuss.elastic.co/u/kodo65)\ **Replies:** 0\ **Last updated:** [August 8, 2018, 6:56am UTC](https://discuss.elastic.co/t/es-6-2-3-cluster-with-spark-2-3-0-fails-with-pipeline-with-id-x-does-not-exist/143435 "2018-08-08T06:56:03Z")
Hi! I have a 6 node cluster (ES 6.2.3) with a very basic ingestion pipeline. When issuing a ...saveToEs("...", Map("es.mapping.id"-\>"...", "es.nodes"-\>"...", "es.ingest.pipeline"-\>"parse\_event")) some of the Spark-exe… --- ## [Log size issue](https://discuss.elastic.co/t/log-size-issue/143420)
**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\ **Replies:** 3\ **Last updated:** [August 8, 2018, 6:42am UTC](https://discuss.elastic.co/t/log-size-issue/143420 "2018-08-08T06:42:14Z")
Hello All, I am using ELK stack. I am parsing my logs using Logstash then forward to elasticsearch after that on Kibana dashboard. My total log file size of 24 Hour is 3 GB at backend. But when i am checking at elastic… --- ## [Getting data from Elastic Search in CSV To S3](https://discuss.elastic.co/t/getting-data-from-elastic-search-in-csv-to-s3/143425)
**Author:** [@DILIP\_SHARMA](https://discuss.elastic.co/u/DILIP_SHARMA)\ **Replies:** 1\ **Last updated:** [August 8, 2018, 6:24am UTC](https://discuss.elastic.co/t/getting-data-from-elastic-search-in-csv-to-s3/143425 "2018-08-08T06:24:02Z")
Hi I am using logstash to load data from S3 to Elastic search for multiple index based on file name , this is more of real time data can say every 5 minute . Question - How can i get data from ES server in CSV format … --- ## [Payload Scoring in ElasticSearch](https://discuss.elastic.co/t/payload-scoring-in-elasticsearch/143431)
**Author:** [@saurzcode](https://discuss.elastic.co/u/saurzcode)\ **Replies:** 0\ **Last updated:** [August 8, 2018, 6:19am UTC](https://discuss.elastic.co/t/payload-scoring-in-elasticsearch/143431 "2018-08-08T06:19:24Z")
Solr has specific feature to allow scoring based on payload - {!payload\_score f=payload\_field func=sum operator=or}A B C https://lucene.apache.org/solr/guide/7\_1/other-parsers.html#payload-score-parser Is there any si… --- ## [GC leader to timeout pings](https://discuss.elastic.co/t/gc-leader-to-timeout-pings/143159)
**Author:** [@LinPower](https://discuss.elastic.co/u/LinPower)\ **Replies:** 4\ **Last updated:** [August 8, 2018, 4:14am UTC](https://discuss.elastic.co/t/gc-leader-to-timeout-pings/143159 "2018-08-08T04:14:45Z")
\[2018-08-06T16:26:24,830\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[...\] \[gc\]\[866954\] overhead, spent \[292ms\] collecting in the last \[1s\] \[2018-08-06T16:26:27,831\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[...\] \[gc\]\[866957\] overhe… --- ## [ElasticSearch NEST Search query not working](https://discuss.elastic.co/t/elasticsearch-nest-search-query-not-working/143415)
**Author:** [@jainsachin99](https://discuss.elastic.co/u/jainsachin99)\ **Replies:** 1\ **Last updated:** [August 8, 2018, 4:09am UTC](https://discuss.elastic.co/t/elasticsearch-nest-search-query-not-working/143415 "2018-08-08T04:09:04Z")
New to ElasticSearch, having below setup ElasticSearch Server version -- 6.3.2 NEST Version -- 6.2.0 Executing Simple Search var response = client.Search(s =\> s .From(0).Size(20) .Index("idx\_name") .TypedKeys(null) ); … --- ## [Forwarding logs without changing source info](https://discuss.elastic.co/t/forwarding-logs-without-changing-source-info/143416)
**Author:** [@Luke\_Devon](https://discuss.elastic.co/u/Luke_Devon)\ **Replies:** 0\ **Last updated:** [August 8, 2018, 2:34am UTC](https://discuss.elastic.co/t/forwarding-logs-without-changing-source-info/143416 "2018-08-08T02:34:06Z")
Hi, I have few linux nodes which are generating thier own application logs. Log types are more likely to apache/tomcat but quite customized. How can I input such application logs to elasticsearch? I want send tho… --- ## [The progress of execution changed from high to low in the search operation](https://discuss.elastic.co/t/the-progress-of-execution-changed-from-high-to-low-in-the-search-operation/143281)
**Author:** [@rui\_dong](https://discuss.elastic.co/u/rui_dong)\ **Replies:** 1\ **Last updated:** [August 7, 2018, 9:21am UTC](https://discuss.elastic.co/t/the-progress-of-execution-changed-from-high-to-low-in-the-search-operation/143281 "2018-08-07T09:21:39Z")
I'm going to test the search performance of an index "schedule": \[ { "operation": { "name":"N clients randomly query 10,000 data", "operation-type": "search", "param-source": "randomly-query" }, "warmup-iter… --- ## [Simplest upgrade data from ElasticSearch 2 to ElasticSearch 6?](https://discuss.elastic.co/t/simplest-upgrade-data-from-elasticsearch-2-to-elasticsearch-6/143298)
**Author:** [@ujjain](https://discuss.elastic.co/u/ujjain)\ **Replies:** 3\ **Last updated:** [August 8, 2018, 12:27am UTC](https://discuss.elastic.co/t/simplest-upgrade-data-from-elasticsearch-2-to-elasticsearch-6/143298 "2018-08-08T00:27:24Z")
We're looking to migrate our clusters with ElasticSearch 2.x to the latest version. What is the simplest way to do this? I already wrote a deploy script for deploying the ELK 2 stack and the ELK 6 stack. Unfortunately E… --- ## [Find docs near geoshape?](https://discuss.elastic.co/t/find-docs-near-geoshape/143395)
**Author:** [@whiteminis](https://discuss.elastic.co/u/whiteminis)\ **Replies:** 0\ **Last updated:** [August 7, 2018, 8:00pm UTC](https://discuss.elastic.co/t/find-docs-near-geoshape/143395 "2018-08-07T20:00:35Z")
I am currently using ES 6.2. Is there a way to find all the docs near indexed geo-shape? I know I can use geo-distance for points, but I have MultiPolygon, Polygon and LineString and I only see the options like within … --- ## [Context Completion Suggestor Issue using Nest in c#?](https://discuss.elastic.co/t/context-completion-suggestor-issue-using-nest-in-c/143171)
**Author:** [@kartheek91](https://discuss.elastic.co/u/kartheek91)\ **Replies:** 1\ **Last updated:** [August 7, 2018, 11:23pm UTC](https://discuss.elastic.co/t/context-completion-suggestor-issue-using-nest-in-c/143171 "2018-08-07T23:23:32Z")
Hi All... I'm facing issue with context based compeltion suggestor.Query is successful and the count is returning zero. This is my audit trail and here is the query var searchResponse = await highlevelclient.Searc… --- ## [Integer cannot be casted to Long](https://discuss.elastic.co/t/integer-cannot-be-casted-to-long/143409)
**Author:** [@almanzarjulian](https://discuss.elastic.co/u/almanzarjulian)\ **Replies:** 0\ **Last updated:** [August 7, 2018, 10:55pm UTC](https://discuss.elastic.co/t/integer-cannot-be-casted-to-long/143409 "2018-08-07T22:55:58Z")
Good afternoon, I'm testing a pipeline and i keep recieving this error: { "error": { "root\_cause": \[ { "type": "class\_cast\_exception", "reason": "java.lang.Integer cannot be cast to java.lang.Long" } \], "type":… --- ## [Painless scripting params.entrySet()?](https://discuss.elastic.co/t/painless-scripting-params-entryset/143306)
**Author:** [@panthersquirrel](https://discuss.elastic.co/u/panthersquirrel)\ **Replies:** 2\ **Last updated:** [August 7, 2018, 10:02pm UTC](https://discuss.elastic.co/t/painless-scripting-params-entryset/143306 "2018-08-07T22:02:46Z")
If I have a document like this: POST random/\_doc/1 { "id": 1 } and i want to do: POST random/\_doc/1/\_update { "script": { "source": " for (entry in params.entrySet()) { ctx.\_source\[entry.getKey… --- ## [Incorrect mapping assigned in Elasticsearch](https://discuss.elastic.co/t/incorrect-mapping-assigned-in-elasticsearch/143403)
**Author:** [@cchulo](https://discuss.elastic.co/u/cchulo)\ **Replies:** 0\ **Last updated:** [August 7, 2018, 9:55pm UTC](https://discuss.elastic.co/t/incorrect-mapping-assigned-in-elasticsearch/143403 "2018-08-07T21:55:07Z")
I am using Elasticsearch, Filebeat, and Logstash 6.3.2 I have a field in the files i'm attempting to index into ES called 'MEAS' and it is of type Double. Here is an example of one of my JSON files, let's call it File\_… --- ## [Loading data into Elasticsearch - the best way to do it](https://discuss.elastic.co/t/loading-data-into-elasticsearch-the-best-way-to-do-it/143401)
**Author:** [@Roman\_G](https://discuss.elastic.co/u/Roman_G)\ **Replies:** 0\ **Last updated:** [August 7, 2018, 9:19pm UTC](https://discuss.elastic.co/t/loading-data-into-elasticsearch-the-best-way-to-do-it/143401 "2018-08-07T21:19:39Z")
I have relatively big sets of documents that we load into elasticsearch via java rest client. Every day we do a batch load of data (basically our full data set) at midnight and then through the day we load delta files wh… --- ## [Elasticsearch does not take "index.max\_result\_window" in elasticsearch.yml](https://discuss.elastic.co/t/elasticsearch-does-not-take-index-max-result-window-in-elasticsearch-yml/143399)
**Author:** [@jxz](https://discuss.elastic.co/u/jxz)\ **Replies:** 1\ **Last updated:** [August 7, 2018, 8:42pm UTC](https://discuss.elastic.co/t/elasticsearch-does-not-take-index-max-result-window-in-elasticsearch-yml/143399 "2018-08-07T20:42:24Z")
Hi, I want to set the max scroll size explicitly through the index.max\_result\_window setting for me to experiment with the different scroll sizes. I tried to add a line (such as "index.max\_result\_window: 10000") to the … --- ## [Searching inner hits in ES datastore](https://discuss.elastic.co/t/searching-inner-hits-in-es-datastore/142665)
**Author:** [@Parul-Kudtarkar](https://discuss.elastic.co/u/Parul-Kudtarkar)\ **Replies:** 6\ **Last updated:** [August 7, 2018, 7:19pm UTC](https://discuss.elastic.co/t/searching-inner-hits-in-es-datastore/142665 "2018-08-07T19:19:43Z")
Hi ES community, Searching and retrieving inner hits (https://www.elastic.co/guide/en/elasticsearch/reference/current/search-request-inner-hits.html) is extremely slow! Any tips to expedite the search? Thanks! Parul --- ## [Elasticsearch Heap Size check](https://discuss.elastic.co/t/elasticsearch-heap-size-check/143377)
**Author:** [@motts](https://discuss.elastic.co/u/motts)\ **Replies:** 0\ **Last updated:** [August 7, 2018, 5:54pm UTC](https://discuss.elastic.co/t/elasticsearch-heap-size-check/143377 "2018-08-07T17:54:21Z")
I am running Centos 6.9 with elasticsearch 2.4. I have my heap size set in /etc/sysconfig/elasticsearch set to ES\_HEAP\_SIZE=31g, but when I type jps -l -m -v I get this output 381 sun.tools.jps.Jps -l -m -v -Dapplicatio… --- ## [Searching for non English text](https://discuss.elastic.co/t/searching-for-non-english-text/143349)
**Author:** [@muthucse](https://discuss.elastic.co/u/muthucse)\ **Replies:** 2\ **Last updated:** [August 7, 2018, 5:46pm UTC](https://discuss.elastic.co/t/searching-for-non-english-text/143349 "2018-08-07T17:46:18Z")
Designed and implemented full text search, proximity search, match, match phrase, MLT, wildcard for english language. Now i am trying to identify what all the features will be missed when we have other languages like fr… --- ## [Impact of deletion on rewriting data](https://discuss.elastic.co/t/impact-of-deletion-on-rewriting-data/143015)
**Author:** [@sambodhi](https://discuss.elastic.co/u/sambodhi)\ **Replies:** 11\ **Last updated:** [August 7, 2018, 5:07pm UTC](https://discuss.elastic.co/t/impact-of-deletion-on-rewriting-data/143015 "2018-08-07T17:07:27Z")
I am ingesting 40 GB data at a time after deleting the previous data for the same period. I have to delete before since new version might be missing some rows. Since update wouldn't remove he unwanted rows, am deleting b… --- ## [What's the best way to define both geo shape and geo point dynamic mapping](https://discuss.elastic.co/t/whats-the-best-way-to-define-both-geo-shape-and-geo-point-dynamic-mapping/143210)
**Author:** [@mikesparr](https://discuss.elastic.co/u/mikesparr)\ **Replies:** 0\ **Last updated:** [August 6, 2018, 7:19pm UTC](https://discuss.elastic.co/t/whats-the-best-way-to-define-both-geo-shape-and-geo-point-dynamic-mapping/143210 "2018-08-06T19:19:05Z")
Using dynamic templates, I have a "locations" mapping for "location" field with mapping type "geo\_point". Some visualizations need this field to be a "geo\_shape", however. I would like to extend the mapping similar to ho… --- ## [Trying to set up TLS on Elastic CLuster](https://discuss.elastic.co/t/trying-to-set-up-tls-on-elastic-cluster/143323)
**Author:** [@bigdamhero](https://discuss.elastic.co/u/bigdamhero)\ **Replies:** 6\ **Last updated:** [August 7, 2018, 4:47pm UTC](https://discuss.elastic.co/t/trying-to-set-up-tls-on-elastic-cluster/143323 "2018-08-07T16:47:13Z")
I'm getting an error in the java log. Caused by: java.security.AccessControlException: access denied ("java.io.FilePermission" "/usr/share/elasticsearch/config/certs/elastic-node-tls-ca.p12" "read") Checking the permis… --- ## [Best practice to paginate full text search queries](https://discuss.elastic.co/t/best-practice-to-paginate-full-text-search-queries/143213)
**Author:** [@porunov](https://discuss.elastic.co/u/porunov)\ **Replies:** 1\ **Last updated:** [August 7, 2018, 3:42pm UTC](https://discuss.elastic.co/t/best-practice-to-paginate-full-text-search-queries/143213 "2018-08-07T15:42:35Z")
Hello, I would like to know what are best practices (what to use) for full text search pagination. I.e. sorting by relevance. As I understand it is impossible to use search\_after parameter to paginate results based on … --- ## [Curator not running](https://discuss.elastic.co/t/curator-not-running/143338)
**Author:** [@AndyT](https://discuss.elastic.co/u/AndyT)\ **Replies:** 2\ **Last updated:** [August 7, 2018, 2:28pm UTC](https://discuss.elastic.co/t/curator-not-running/143338 "2018-08-07T14:28:39Z")
Hi, Trying to setup some curator jobs to delete data that's over a year old. Have curator installed via YUM. Have the following in my curator.yml client: hosts: - 127.0.0.1 port: 9200 url\_prefix: use\_ssl: … --- ## [After performing "Rolling Upgrade" from 6.0 to 6.3.1 Elasticsearch has stopped working](https://discuss.elastic.co/t/after-performing-rolling-upgrade-from-6-0-to-6-3-1-elasticsearch-has-stopped-working/143345)
**Author:** [@Reena\_Deberry](https://discuss.elastic.co/u/Reena_Deberry)\ **Replies:** 2\ **Last updated:** [August 7, 2018, 2:23pm UTC](https://discuss.elastic.co/t/after-performing-rolling-upgrade-from-6-0-to-6-3-1-elasticsearch-has-stopped-working/143345 "2018-08-07T14:23:52Z")
Rolling upgrade did not work as documented, I have 1 node, elastic log shows this warning below. Any other info needed pls let me know. We are sort of stuck right now and i'm so new to this that i'm not sure how to proc… --- ## [Mustache template to access timestamp field](https://discuss.elastic.co/t/mustache-template-to-access-timestamp-field/143195)
**Author:** [@Micah\_Hunsberger](https://discuss.elastic.co/u/Micah_Hunsberger)\ **Replies:** 7\ **Last updated:** [August 7, 2018, 1:42pm UTC](https://discuss.elastic.co/t/mustache-template-to-access-timestamp-field/143195 "2018-08-07T13:42:39Z")
I want to create a watch that generates an action for a certain event, but I want to format the output using a mustache template. In the output I want to be able to say when each event happened, e.g. {{#ctx.payload.hit… --- ## [Why These are Disabled?](https://discuss.elastic.co/t/why-these-are-disabled/141604)
**Author:** [@addanuj](https://discuss.elastic.co/u/addanuj)\ **Replies:** 2\ **Last updated:** [August 7, 2018, 1:42pm UTC](https://discuss.elastic.co/t/why-these-are-disabled/141604 "2018-08-07T13:42:03Z")
Hi All, I am trying to create a multimetric job, but not able to to use any of my fields not even in the single metric job? Please let me know what is the reason? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1587) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1589)