# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1453 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1454 --- ## [Connect to remote elasticsearch cluster](https://discuss.elastic.co/t/connect-to-remote-elasticsearch-cluster/160753)
**Author:** [@ichiban88](https://discuss.elastic.co/u/ichiban88)\ **Replies:** 7\ **Last updated:** [December 13, 2018, 10:29pm UTC](https://discuss.elastic.co/t/connect-to-remote-elasticsearch-cluster/160753 "2018-12-13T22:29:55Z")
I have an elasticsearch cluster running on an EC2 server. I get a variety of different error mesages when I try to connect. Currently, in the elasticsearch.yml file all the transport items are commented out but I have t… --- ## [Ingest-Attachement: How get (or store) properties without getting (storing) source document content](https://discuss.elastic.co/t/ingest-attachement-how-get-or-store-properties-without-getting-storing-source-document-content/160796)
**Author:** [@Francillo](https://discuss.elastic.co/u/Francillo)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 10:09pm UTC](https://discuss.elastic.co/t/ingest-attachement-how-get-or-store-properties-without-getting-storing-source-document-content/160796 "2018-12-13T22:09:08Z")
Hi, I have to store documents using ingest-attachement. This works, and I have need some properties (file meta data such as date, filename, and so on ...). But I when I run a search query, I don't want the content of … --- ## [Large Capacity Sizing: Single Cluster vs Multiple Clusters, Index Sizing, Memory Problems](https://discuss.elastic.co/t/large-capacity-sizing-single-cluster-vs-multiple-clusters-index-sizing-memory-problems/160812)
**Author:** [@thehybridtech](https://discuss.elastic.co/u/thehybridtech)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 9:42pm UTC](https://discuss.elastic.co/t/large-capacity-sizing-single-cluster-vs-multiple-clusters-index-sizing-memory-problems/160812 "2018-12-13T21:42:31Z")
Hiya all... Some quick scaling questions to get best practices. We deal with a very large pipeline of events every second and doing another round of evaluation now that we have moved to ES6. I will share our current s… --- ## [Match phrase prefix in set of documents](https://discuss.elastic.co/t/match-phrase-prefix-in-set-of-documents/160570)
**Author:** [@Ozymandy](https://discuss.elastic.co/u/Ozymandy)\ **Replies:** 4\ **Last updated:** [December 13, 2018, 9:34pm UTC](https://discuss.elastic.co/t/match-phrase-prefix-in-set-of-documents/160570 "2018-12-13T21:34:17Z")
Hi all, I am using multi match phrase\_prefix for matching my documents. And it works fine when I need to extract matched documents by whole index. But it does not work properly for case when I need to query by prefix in… --- ## [How do I refer to parent document's fields from within a Filter aggregation's Query clause](https://discuss.elastic.co/t/how-do-i-refer-to-parent-documents-fields-from-within-a-filter-aggregations-query-clause/160809)
**Author:** [@Derya](https://discuss.elastic.co/u/Derya)\ **Replies:** 0\ **Last updated:** [December 13, 2018, 8:17pm UTC](https://discuss.elastic.co/t/how-do-i-refer-to-parent-documents-fields-from-within-a-filter-aggregations-query-clause/160809 "2018-12-13T20:17:53Z")
Hello all. I opened a feature request for a reverse\_nested filter yesterday but as I thought about it more I feel like there should be a way to do this particular thing I want already. I have a filter aggregation that's … --- ## [Discovery-ec2 plugin always tries to ping localhost / never finds the nodes that it should](https://discuss.elastic.co/t/discovery-ec2-plugin-always-tries-to-ping-localhost-never-finds-the-nodes-that-it-should/160433)
**Author:** [@a.sapien](https://discuss.elastic.co/u/a.sapien)\ **Replies:** 10\ **Last updated:** [December 13, 2018, 8:02pm UTC](https://discuss.elastic.co/t/discovery-ec2-plugin-always-tries-to-ping-localhost-never-finds-the-nodes-that-it-should/160433 "2018-12-13T20:02:02Z")
Hi there. I am new to elastic-search, but not new to systems administration. Apologies if i did miss something glaringly obvious. I am trying to build an ES cluster in AWS. I am hoping to use the discovery-ec2 plugin t… --- ## [Extract key phrases for given sentence from elastic search](https://discuss.elastic.co/t/extract-key-phrases-for-given-sentence-from-elastic-search/160795)
**Author:** [@vnykrk](https://discuss.elastic.co/u/vnykrk)\ **Replies:** 0\ **Last updated:** [December 13, 2018, 5:57pm UTC](https://discuss.elastic.co/t/extract-key-phrases-for-given-sentence-from-elastic-search/160795 "2018-12-13T17:57:19Z")
hello I need help with indexing/query for below use case I have list of "keyphrases" like below which will go into elastic search index. //e.g. Keyphrases to index: "beautiful place for summer" "travel destination for… --- ## [Data set difference between fields on different indexes](https://discuss.elastic.co/t/data-set-difference-between-fields-on-different-indexes/160015)
**Author:** [@nandrik](https://discuss.elastic.co/u/nandrik)\ **Replies:** 5\ **Last updated:** [December 13, 2018, 5:38pm UTC](https://discuss.elastic.co/t/data-set-difference-between-fields-on-different-indexes/160015 "2018-12-13T17:38:36Z")
Hi, per my previous post, I ended up creating two separate indexes (Index 1, Index 2) sharing one common field dstIP. I'd like now, let's say on an hourly basis, to get a list of all the IP addresses that exist in Index… --- ## [Aggs / Max timestamp Term query issue](https://discuss.elastic.co/t/aggs-max-timestamp-term-query-issue/160604)
**Author:** [@mgolubov55](https://discuss.elastic.co/u/mgolubov55)\ **Replies:** 8\ **Last updated:** [December 13, 2018, 5:26pm UTC](https://discuss.elastic.co/t/aggs-max-timestamp-term-query-issue/160604 "2018-12-13T17:26:04Z")
When I execute this query: GET /logstash\*/\_search?size=0 { "aggs" : { "max\_timestamp" : { "max" : { "field" : "@timestamp" } } } } I get this result: . . }, "aggregations" : { "max\_timestamp" : { "value" : 1… --- ## [Word count/frequency per field](https://discuss.elastic.co/t/word-count-frequency-per-field/159910)
**Author:** [@M.alsioufi](https://discuss.elastic.co/u/M.alsioufi)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 4:37pm UTC](https://discuss.elastic.co/t/word-count-frequency-per-field/159910 "2018-12-13T16:37:30Z")
Hi there, is there any convenient way to get the count of words/tokens in some fields of a document? for example: curl -XPUT 'http://localhost:9200/twitter/tweet/1?pretty=true' -d '{ "text1" : "twitter, test, test, t… --- ## [Sorting problem on sparse fields](https://discuss.elastic.co/t/sorting-problem-on-sparse-fields/160564)
**Author:** [@fmhwong](https://discuss.elastic.co/u/fmhwong)\ **Replies:** 3\ **Last updated:** [December 13, 2018, 3:45pm UTC](https://discuss.elastic.co/t/sorting-problem-on-sparse-fields/160564 "2018-12-13T15:45:12Z")
I have multiple types of documents in one index. Most of the documents are type 1. When the first document from type 2 added to the index, the visualization failed to return the document and I got "Request Timeout after … --- ## [Repository-s3 plugin for 3rd party provider](https://discuss.elastic.co/t/repository-s3-plugin-for-3rd-party-provider/160153)
**Author:** [@Daimon\_Rasmussen](https://discuss.elastic.co/u/Daimon_Rasmussen)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 3:36pm UTC](https://discuss.elastic.co/t/repository-s3-plugin-for-3rd-party-provider/160153 "2018-12-13T15:36:37Z")
Hi, in elastic 5, i could set the repository-s3 plugin to use an object store by another provider (not aws). usage was documented here: https://www.elastic.co/guide/en/elasticsearch/plugins/5.6/repository-s3-repositor… --- ## [Take Image of one node and create other nodes](https://discuss.elastic.co/t/take-image-of-one-node-and-create-other-nodes/160752)
**Author:** [@muthucse](https://discuss.elastic.co/u/muthucse)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 2:57pm UTC](https://discuss.elastic.co/t/take-image-of-one-node-and-create-other-nodes/160752 "2018-12-13T14:57:06Z")
We are running ES servers in azure cloud. Every time we need to install and configure all the settings manually for each node. As we are also using Nginx proxy it involves more of repetitive tasks to setup each env. How … --- ## [Fuzziness in query\_string](https://discuss.elastic.co/t/fuzziness-in-query-string/160711)
**Author:** [@roru](https://discuss.elastic.co/u/roru)\ **Replies:** 3\ **Last updated:** [December 13, 2018, 2:37pm UTC](https://discuss.elastic.co/t/fuzziness-in-query-string/160711 "2018-12-13T14:37:21Z")
Hi all, I am using query\_string for my queries, because I want the user to be able to use operators like AND and OR. The problem is, that if a user searches for "nestle", he won't get any results, because it is actuall… --- ## [Query on aggregation and scroll](https://discuss.elastic.co/t/query-on-aggregation-and-scroll/160416)
**Author:** [@sanjeebkdeka](https://discuss.elastic.co/u/sanjeebkdeka)\ **Replies:** 5\ **Last updated:** [December 13, 2018, 1:38pm UTC](https://discuss.elastic.co/t/query-on-aggregation-and-scroll/160416 "2018-12-13T13:38:46Z")
Hi, I have a requirement to retrieve all instances of records having unique value for a particular column. All the records having that same unique value must appear in one cluster. The number of records in the index cou… --- ## [How to create elastic search cluster on AWS-EC2 using ES-6.5.2](https://discuss.elastic.co/t/how-to-create-elastic-search-cluster-on-aws-ec2-using-es-6-5-2/160670)
**Author:** [@Madhu\_Cherukuri](https://discuss.elastic.co/u/Madhu_Cherukuri)\ **Replies:** 17\ **Last updated:** [December 13, 2018, 12:34pm UTC](https://discuss.elastic.co/t/how-to-create-elastic-search-cluster-on-aws-ec2-using-es-6-5-2/160670 "2018-12-13T12:34:47Z")
Hi am creating cluster with 3 nodes making 2 nodes as master and data, 1 is data node discovery.zen.ping.unicast.hosts: \["master\_node1:9300", "master\_node2:9300", "datanode:9300"\] i have added like this in three nodes … --- ## [Aggregation Pagination Composite VS Include Partion](https://discuss.elastic.co/t/aggregation-pagination-composite-vs-include-partion/160700)
**Author:** [@Gary\_Harpaz](https://discuss.elastic.co/u/Gary_Harpaz)\ **Replies:** 3\ **Last updated:** [December 13, 2018, 12:25pm UTC](https://discuss.elastic.co/t/aggregation-pagination-composite-vs-include-partion/160700 "2018-12-13T12:25:24Z")
Hi, At my company we use a terms aggregation with include: partition number to paginate the results. I noticed that in newer versions you have a composite aggregation which also allows pagination. Which do you think i… --- ## [Unable to use field named "\_Data" in Sql query anymore](https://discuss.elastic.co/t/unable-to-use-field-named-data-in-sql-query-anymore/158786)
**Author:** [@Magnus\_Andersson1](https://discuss.elastic.co/u/Magnus_Andersson1)\ **Replies:** 5\ **Last updated:** [December 13, 2018, 12:27pm UTC](https://discuss.elastic.co/t/unable-to-use-field-named-data-in-sql-query-anymore/158786 "2018-12-13T12:27:06Z")
Hi, I have a document looking like this, copied from the \_source property of a Elastic query result: { "AbstractId" : "7f424fa0-f30e-477d-8245-d3b4e97e0538", "Category" : "GUI", "Creat… --- ## [How to find some key which is not in mapping?](https://discuss.elastic.co/t/how-to-find-some-key-which-is-not-in-mapping/160724)
**Author:** [@inandi](https://discuss.elastic.co/u/inandi)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 11:54am UTC](https://discuss.elastic.co/t/how-to-find-some-key-which-is-not-in-mapping/160724 "2018-12-13T11:54:09Z")
Here is my sample data { "geo\_type" : "GPS\_LOCATION", "happenon" : 1544439593, "country" : "IND", "idapp" : "81", } my template is { "index\_patterns": \[ "index\*" \], … --- ## [Elasticsearch Highlighting Issue with fragmentor](https://discuss.elastic.co/t/elasticsearch-highlighting-issue-with-fragmentor/159313)
**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\ **Replies:** 5\ **Last updated:** [December 13, 2018, 11:06am UTC](https://discuss.elastic.co/t/elasticsearch-highlighting-issue-with-fragmentor/159313 "2018-12-13T11:06:02Z")
I am finding issues with how Elasticsearch highlights the text Example: when using "unified" highlighter i.e., "highlight": { "type" : "unified", "fields": { "\*": {} } the results shown is : "highlight": { … --- ## [Elasticsearch run in kubernetes](https://discuss.elastic.co/t/elasticsearch-run-in-kubernetes/160679)
**Author:** [@pytimer](https://discuss.elastic.co/u/pytimer)\ **Replies:** 6\ **Last updated:** [December 13, 2018, 10:23am UTC](https://discuss.elastic.co/t/elasticsearch-run-in-kubernetes/160679 "2018-12-13T10:23:37Z")
Hi, all I run Elasticsearch 6.2.2 in Kubernetes and use glusterfs as storage backend. When i start is works well, everything looks OK. But run after a while, health of that some indices turned Red. I don't know what ha… --- ## [Upgrade kibana and ES](https://discuss.elastic.co/t/upgrade-kibana-and-es/160583)
**Author:** [@ilanas](https://discuss.elastic.co/u/ilanas)\ **Replies:** 3\ **Last updated:** [December 13, 2018, 10:16am UTC](https://discuss.elastic.co/t/upgrade-kibana-and-es/160583 "2018-12-13T10:16:24Z")
Hello, y try to upgrade kibana in dev environment and i install 6.5.3 of kibana, logstash and elasticsearch. I export al de saved object and i import in the new envirnment. how can i export/import the indexes and the ind… --- ## [Auto cleanup monitoring cluster](https://discuss.elastic.co/t/auto-cleanup-monitoring-cluster/160676)
**Author:** [@Hitesh\_Baldaniya](https://discuss.elastic.co/u/Hitesh_Baldaniya)\ **Replies:** 3\ **Last updated:** [December 13, 2018, 10:11am UTC](https://discuss.elastic.co/t/auto-cleanup-monitoring-cluster/160676 "2018-12-13T10:11:00Z")
Hi, We have created cluster on cloud.elastic.co where we have enabled monitoring on different cluster. Following are my questions. cloud.elastic uses "X-Pack" for monitoring? How do I set auto cleanup of past "N" day… --- ## [Automatically delete 1 month old records/documents(without deleting index) in elastic search/kibana](https://discuss.elastic.co/t/automatically-delete-1-month-old-records-documents-without-deleting-index-in-elastic-search-kibana/160041)
**Author:** [@sid\_nikhil](https://discuss.elastic.co/u/sid_nikhil)\ **Replies:** 20\ **Last updated:** [December 13, 2018, 9:19am UTC](https://discuss.elastic.co/t/automatically-delete-1-month-old-records-documents-without-deleting-index-in-elastic-search-kibana/160041 "2018-12-13T09:19:40Z")
When i try to create time based index for filebeats,it says "unable to fetch mapping , do you have indices matching that pattern". However the normal index is getting created when i type in filebeat-\*. Can anybody pleas… --- ## [ES1.7.2 - High CPU usage](https://discuss.elastic.co/t/es1-7-2-high-cpu-usage/160649)
**Author:** [@saihariharan](https://discuss.elastic.co/u/saihariharan)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 9:11am UTC](https://discuss.elastic.co/t/es1-7-2-high-cpu-usage/160649 "2018-12-13T09:11:46Z")
We are facing high CPU usage on a lone node in a 5 node ES 1.7.2 cluster. All the cluster is currently doing is replicating/sync'ng documents from a Couchbase cluster through the transport-couchbase plugin. CPU is aroun… --- ## [Cluster.routing.allocation.exclude.\_name not working](https://discuss.elastic.co/t/cluster-routing-allocation-exclude-name-not-working/160620)
**Author:** [@philschroeder](https://discuss.elastic.co/u/philschroeder)\ **Replies:** 5\ **Last updated:** [December 13, 2018, 8:46am UTC](https://discuss.elastic.co/t/cluster-routing-allocation-exclude-name-not-working/160620 "2018-12-13T08:46:03Z")
Hi, I am trying to decommission some nodes in an old (ES2.2) cluster. First step is moving the data off of the nodes. I'm using: curl -XPUT ES\_HOST:9200/\_cluster/settings?explain -H 'Content-Type: application/json' … --- ## [How to count up "skipped shards" in "\_shards" as query result](https://discuss.elastic.co/t/how-to-count-up-skipped-shards-in-shards-as-query-result/159668)
**Author:** [@junkoshimane](https://discuss.elastic.co/u/junkoshimane)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 8:10am UTC](https://discuss.elastic.co/t/how-to-count-up-skipped-shards-in-shards-as-query-result/159668 "2018-12-13T08:10:03Z")
Hi all, I look for the way to count up "skipped shards" in "\_shards" as query result. The following topic is similar to mine. But nobody has commented to that topic yet. Based on the following URL, https://discuss.e… --- ## [Elasticsearch Highlighting is very slow](https://discuss.elastic.co/t/elasticsearch-highlighting-is-very-slow/160680)
**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\ **Replies:** 0\ **Last updated:** [December 13, 2018, 7:26am UTC](https://discuss.elastic.co/t/elasticsearch-highlighting-is-very-slow/160680 "2018-12-13T07:26:09Z")
Hi, I find unified highlighting is taking a long time to fetch highlight results. I wish to know why there is huge difference when using highlighting I am using "term\_vector": "with\_positions\_offsets" on all the fields… --- ## [How much data for a warm node](https://discuss.elastic.co/t/how-much-data-for-a-warm-node/160648)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 1\ **Last updated:** [December 13, 2018, 6:17am UTC](https://discuss.elastic.co/t/how-much-data-for-a-warm-node/160648 "2018-12-13T06:17:17Z")
I'm researching the impossible questions for planning a cluster. We need to keep some data for a year or more. If we do a hot/warm, the question is can we keep 10-20G or more on a warm node? Disk is cheap, nodes aren'… --- ## [Remove nodes from ELK cluster](https://discuss.elastic.co/t/remove-nodes-from-elk-cluster/160669)
**Author:** [@rajisankar](https://discuss.elastic.co/u/rajisankar)\ **Replies:** 2\ **Last updated:** [December 13, 2018, 6:07am UTC](https://discuss.elastic.co/t/remove-nodes-from-elk-cluster/160669 "2018-12-13T06:07:13Z")
Hi, I have Elasticsearch 6.3 OSS 3-node cluster. One master and 2 data nodes. I added another data node to the cluster. Then, removed it using the following API call. curl -XPUT localhost:9200/\_cluster/settings -H … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1452) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1454)