# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1160 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1161 --- ## [Elasticsearch ingest pipeline drop processor no worky :(](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-drop-processor-no-worky/198904)
**Author:** [@nilsenj](https://discuss.elastic.co/u/nilsenj)\ **Replies:** 1\ **Last updated:** [September 11, 2019, 12:55pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-drop-processor-no-worky/198904 "2019-09-11T12:55:12Z")
Hello fellow log ingestors, I have an ingest pipeline to ingest logs however I want to drop the document if it contains a certain string in the message field. I am trying to use the drop processor for this but the docum… --- ## [Elasticsearch insertion, deletion, updation](https://discuss.elastic.co/t/elasticsearch-insertion-deletion-updation/198956)
**Author:** [@Dv\_Thiyanesh](https://discuss.elastic.co/u/Dv_Thiyanesh)\ **Replies:** 6\ **Last updated:** [September 11, 2019, 12:46pm UTC](https://discuss.elastic.co/t/elasticsearch-insertion-deletion-updation/198956 "2019-09-11T12:46:53Z")
I am using java client API and established connection with elastic search and my requirement is i need to take a sql query from the user and with that sql query i need to perform CRUD operation. i have used translate met… --- ## [Sql queries with elastic search](https://discuss.elastic.co/t/sql-queries-with-elastic-search/198949)
**Author:** [@Velliyangiri](https://discuss.elastic.co/u/Velliyangiri)\ **Replies:** 5\ **Last updated:** [September 11, 2019, 12:41pm UTC](https://discuss.elastic.co/t/sql-queries-with-elastic-search/198949 "2019-09-11T12:41:27Z")
Is it possible to process elastic search using sql queries in java program? If it is yes,give a sample code for this elastic search retrieval over sql queries in java program.Please give me a solution under RestHighLevel… --- ## [Stutract Two values](https://discuss.elastic.co/t/stutract-two-values/198869)
**Author:** [@Arpan.S](https://discuss.elastic.co/u/Arpan.S)\ **Replies:** 6\ **Last updated:** [September 11, 2019, 12:25pm UTC](https://discuss.elastic.co/t/stutract-two-values/198869 "2019-09-11T12:25:37Z")
Hi, I want to get difference between two values. suppose I have data in following format. "\_source" : { "students" : \[ { "name" : "A", "total\_fee" : 12345, "paid\_fee" : 12344.8 }, { "name" : "B", "total\_fee" … --- ## [How to get running time in this case?](https://discuss.elastic.co/t/how-to-get-running-time-in-this-case/197595)
**Author:** [@morinooji](https://discuss.elastic.co/u/morinooji)\ **Replies:** 4\ **Last updated:** [September 11, 2019, 11:41am UTC](https://discuss.elastic.co/t/how-to-get-running-time-in-this-case/197595 "2019-09-11T11:41:50Z")
There are two docs which are added by Application Logger (log4j). docs have same instance id (key). #1 { "instance\_id": "ee0e5890-4968-4dec-80c7-69e22ed4001b" , "message": "done", "@TimeStamp" : "2019-08-06T09:33:0… --- ## [Wild card query is not returing expected result](https://discuss.elastic.co/t/wild-card-query-is-not-returing-expected-result/199067)
**Author:** [@imprints](https://discuss.elastic.co/u/imprints)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 11:14am UTC](https://discuss.elastic.co/t/wild-card-query-is-not-returing-expected-result/199067 "2019-09-11T11:14:26Z")
I was trying with below query { "\_source" : \["prmry\_pers\_frst\_gvn\_nm"\], "query": { "bool": { "must": { "wildcard": { "prmry\_pers\_frst\_gvn\_nm": "Ben Unit\*" } } } }, "size": "100" } Was expecting below result… --- ## [X-Pack Security is not avaible on ES 6.6.1 basic](https://discuss.elastic.co/t/x-pack-security-is-not-avaible-on-es-6-6-1-basic/199065)
**Author:** [@pzygan](https://discuss.elastic.co/u/pzygan)\ **Replies:** 2\ **Last updated:** [September 11, 2019, 11:10am UTC](https://discuss.elastic.co/t/x-pack-security-is-not-avaible-on-es-6-6-1-basic/199065 "2019-09-11T11:10:34Z")
Hi, I've got elasticsearch-6.6.1 with basic license, installed on one node. I try to configure security, but when i try setup passwords i get an error : C:\\ProgramData\\Elastic661\\elasticsearch-6.6.1\\bin\>elasticsearc… --- ## [Elasticsearch to speedup social media feed](https://discuss.elastic.co/t/elasticsearch-to-speedup-social-media-feed/199064)
**Author:** [@ajayk](https://discuss.elastic.co/u/ajayk)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 10:41am UTC](https://discuss.elastic.co/t/elasticsearch-to-speedup-social-media-feed/199064 "2019-09-11T10:41:35Z")
Hi, It is very well known fact that EL is used to speed-up search capabilities within a website. You can implement search based on the time frame and display the results. My thought is that let's suppose if it is a Fa… --- ## [Slow cluster operations (\_cat/nodes time out)](https://discuss.elastic.co/t/slow-cluster-operations-cat-nodes-time-out/197224)
**Author:** [@hunsw](https://discuss.elastic.co/u/hunsw)\ **Replies:** 1\ **Last updated:** [September 11, 2019, 10:14am UTC](https://discuss.elastic.co/t/slow-cluster-operations-cat-nodes-time-out/197224 "2019-09-11T10:14:01Z")
Hey all, This is a fairly complex problem I'm facing for two days now. SYMPTOMS The main symptom from the admin perspective is the time out of the \_cat APIs, e.g. \_cat/nodes and slow user logins in Kibana. Sometime a… --- ## [Docs.count is diffenet when I twice post data to elasticsearch](https://discuss.elastic.co/t/docs-count-is-diffenet-when-i-twice-post-data-to-elasticsearch/199056)
**Author:** [@kiddingl](https://discuss.elastic.co/u/kiddingl)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 10:12am UTC](https://discuss.elastic.co/t/docs-count-is-diffenet-when-i-twice-post-data-to-elasticsearch/199056 "2019-09-11T10:12:42Z")
elaticsearch: 6.3.1 os: centos7 kernel: 3.10 I run the shell command: curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9202/shakespeare/doc/\_bulk?pretty' --data-binary @shakespeare\_6.0.json The end of c… --- ## [Reformatting index timeout exception](https://discuss.elastic.co/t/reformatting-index-timeout-exception/199051)
**Author:** [@acidserg](https://discuss.elastic.co/u/acidserg)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 9:29am UTC](https://discuss.elastic.co/t/reformatting-index-timeout-exception/199051 "2019-09-11T09:29:01Z")
Hi all! I'm trying to reindex my structure in the next way. I have a lot of indexes like "index1"..."indexN". I want to create next structure - I have one index with "indexes" name, and a lot of alias to every document… --- ## [Getting watch history automatically](https://discuss.elastic.co/t/getting-watch-history-automatically/199047)
**Author:** [@PortableInk](https://discuss.elastic.co/u/PortableInk)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 9:10am UTC](https://discuss.elastic.co/t/getting-watch-history-automatically/199047 "2019-09-11T09:10:48Z")
Hi, I was looking at creating a watch that watches the other watches, indexing the last status of the watch (last triggered and last fired etc.) and sending out an email should a watch not fire when it should have. Kib… --- ## [How about Force change cluster's elected master node](https://discuss.elastic.co/t/how-about-force-change-clusters-elected-master-node/198648)
**Author:** [@luyuncheng](https://discuss.elastic.co/u/luyuncheng)\ **Replies:** 6\ **Last updated:** [September 11, 2019, 8:58am UTC](https://discuss.elastic.co/t/how-about-force-change-clusters-elected-master-node/198648 "2019-09-11T08:58:55Z")
When i see the issues: When talk about force change cluster's elected master node, if there is a master leave but cluster settings not changed, what if changed the cluster block level into METADATA\_WRITE? not BLOC… --- ## [Limiting aggregation input size](https://discuss.elastic.co/t/limiting-aggregation-input-size/199019)
**Author:** [@Yonatan\_Omer](https://discuss.elastic.co/u/Yonatan_Omer)\ **Replies:** 1\ **Last updated:** [September 11, 2019, 8:25am UTC](https://discuss.elastic.co/t/limiting-aggregation-input-size/199019 "2019-09-11T08:25:39Z")
Is it possible to limit the number of documents to aggregate? I wish to optimize the number of script executions specified in the "include" field. POST /stats/\_search { "size":0, "query": { "bool" : { … --- ## [How to restrict field to add data in copy\_to method](https://discuss.elastic.co/t/how-to-restrict-field-to-add-data-in-copy-to-method/195706)
**Author:** [@Debashis\_Mondal](https://discuss.elastic.co/u/Debashis_Mondal)\ **Replies:** 2\ **Last updated:** [September 11, 2019, 7:28am UTC](https://discuss.elastic.co/t/how-to-restrict-field-to-add-data-in-copy-to-method/195706 "2019-09-11T07:28:50Z")
Hi, I am using copy\_to method where I am trying to allow first\_name and last\_name to add data and full\_name will be read-only. The data will be added into the full\_name field automatically. PUT my\_index { "mappings":… --- ## [Upgrade order](https://discuss.elastic.co/t/upgrade-order/198627)
**Author:** [@amitavmohanty01](https://discuss.elastic.co/u/amitavmohanty01)\ **Replies:** 15\ **Last updated:** [September 11, 2019, 6:40am UTC](https://discuss.elastic.co/t/upgrade-order/198627 "2019-09-11T06:40:42Z")
When upgrading from any version to a higher version that is supported by Elastic, what is the order of upgrade for node types: master, index-only, coordination-only ? --- ## [How can i find all similar results as groups?](https://discuss.elastic.co/t/how-can-i-find-all-similar-results-as-groups/199011)
**Author:** [@nikedadi](https://discuss.elastic.co/u/nikedadi)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 6:04am UTC](https://discuss.elastic.co/t/how-can-i-find-all-similar-results-as-groups/199011 "2019-09-11T06:04:16Z")
I have index with documents with titles like this: The best movie! THE BEST, MOVIE. My film The "Best mowie" MY FILM! First i want to get all titles analyzed by next rules: a) Lowercase b) Strip \[.,"'-\_\] etc. c) Ch… --- ## [Tips :- Finding the version of Elaasticsearch, Kibana and others , try this one line command](https://discuss.elastic.co/t/tips-finding-the-version-of-elaasticsearch-kibana-and-others-try-this-one-line-command/198996)
**Author:** [@Joseph\_John](https://discuss.elastic.co/u/Joseph_John)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 3:14am UTC](https://discuss.elastic.co/t/tips-finding-the-version-of-elaasticsearch-kibana-and-others-try-this-one-line-command/198996 "2019-09-11T03:14:08Z")
Hi All, Like to introduce me, Joseph John a open source user and lobbyist. Trying to see how I could make use of APM for Adempiere and Odoo. Like to share here for Linux new comers, to check your elaticsearch, and a… --- ## [NEST date deserialization challenges](https://discuss.elastic.co/t/nest-date-deserialization-challenges/198994)
**Author:** [@rpatrick00](https://discuss.elastic.co/u/rpatrick00)\ **Replies:** 0\ **Last updated:** [September 11, 2019, 2:49am UTC](https://discuss.elastic.co/t/nest-date-deserialization-challenges/198994 "2019-09-11T02:49:52Z")
I have an Index in Elasticsearch 7.2.0 with mappings that look like the following: { "settings": { "analysis": { "normalizer": { "lowercase\_normalizer": { "type": "custom", "char\_filter": , "filter": \["lowercase… --- ## [Aggregating, picking top value using ordering then ordering buckets by score](https://discuss.elastic.co/t/aggregating-picking-top-value-using-ordering-then-ordering-buckets-by-score/198975)
**Author:** [@lloydk](https://discuss.elastic.co/u/lloydk)\ **Replies:** 1\ **Last updated:** [September 10, 2019, 10:36pm UTC](https://discuss.elastic.co/t/aggregating-picking-top-value-using-ordering-then-ordering-buckets-by-score/198975 "2019-09-10T22:36:10Z")
Imagine a packages repository like NuGet or NPM. Multiple packages with the same ID and many versions. These are entered individually as a document into the index. Now in a query I want to aggregate them by ID, sort th… --- ## [Best practices to configure indexSet passwords for kibana and other users before elasticsearch starts (k8s)](https://discuss.elastic.co/t/best-practices-to-configure-indexset-passwords-for-kibana-and-other-users-before-elasticsearch-starts-k8s/198974)
**Author:** [@O\_K](https://discuss.elastic.co/u/O_K)\ **Replies:** 0\ **Last updated:** [September 10, 2019, 8:50pm UTC](https://discuss.elastic.co/t/best-practices-to-configure-indexset-passwords-for-kibana-and-other-users-before-elasticsearch-starts-k8s/198974 "2019-09-10T20:50:24Z")
Hello, Please let me know the preferred options to set passwords for elastic users (kibana user, etc) before elasticsearch starts? I noticed that we can use k8s secrets, what other options do we have? Do we have env va… --- ## [Unable to use loadBalancerIP with elastic/helm-chart](https://discuss.elastic.co/t/unable-to-use-loadbalancerip-with-elastic-helm-chart/198954)
**Author:** [@darenjacobs](https://discuss.elastic.co/u/darenjacobs)\ **Replies:** 0\ **Last updated:** [September 10, 2019, 6:21pm UTC](https://discuss.elastic.co/t/unable-to-use-loadbalancerip-with-elastic-helm-chart/198954 "2019-09-10T18:21:44Z")
Hello, I am deploying ElasticSearch using helm charts here: elastic/helm-charts on GCP k8s version: 1.13.7-gke.8. providing loadBalancerIP: x.x.x.x is not working. I am using the provided values.yaml file except in th… --- ## [How Do You Serve Out Data From Elastic For End-user Use?](https://discuss.elastic.co/t/how-do-you-serve-out-data-from-elastic-for-end-user-use/198972)
**Author:** [@beezit](https://discuss.elastic.co/u/beezit)\ **Replies:** 0\ **Last updated:** [September 10, 2019, 8:37pm UTC](https://discuss.elastic.co/t/how-do-you-serve-out-data-from-elastic-for-end-user-use/198972 "2019-09-10T20:37:41Z")
So assuming you got Elastic to work, loaded in your index and mappings are fine etc, how do you serve out the data that ES worked on to the end-users for use? Still trying to understand how all these tie together. Thank… --- ## [Elasticsearch Snapshot repository size estimates](https://discuss.elastic.co/t/elasticsearch-snapshot-repository-size-estimates/198774)
**Author:** [@awhelan](https://discuss.elastic.co/u/awhelan)\ **Replies:** 3\ **Last updated:** [September 10, 2019, 8:10pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-repository-size-estimates/198774 "2019-09-10T20:10:37Z")
Hello, I have a size question concerning the Elasticsearch \[Snapshot/Restore\] API capabilities Let’s, say I am only backing up one index. An example call to the snapshot API is shown below for an index called myindex. … --- ## [Kibana timeout during discover. Elasticsearch error: collector \[node\_stats\] timed out when collecting data](https://discuss.elastic.co/t/kibana-timeout-during-discover-elasticsearch-error-collector-node-stats-timed-out-when-collecting-data/198666)
**Author:** [@O\_K](https://discuss.elastic.co/u/O_K)\ **Replies:** 2\ **Last updated:** [September 10, 2019, 8:01pm UTC](https://discuss.elastic.co/t/kibana-timeout-during-discover-elasticsearch-error-collector-node-stats-timed-out-when-collecting-data/198666 "2019-09-10T20:01:09Z")
Hello, I have problems ( errors below) to discover indexes in kibana, some indexes loads after 2nd attempt like dev.k8s-2019.09.09 (900Mb) , some indexes are more problematic with discovering in kibana like dev.k8s.app… --- ## [Changing Timezone in Elasticsearch query response](https://discuss.elastic.co/t/changing-timezone-in-elasticsearch-query-response/198967)
**Author:** [@Daniel\_Merege](https://discuss.elastic.co/u/Daniel_Merege)\ **Replies:** 0\ **Last updated:** [September 10, 2019, 7:38pm UTC](https://discuss.elastic.co/t/changing-timezone-in-elasticsearch-query-response/198967 "2019-09-10T19:38:11Z")
I'd like to know how I can make Elasticsearch change the timezone of timestamps in query's response JSON by using any parameter, instead of using script fields. Is it possible? I could make it consider the timezone in t… --- ## [How do nodes and shards work in this scenario?](https://discuss.elastic.co/t/how-do-nodes-and-shards-work-in-this-scenario/198947)
**Author:** [@orokusaki](https://discuss.elastic.co/u/orokusaki)\ **Replies:** 4\ **Last updated:** [September 10, 2019, 6:30pm UTC](https://discuss.elastic.co/t/how-do-nodes-and-shards-work-in-this-scenario/198947 "2019-09-10T18:30:40Z")
If we set up an Elasticsearch cluster with 2 nodes, and an index configured for 4 shards with 1 replica, and then we begin indexing data, I understand our data will be placed into shards based on the hash of the routing … --- ## [For read/search performance, 6 small nodes vs 3 large nodes?](https://discuss.elastic.co/t/for-read-search-performance-6-small-nodes-vs-3-large-nodes/198955)
**Author:** [@orokusaki](https://discuss.elastic.co/u/orokusaki)\ **Replies:** 0\ **Last updated:** [September 10, 2019, 6:24pm UTC](https://discuss.elastic.co/t/for-read-search-performance-6-small-nodes-vs-3-large-nodes/198955 "2019-09-10T18:24:18Z")
For some background, our usage of Elasticsearch is for an index of real estate transactions. Each transaction is added once and then updated 3-4 times (as agents are added and a few other specific actions that trigger a … --- ## [How can I control the size of the elasticsearch stdout file](https://discuss.elastic.co/t/how-can-i-control-the-size-of-the-elasticsearch-stdout-file/198953)
**Author:** [@tom\_hogan](https://discuss.elastic.co/u/tom_hogan)\ **Replies:** 0\ **Last updated:** [September 10, 2019, 6:04pm UTC](https://discuss.elastic.co/t/how-can-i-control-the-size-of-the-elasticsearch-stdout-file/198953 "2019-09-10T18:04:04Z")
The elasticsearch process is throwing errors. The errors need to be addressed, but they don't prevent the application from working. The errors are also being written to the log file. But in the meantime, how can I preve… --- ## [Check the top\_hits aggregation results to see if every top hit has a field with a specific value](https://discuss.elastic.co/t/check-the-top-hits-aggregation-results-to-see-if-every-top-hit-has-a-field-with-a-specific-value/197904)
**Author:** [@awatkins](https://discuss.elastic.co/u/awatkins)\ **Replies:** 5\ **Last updated:** [September 10, 2019, 5:49pm UTC](https://discuss.elastic.co/t/check-the-top-hits-aggregation-results-to-see-if-every-top-hit-has-a-field-with-a-specific-value/197904 "2019-09-10T17:49:11Z")
I am trying to accomplish what seems like it should be super easy and obviously possible but hitting a hard brick wall instead. aggregate all elastic documents in a specific index from the last 60 days into buckets by… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1159) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1161)