# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=849 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 850 --- ## [Scripted fields](https://discuss.elastic.co/t/scripted-fields/243015)
**Author:** [@DJindal](https://discuss.elastic.co/u/DJindal)\ **Replies:** 0\ **Last updated:** [July 29, 2020, 7:45am UTC](https://discuss.elastic.co/t/scripted-fields/243015 "2020-07-29T07:45:36Z")
hi in my location field which is a geo-hash field, holds latitude and longitude values which is sometimes 0,0. i wish to exclude this 0,0 value to be plotted in the coordinate map. i am using kibana 6.5. how can i exc… --- ## [Rabbitmq setup in ELK stack](https://discuss.elastic.co/t/rabbitmq-setup-in-elk-stack/242696)
**Author:** [@nityaraj06](https://discuss.elastic.co/u/nityaraj06)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 7:00am UTC](https://discuss.elastic.co/t/rabbitmq-setup-in-elk-stack/242696 "2020-07-29T07:00:13Z")
Hi, I need to install a messaging queue in the ELK stack. I am planning to use RabbitMQ for this purpose since my Elastic installation is on Windows servers. I have around 30 app servers on which logstash is installed … --- ## [Elasticsearch cross cluster replication, authorization and authentication](https://discuss.elastic.co/t/elasticsearch-cross-cluster-replication-authorization-and-authentication/242816)
**Author:** [@lnitin12](https://discuss.elastic.co/u/lnitin12)\ **Replies:** 1\ **Last updated:** [July 29, 2020, 5:49am UTC](https://discuss.elastic.co/t/elasticsearch-cross-cluster-replication-authorization-and-authentication/242816 "2020-07-29T05:49:52Z")
To setup cross cluster replication in elasticsearch, what is the authorization and authentication mechanism in between Local and Remote cluster ..? How does local cluster recognize remote cluster.? @elasticsearch --- ## [Match terms with characters in a sequence](https://discuss.elastic.co/t/match-terms-with-characters-in-a-sequence/238768)
**Author:** [@emarthinsen](https://discuss.elastic.co/u/emarthinsen)\ **Replies:** 5\ **Last updated:** [July 29, 2020, 4:33am UTC](https://discuss.elastic.co/t/match-terms-with-characters-in-a-sequence/238768 "2020-07-29T04:33:31Z")
I'm interested in building an autocomplete-style interface where someone can enter characters and the results will be the terms that have those characters in that order, but not necessarily contiguous. This is functiona… --- ## [Elasticsearch index disk usage change (size of primary and replica shards on disk )](https://discuss.elastic.co/t/elasticsearch-index-disk-usage-change-size-of-primary-and-replica-shards-on-disk/242829)
**Author:** [@jinner](https://discuss.elastic.co/u/jinner)\ **Replies:** 2\ **Last updated:** [July 29, 2020, 4:30am UTC](https://discuss.elastic.co/t/elasticsearch-index-disk-usage-change-size-of-primary-and-replica-shards-on-disk/242829 "2020-07-29T04:30:07Z")
As you can see above, disk usage of index is changed (poped up a bit around 10:21 and came down again) although document count is still increasing. Additionally, ILM(index lifecycle management) which is allocated to th… --- ## [ES 7.8.0 Java RestHighLevelClient UpdateByQueryAsync throws SocketTimeoutException](https://discuss.elastic.co/t/es-7-8-0-java-resthighlevelclient-updatebyqueryasync-throws-sockettimeoutexception/242839)
**Author:** [@benatwork](https://discuss.elastic.co/u/benatwork)\ **Replies:** 2\ **Last updated:** [July 28, 2020, 11:23pm UTC](https://discuss.elastic.co/t/es-7-8-0-java-resthighlevelclient-updatebyqueryasync-throws-sockettimeoutexception/242839 "2020-07-28T23:23:54Z")
Hi all, First post here so I should say, we love elasticsearch! Some big fans on our team. I'm looking into an issue we're seeing on ES 7.8.0 using the Java RestHighLevelClient, where an expensive UpdateByQuery is thro… --- ## [Filter synonym not working](https://discuss.elastic.co/t/filter-synonym-not-working/242868)
**Author:** [@ggiff](https://discuss.elastic.co/u/ggiff)\ **Replies:** 0\ **Last updated:** [July 28, 2020, 9:19am UTC](https://discuss.elastic.co/t/filter-synonym-not-working/242868 "2020-07-28T09:19:15Z")
I am using ingest processor to ingest/index files like pdf, xls etc. This is my pipeline: curl -XPUT 'ES\_HOST:ES\_PORT/\_ingest/pipeline/attachment?pretty' -H 'Content-Type: application/json' -d '{ "description" : "Extr… --- ## [Java testing framework documents deleted?](https://discuss.elastic.co/t/java-testing-framework-documents-deleted/242977)
**Author:** [@chenqi0805](https://discuss.elastic.co/u/chenqi0805)\ **Replies:** 1\ **Last updated:** [July 28, 2020, 10:33pm UTC](https://discuss.elastic.co/t/java-testing-framework-documents-deleted/242977 "2020-07-28T22:33:25Z")
https://www.elastic.co/guide/en/elasticsearch/reference/current/testing-framework.html What is the latest practice? Also, is there example on how to set up es cluster for integration test in gradle? --- ## [Semantic Search using ML capabilities](https://discuss.elastic.co/t/semantic-search-using-ml-capabilities/242860)
**Author:** [@Shubham\_Mittal](https://discuss.elastic.co/u/Shubham_Mittal)\ **Replies:** 3\ **Last updated:** [July 28, 2020, 10:19pm UTC](https://discuss.elastic.co/t/semantic-search-using-ml-capabilities/242860 "2020-07-28T22:19:40Z")
Hi Team, Could you please tell if elastic search currently supports semantic search using machine learning features? --- ## [Dynamic queue sizes](https://discuss.elastic.co/t/dynamic-queue-sizes/242418)
**Author:** [@Ankit\_Malpani](https://discuss.elastic.co/u/Ankit_Malpani)\ **Replies:** 4\ **Last updated:** [July 28, 2020, 9:49pm UTC](https://discuss.elastic.co/t/dynamic-queue-sizes/242418 "2020-07-28T21:49:35Z")
I wanted to hear thoughts on adding an API to make queues dynamic. I understand this is an advanced setting and there can be drawbacks to raising queue sizes etc. but a queue does help during bursty behaviors and even th… --- ## [Getting additional fields without \_source](https://discuss.elastic.co/t/getting-additional-fields-without-source/242955)
**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\ **Replies:** 6\ **Last updated:** [July 28, 2020, 9:42pm UTC](https://discuss.elastic.co/t/getting-additional-fields-without-source/242955 "2020-07-28T21:42:08Z")
Hi, I was looking for options to improve indexing performance and reduce disk space usage on our ES cluster. When I checked the documentation for the \_source field, I saw the warnings mentioned there. However, it occurr… --- ## [Elasticsearh query tuning](https://discuss.elastic.co/t/elasticsearh-query-tuning/242817)
**Author:** [@Ekta](https://discuss.elastic.co/u/Ekta)\ **Replies:** 1\ **Last updated:** [July 28, 2020, 8:16pm UTC](https://discuss.elastic.co/t/elasticsearh-query-tuning/242817 "2020-07-28T20:16:08Z")
Hi All, Is there any tool for elasticsearch query optimation or any manual way to optimize query running time? --- ## [Why the same logs ingested over multiple index](https://discuss.elastic.co/t/why-the-same-logs-ingested-over-multiple-index/242901)
**Author:** [@anirbandas](https://discuss.elastic.co/u/anirbandas)\ **Replies:** 4\ **Last updated:** [July 28, 2020, 5:23pm UTC](https://discuss.elastic.co/t/why-the-same-logs-ingested-over-multiple-index/242901 "2020-07-28T17:23:28Z")
Hi , Recently we have configured the ELK cluster but when i start the collecting logs through logstash from three log sources like firewall, cisco router and windows server, i can see that that firewall logs ingested to… --- ## [Upgrading 200+ document types in single index from ES 1.4 to ES 7.4](https://discuss.elastic.co/t/upgrading-200-document-types-in-single-index-from-es-1-4-to-es-7-4/242910)
**Author:** [@pavanpatel20](https://discuss.elastic.co/u/pavanpatel20)\ **Replies:** 7\ **Last updated:** [July 28, 2020, 3:59pm UTC](https://discuss.elastic.co/t/upgrading-200-document-types-in-single-index-from-es-1-4-to-es-7-4/242910 "2020-07-28T15:59:19Z")
In my project we are using ES 1.4 and one of our index has around 200 document types. We are now upgrading ES to 7.4 and one of the major problem is removal of document types. We are on single node, so creating 200 indic… --- ## [Different Query Returns for Kibana and FME HTTP Caller](https://discuss.elastic.co/t/different-query-returns-for-kibana-and-fme-http-caller/242926)
**Author:** [@jattoe](https://discuss.elastic.co/u/jattoe)\ **Replies:** 1\ **Last updated:** [July 28, 2020, 3:26pm UTC](https://discuss.elastic.co/t/different-query-returns-for-kibana-and-fme-http-caller/242926 "2020-07-28T15:26:20Z")
I have been using the dev tools console on Kibana to write my queries and make sure everything is working as I would like. You can see an example of the return I get below. I then take this query and put it into an h… --- ## [Search query total hits not adding up when using multiple queries](https://discuss.elastic.co/t/search-query-total-hits-not-adding-up-when-using-multiple-queries/242676)
**Author:** [@antonsamper](https://discuss.elastic.co/u/antonsamper)\ **Replies:** 9\ **Last updated:** [July 28, 2020, 1:13pm UTC](https://discuss.elastic.co/t/search-query-total-hits-not-adding-up-when-using-multiple-queries/242676 "2020-07-28T13:13:50Z")
I have encountered a strange problem whereby the total hits don't seem to be adding up when I use multiple filters. I have an index with around 40 million documents. A typical document looks like something like this: {… --- ## [Why update\_by\_query/delete\_by\_query are taking almost same time with Automatic Slicing & Without Slicing?](https://discuss.elastic.co/t/why-update-by-query-delete-by-query-are-taking-almost-same-time-with-automatic-slicing-without-slicing/242911)
**Author:** [@dillibabu.mekala](https://discuss.elastic.co/u/dillibabu.mekala)\ **Replies:** 0\ **Last updated:** [July 28, 2020, 1:06pm UTC](https://discuss.elastic.co/t/why-update-by-query-delete-by-query-are-taking-almost-same-time-with-automatic-slicing-without-slicing/242911 "2020-07-28T13:06:57Z")
Hi Team, I have gone through the elastic search docx and tried to implement the slicing concept in 2-ways for update\_by\_query/delete\_by\_query. Manual Slicing (https://www.elastic.co/guide/en/elasticsearch/reference/cu… --- ## [How to Merge 2-index data in to One of the two Self Indexes without Re-Indexing to Third Index?](https://discuss.elastic.co/t/how-to-merge-2-index-data-in-to-one-of-the-two-self-indexes-without-re-indexing-to-third-index/242359)
**Author:** [@dillibabu.mekala](https://discuss.elastic.co/u/dillibabu.mekala)\ **Replies:** 1\ **Last updated:** [July 28, 2020, 12:57pm UTC](https://discuss.elastic.co/t/how-to-merge-2-index-data-in-to-one-of-the-two-self-indexes-without-re-indexing-to-third-index/242359 "2020-07-28T12:57:33Z")
Assume i have indices with names carssdata\_original, carssdata\_stage The data in the carsspark\_original is given below. { "\_index": "carssdata\_original", "\_type": "doc", "\_score": 1, "\_source": { "carid": "1", "c… --- ## [Secure elasticstack](https://discuss.elastic.co/t/secure-elasticstack/242752)
**Author:** [@elk6](https://discuss.elastic.co/u/elk6)\ **Replies:** 10\ **Last updated:** [July 28, 2020, 12:10pm UTC](https://discuss.elastic.co/t/secure-elasticstack/242752 "2020-07-28T12:10:23Z")
I have a small cluster that sits on one machine which pulls data from about 5 servers. Now, I was asked to secure the connection and set up a user for when entering Kibana. I read the latest documentation and it seems … --- ## [Rate() function in elasticsearch](https://discuss.elastic.co/t/rate-function-in-elasticsearch/242895)
**Author:** [@Nikparab](https://discuss.elastic.co/u/Nikparab)\ **Replies:** 0\ **Last updated:** [July 28, 2020, 11:53am UTC](https://discuss.elastic.co/t/rate-function-in-elasticsearch/242895 "2020-07-28T11:53:55Z")
I want to query data present in elasticsearch index using grafana. I want to use rate function. The prometheus query is as below. sum (rate (container\_network\_receive\_bytes\_total{image!="",name=~".",namespace=~"$Namespa… --- ## [Elasticsearch query result in xml](https://discuss.elastic.co/t/elasticsearch-query-result-in-xml/242892)
**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\ **Replies:** 2\ **Last updated:** [July 28, 2020, 11:27am UTC](https://discuss.elastic.co/t/elasticsearch-query-result-in-xml/242892 "2020-07-28T11:27:14Z")
Dears, Is there any way to convert result of query (json) to xml format? Best Regards, Daniel --- ## [Elasticsearch analyzing and mapping data](https://discuss.elastic.co/t/elasticsearch-analyzing-and-mapping-data/242601)
**Author:** [@Saber\_Ben\_Njima](https://discuss.elastic.co/u/Saber_Ben_Njima)\ **Replies:** 5\ **Last updated:** [July 28, 2020, 11:20am UTC](https://discuss.elastic.co/t/elasticsearch-analyzing-and-mapping-data/242601 "2020-07-28T11:20:29Z")
{ "\_index" : "filebeat-7.7.0-2020.06.26", "\_type" : "\_doc", "\_id" : "-cmj8HIBlEC9388KS7SY", "\_score" : 1.0, "\_source" : { "message" : "17-02-2020 11:45:55TO -\> | Brand : TT | Channel : di… --- ## [LDAP or AD implementation in ELK](https://discuss.elastic.co/t/ldap-or-ad-implementation-in-elk/241016)
**Author:** [@RajeshKumar](https://discuss.elastic.co/u/RajeshKumar)\ **Replies:** 2\ **Last updated:** [July 28, 2020, 11:13am UTC](https://discuss.elastic.co/t/ldap-or-ad-implementation-in-elk/241016 "2020-07-28T11:13:54Z")
Hi, I'm trying to setup LDAP authentication in my ELK. My Org has AD/LDAP implemented with in same setup. I used the following settings in my elasticsearch.yml xpack.security.enabled: true xpack.security.transport.ssl… --- ## [Tolerance of spelling mistakes when searching with shingles](https://discuss.elastic.co/t/tolerance-of-spelling-mistakes-when-searching-with-shingles/242887)
**Author:** [@LanceWalton](https://discuss.elastic.co/u/LanceWalton)\ **Replies:** 0\ **Last updated:** [July 28, 2020, 10:43am UTC](https://discuss.elastic.co/t/tolerance-of-spelling-mistakes-when-searching-with-shingles/242887 "2020-07-28T10:43:16Z")
Hi. I'm very new to elasticsearch. I hope this is the right forum for asking this question. In https://www.elastic.co/blog/searching-with-shingles, Zachary Tong describes the solution to the problem I have, except at t… --- ## [View query created by HL Rest Client](https://discuss.elastic.co/t/view-query-created-by-hl-rest-client/242870)
**Author:** [@sutty100](https://discuss.elastic.co/u/sutty100)\ **Replies:** 2\ **Last updated:** [July 28, 2020, 10:23am UTC](https://discuss.elastic.co/t/view-query-created-by-hl-rest-client/242870 "2020-07-28T10:23:28Z")
I can't find a way to output the query created by the Java 7.8 High level Rest Client. I want to take the query and explain it/debug it in Kibana dev tools. However without an easy way to output the query being sent to e… --- ## [DSL query aggregation question](https://discuss.elastic.co/t/dsl-query-aggregation-question/242873)
**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\ **Replies:** 0\ **Last updated:** [July 28, 2020, 9:43am UTC](https://discuss.elastic.co/t/dsl-query-aggregation-question/242873 "2020-07-28T09:43:10Z")
Dears, I have some query with aggregation like this: "aggs": { "NAME": { "terms": { "script": "doc\['si.rc.keyword'\].getValue().substring(0,1)", "order": { "\_key": "asc" } … --- ## [ElasticSearch Transform Find Time Difference across documents](https://discuss.elastic.co/t/elasticsearch-transform-find-time-difference-across-documents/242861)
**Author:** [@vihar\_mamania](https://discuss.elastic.co/u/vihar_mamania)\ **Replies:** 1\ **Last updated:** [July 28, 2020, 9:16am UTC](https://discuss.elastic.co/t/elasticsearch-transform-find-time-difference-across-documents/242861 "2020-07-28T09:16:48Z")
I have multiple logs being sent out to Elasticsearch in the following way: { "resourceId" : 12345, "event" : "SUBMITTED/PROCESSING/SUCCESSFUL" "event\_time" : "dateString" } Resource Id w… --- ## [Is there any configuration that can maintain the green status for .security-7 index always?](https://discuss.elastic.co/t/is-there-any-configuration-that-can-maintain-the-green-status-for-security-7-index-always/242834)
**Author:** [@hiruni.insyncit.net](https://discuss.elastic.co/u/hiruni.insyncit.net)\ **Replies:** 6\ **Last updated:** [July 28, 2020, 9:14am UTC](https://discuss.elastic.co/t/is-there-any-configuration-that-can-maintain-the-green-status-for-security-7-index-always/242834 "2020-07-28T09:14:18Z")
Is there any configuration that can maintain the green status for .security-7 index always? --- ## [Pass applied filter value in dashboard in URL field](https://discuss.elastic.co/t/pass-applied-filter-value-in-dashboard-in-url-field/242859)
**Author:** [@ruben.ramirez](https://discuss.elastic.co/u/ruben.ramirez)\ **Replies:** 0\ **Last updated:** [July 28, 2020, 8:14am UTC](https://discuss.elastic.co/t/pass-applied-filter-value-in-dashboard-in-url-field/242859 "2020-07-28T08:14:00Z")
Hi everyone. I want to take the value of the applied filter and enter it in a filter to be applied in the other dashboard. For example I have this filter: And I want to add this value to a link in a url filter field… --- ## [ElasticSearch is being attacked?](https://discuss.elastic.co/t/elasticsearch-is-being-attacked/242727)
**Author:** [@ClubberLang](https://discuss.elastic.co/u/ClubberLang)\ **Replies:** 3\ **Last updated:** [July 28, 2020, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-is-being-attacked/242727 "2020-07-28T08:07:37Z")
Hi, I have installed ES since month now, everything was fine until Friday. Each time, I need to restore ES manually (Delete / Restart / Launch my jobs). But since Friday, after a few hours, everything is down again! M… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=848) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=850)