# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=903 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 904 --- ## [How to speed up query searching on text on an index with 50M+ documents?](https://discuss.elastic.co/t/how-to-speed-up-query-searching-on-text-on-an-index-with-50m-documents/232329)
**Author:** [@Aurel\_Drejta](https://discuss.elastic.co/u/Aurel_Drejta)\ **Replies:** 12\ **Last updated:** [June 1, 2020, 10:02pm UTC](https://discuss.elastic.co/t/how-to-speed-up-query-searching-on-text-on-an-index-with-50m-documents/232329 "2020-06-01T22:02:34Z")
Hi everyone. I have an index that has roughly 60 million documents in it with more being added to it daily (about half a million every 2-3 months). The field that will be searched in the index is a text field that can … --- ## [How to use elasticsearch-py to test elastic client using authentication](https://discuss.elastic.co/t/how-to-use-elasticsearch-py-to-test-elastic-client-using-authentication/235233)
**Author:** [@JyL](https://discuss.elastic.co/u/JyL)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 8:58pm UTC](https://discuss.elastic.co/t/how-to-use-elasticsearch-py-to-test-elastic-client-using-authentication/235233 "2020-06-01T20:58:40Z")
Hey, I am trying to test elastic client using authentications with the elasticsearch-py. I use the trial license and connect to AD for my team. reference here https://github.com/elastic/elasticsearch-py \>\>\> from elas… --- ## [Remote Elasticsearch/Kibana connection](https://discuss.elastic.co/t/remote-elasticsearch-kibana-connection/235226)
**Author:** [@jshi](https://discuss.elastic.co/u/jshi)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 8:32pm UTC](https://discuss.elastic.co/t/remote-elasticsearch-kibana-connection/235226 "2020-06-01T20:32:56Z")
I just installed elasticsearch and kibana on an ubuntu server hosted on AWS. I configured the kibana.yml file with the server.host as the ip for the server (ie. 12.345.678.901) and also configured the elasticsearch.yml f… --- ## [How to calculate search time spent by Elasticsearch on its inverted index alone?](https://discuss.elastic.co/t/how-to-calculate-search-time-spent-by-elasticsearch-on-its-inverted-index-alone/232962)
**Author:** [@kmdabdulla](https://discuss.elastic.co/u/kmdabdulla)\ **Replies:** 6\ **Last updated:** [June 1, 2020, 8:33pm UTC](https://discuss.elastic.co/t/how-to-calculate-search-time-spent-by-elasticsearch-on-its-inverted-index-alone/232962 "2020-06-01T20:33:41Z")
Took field gives overall search time but is there any way to find the time elasticsearch spends only on its index alone? --- ## [Creating Scripted field by extracting filename from long log message](https://discuss.elastic.co/t/creating-scripted-field-by-extracting-filename-from-long-log-message/235227)
**Author:** [@sarvendras](https://discuss.elastic.co/u/sarvendras)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 8:32pm UTC](https://discuss.elastic.co/t/creating-scripted-field-by-extracting-filename-from-long-log-message/235227 "2020-06-01T20:32:59Z")
HI team, I have to extract substring(some file name) from long log message in a index. I am trying toi create a scripted filed for extracting substring(file name) from long file using below painless script but its not … --- ## [Searchable snapshots with index.store.snapshot.cache.enabled:false. throws error](https://discuss.elastic.co/t/searchable-snapshots-with-index-store-snapshot-cache-enabled-false-throws-error/235209)
**Author:** [@cks](https://discuss.elastic.co/u/cks)\ **Replies:** 1\ **Last updated:** [June 1, 2020, 8:29pm UTC](https://discuss.elastic.co/t/searchable-snapshots-with-index-store-snapshot-cache-enabled-false-throws-error/235209 "2020-06-01T20:29:11Z")
Testing searchable snapshots on Flash based fast NFS gave errors with cache:false Using a 20 node Elastic cluster version 7.5.0, took snapshot of a 3.2TB index (40 shards, no replicas) and stored in NFS mount. Built El… --- ## [One index field update based on some condition on field of another index](https://discuss.elastic.co/t/one-index-field-update-based-on-some-condition-on-field-of-another-index/234702)
**Author:** [@sarvendras](https://discuss.elastic.co/u/sarvendras)\ **Replies:** 5\ **Last updated:** [June 1, 2020, 8:24pm UTC](https://discuss.elastic.co/t/one-index-field-update-based-on-some-condition-on-field-of-another-index/234702 "2020-06-01T20:24:38Z")
Hi Elastic Team, I have two index with below fields. Index1: index1 has 2 below fields. RRN Flag 1 nofraud 2 nofraud 3 nofraud 4 fraud Index2: this has only 1 field RRN 1 2 … --- ## [Restart elasticsearch 7.X with 1 primary and 1 replica](https://discuss.elastic.co/t/restart-elasticsearch-7-x-with-1-primary-and-1-replica/235213)
**Author:** [@linuks](https://discuss.elastic.co/u/linuks)\ **Replies:** 1\ **Last updated:** [June 1, 2020, 7:13pm UTC](https://discuss.elastic.co/t/restart-elasticsearch-7-x-with-1-primary-and-1-replica/235213 "2020-06-01T19:13:41Z")
Hello guys! i have a 3 node Elasticsarch with indexes with 1 primary and 1 replica shards, but for now i want to add path.repo parameter for backup on NFS according to docs, i should restart Elasticsearch one by one nod… --- ## [Where to get synonym.txt file for the english language?](https://discuss.elastic.co/t/where-to-get-synonym-txt-file-for-the-english-language/235202)
**Author:** [@josie\_kat](https://discuss.elastic.co/u/josie_kat)\ **Replies:** 3\ **Last updated:** [June 1, 2020, 5:16pm UTC](https://discuss.elastic.co/t/where-to-get-synonym-txt-file-for-the-english-language/235202 "2020-06-01T17:16:17Z")
"synonym" : { "type" : "synonym", "synonyms\_path" : "analysis/synonym.txt" } } --- ## [Limit Elasticsearch to 512 MB on Kubernetes](https://discuss.elastic.co/t/limit-elasticsearch-to-512-mb-on-kubernetes/234892)
**Author:** [@lucbas](https://discuss.elastic.co/u/lucbas)\ **Replies:** 5\ **Last updated:** [June 1, 2020, 3:51pm UTC](https://discuss.elastic.co/t/limit-elasticsearch-to-512-mb-on-kubernetes/234892 "2020-06-01T15:51:33Z")
Hi all I'm trying to set up elastic search on Kubernetes (GKE) and try to limit its memory usage to max 512MB (or even lower). Performance is not that crucial for us, we just need to run some Jaeger queries from time t… --- ## [Help forming a cluster](https://discuss.elastic.co/t/help-forming-a-cluster/235172)
**Author:** [@Kevin\_M](https://discuss.elastic.co/u/Kevin_M)\ **Replies:** 7\ **Last updated:** [June 1, 2020, 3:06pm UTC](https://discuss.elastic.co/t/help-forming-a-cluster/235172 "2020-06-01T15:06:24Z")
Hey I am loosing my mind over this, I have 3 VMs on the same ESXI host in the same subnet. All have firewalld disabled and SElinux disabled. I can telnet on port 9300 from all hosts to all hosts in all directions. The cl… --- ## [Explain API with DFS](https://discuss.elastic.co/t/explain-api-with-dfs/235184)
**Author:** [@riverbuilding](https://discuss.elastic.co/u/riverbuilding)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 2:37pm UTC](https://discuss.elastic.co/t/explain-api-with-dfs/235184 "2020-06-01T14:37:46Z")
as we know that explain API can be used to demonstrate the detail score info, but when use DFS to search, is it possible to gain the DFS part info when use explain API? --- ## [How to implement Filters with ElasticSearch 7 and NEST 7](https://discuss.elastic.co/t/how-to-implement-filters-with-elasticsearch-7-and-nest-7/235166)
**Author:** [@Isanka\_Thalagala](https://discuss.elastic.co/u/Isanka_Thalagala)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 12:46pm UTC](https://discuss.elastic.co/t/how-to-implement-filters-with-elasticsearch-7-and-nest-7/235166 "2020-06-01T12:46:51Z")
I'm using ElarsticSearch 7.7 & NEST 7.7 and I'm trying to filter data by some fields. As of 1st try, I need to filter by delivery dates. it returns documents by the search query.But when I add deliveryFilter I'm getti… --- ## [Search for slash only](https://discuss.elastic.co/t/search-for-slash-only/235160)
**Author:** [@AsfK](https://discuss.elastic.co/u/AsfK)\ **Replies:** 1\ **Last updated:** [June 1, 2020, 1:38pm UTC](https://discuss.elastic.co/t/search-for-slash-only/235160 "2020-06-01T13:38:49Z")
Hello! Looking for date contains slash return a document: GET /cdata\*/\_search { "query": { "query\_string": { "fields": \[ "callStartDate" \], "query": "3/24/2020", "analy… --- ## [Filter keep\_types not working with pattern tokenizer](https://discuss.elastic.co/t/filter-keep-types-not-working-with-pattern-tokenizer/235171)
**Author:** [@alembfilho](https://discuss.elastic.co/u/alembfilho)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 1:08pm UTC](https://discuss.elastic.co/t/filter-keep-types-not-working-with-pattern-tokenizer/235171 "2020-06-01T13:08:25Z")
Hello, I am having a problem using the "keep\_types" filter with a "pattern" tokenizer, here is an example: { "tokenizer": { "type": "pattern", "pattern": "\[()., \_-\]" }, "filter": \[ … --- ## [How to read JSON string in message field](https://discuss.elastic.co/t/how-to-read-json-string-in-message-field/235167)
**Author:** [@Ankit\_S](https://discuss.elastic.co/u/Ankit_S)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 12:47pm UTC](https://discuss.elastic.co/t/how-to-read-json-string-in-message-field/235167 "2020-06-01T12:47:48Z")
Hello, I have a message field having JSON string I need to filter records based on that keys of that JSON. Following is my message field having JSON string "\_source": { "@timestamp": "2020-06-01T11:30:01.081Z", "lev… --- ## [Top hits query working very slow while retrieving data](https://discuss.elastic.co/t/top-hits-query-working-very-slow-while-retrieving-data/235165)
**Author:** [@pooja\_sanga](https://discuss.elastic.co/u/pooja_sanga)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 12:46pm UTC](https://discuss.elastic.co/t/top-hits-query-working-very-slow-while-retrieving-data/235165 "2020-06-01T12:46:17Z")
Hi, I have a nested index with 27627 records. I running the following query and getting the result in 34s if i put size=100. If i run the query for size-2/3 i get the result in about 1s. If i run the same query without … --- ## [Backup ElasticSearch data using GCS unexpectedly crashed](https://discuss.elastic.co/t/backup-elasticsearch-data-using-gcs-unexpectedly-crashed/235162)
**Author:** [@Ab\_Avramidis](https://discuss.elastic.co/u/Ab_Avramidis)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 12:37pm UTC](https://discuss.elastic.co/t/backup-elasticsearch-data-using-gcs-unexpectedly-crashed/235162 "2020-06-01T12:37:03Z")
Hi, I had set up ES automatically to make backup of the indices to a Google Cloud Storage repo. Everything was working fine until unexpectedly crashed. I executed the command "elasticsearch-keystore list"to list the a… --- ## [Will analyzers applicable to existing documents?](https://discuss.elastic.co/t/will-analyzers-applicable-to-existing-documents/234918)
**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\ **Replies:** 2\ **Last updated:** [June 1, 2020, 11:46am UTC](https://discuss.elastic.co/t/will-analyzers-applicable-to-existing-documents/234918 "2020-06-01T11:46:56Z")
Hi Team, Hope you are doing great..! I'm new to elasticsearch. I have an index with 100 document's. Now as per customer requirement i have created a new custom analyzer, now my question is i want that 100 documents ana… --- ## [RestClient Connection reset by peer](https://discuss.elastic.co/t/restclient-connection-reset-by-peer/235134)
**Author:** [@wmj765](https://discuss.elastic.co/u/wmj765)\ **Replies:** 2\ **Last updated:** [June 1, 2020, 11:17am UTC](https://discuss.elastic.co/t/restclient-connection-reset-by-peer/235134 "2020-06-01T11:17:10Z")
Hi , when using RestHighLevelClient , often the requests to Elasticsearch (index search, index requests etc) fail due to connection problems. java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImp… --- ## [Get data primary key](https://discuss.elastic.co/t/get-data-primary-key/235128)
**Author:** [@freesinger](https://discuss.elastic.co/u/freesinger)\ **Replies:** 1\ **Last updated:** [June 1, 2020, 9:19am UTC](https://discuss.elastic.co/t/get-data-primary-key/235128 "2020-06-01T09:19:52Z")
Hi, I am handling how to find the primary key of data in ES index. I know that ES has \_id to represent each document's unique id, but the problem is that when I handling the data which has been stored in ES, the data ma… --- ## [How to trigger "indexing.index\_failed" stat](https://discuss.elastic.co/t/how-to-trigger-indexing-index-failed-stat/235133)
**Author:** [@vakhtang](https://discuss.elastic.co/u/vakhtang)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 8:23am UTC](https://discuss.elastic.co/t/how-to-trigger-indexing-index-failed-stat/235133 "2020-06-01T08:23:35Z")
Hello, One of the stats, that we can receive from the \_cat/indices API, is indexing.index\_failed. In the documentation, this stat describes as: "Number of failed indexing operations". How can I trigger this stat? I t… --- ## [How can I export all documents in an index for later reuse?](https://discuss.elastic.co/t/how-can-i-export-all-documents-in-an-index-for-later-reuse/234701)
**Author:** [@eizquierdo](https://discuss.elastic.co/u/eizquierdo)\ **Replies:** 1\ **Last updated:** [June 1, 2020, 8:01am UTC](https://discuss.elastic.co/t/how-can-i-export-all-documents-in-an-index-for-later-reuse/234701 "2020-06-01T08:01:26Z")
What I’m looking for is exactly what Kibana does when installing sample data. It imports all the data of the samples and updates the timestamp relative to current time: https://www.elastic.co/guide/en/kibana/master/gett… --- ## [Indies turn to red status and unable to connect after removing monitor-es-\*](https://discuss.elastic.co/t/indies-turn-to-red-status-and-unable-to-connect-after-removing-monitor-es/235002)
**Author:** [@Huy\_Le1](https://discuss.elastic.co/u/Huy_Le1)\ **Replies:** 6\ **Last updated:** [June 1, 2020, 7:01am UTC](https://discuss.elastic.co/t/indies-turn-to-red-status-and-unable-to-connect-after-removing-monitor-es/235002 "2020-06-01T07:01:30Z")
Hi, I've removed some .monitoring-es-\* indexes cause they are too large and I never use them. After that, all indexes were created on the same day as those .monitoring-es-\* indexes turned to red and unable to connect. … --- ## [Using a custom HttpTransport in ElasticSearch](https://discuss.elastic.co/t/using-a-custom-httptransport-in-elasticsearch/235117)
**Author:** [@rahulkarajgikar](https://discuss.elastic.co/u/rahulkarajgikar)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 6:30am UTC](https://discuss.elastic.co/t/using-a-custom-httptransport-in-elasticsearch/235117 "2020-06-01T06:30:26Z")
Hi everyone, So I've created a NetworkPlugin that uses a custom HttpTransport. I've also registered it using NetworkPlugin.getHttpTransports(). However, when I install this plugin and run ES, it doesn't seem to be using… --- ## [Normalizer and query speed](https://discuss.elastic.co/t/normalizer-and-query-speed/235113)
**Author:** [@Jose\_Salgodo](https://discuss.elastic.co/u/Jose_Salgodo)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 5:50am UTC](https://discuss.elastic.co/t/normalizer-and-query-speed/235113 "2020-06-01T05:50:00Z")
do normalizer's effect the speed of match querys --- ## [Copy live data between clusters](https://discuss.elastic.co/t/copy-live-data-between-clusters/234083)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 2\ **Last updated:** [June 1, 2020, 4:53am UTC](https://discuss.elastic.co/t/copy-live-data-between-clusters/234083 "2020-06-01T04:53:01Z")
Hi, I would like to copy indices/data between 2 clusters. For example, copy every 1/2/15 minutes the data from the index in cluster1 to cluster2. I would like the data to be live or near live in cluster2. So if a doc… --- ## [ILM Policy Shard Allocation on the same node](https://discuss.elastic.co/t/ilm-policy-shard-allocation-on-the-same-node/229928)
**Author:** [@DawitCh](https://discuss.elastic.co/u/DawitCh)\ **Replies:** 2\ **Last updated:** [June 1, 2020, 3:18am UTC](https://discuss.elastic.co/t/ilm-policy-shard-allocation-on-the-same-node/229928 "2020-06-01T03:18:44Z")
Have I already try to look at this kind of question in the community? I would say yes. Most of them got red status cluster, but in my case There are 3 nodes HOT WARM COLD respectively from node 1 to node 3 I add d… --- ## [Preventing / Throttling of excessive document spam from buggy forwarding agent / service](https://discuss.elastic.co/t/preventing-throttling-of-excessive-document-spam-from-buggy-forwarding-agent-service/235100)
**Author:** [@Dandy](https://discuss.elastic.co/u/Dandy)\ **Replies:** 0\ **Last updated:** [June 1, 2020, 1:20am UTC](https://discuss.elastic.co/t/preventing-throttling-of-excessive-document-spam-from-buggy-forwarding-agent-service/235100 "2020-06-01T01:20:38Z")
I have a scenario where a buggy service spammed about 3,000x more logs then expected and basically caused a massive cascading issue where document bulk tasks were taking 20minutes+ to process and incoming logs were just … --- ## [Conditional query in elasticsearch](https://discuss.elastic.co/t/conditional-query-in-elasticsearch/235085)
**Author:** [@yazhini\_ravi](https://discuss.elastic.co/u/yazhini_ravi)\ **Replies:** 0\ **Last updated:** [May 31, 2020, 7:19pm UTC](https://discuss.elastic.co/t/conditional-query-in-elasticsearch/235085 "2020-05-31T19:19:54Z")
Hi, I'm using ES 5.5 and having a query dsl with javasript API request like this client.search({ index: 'demo', type: 'sample', body: { "query": { "bool" : { "must": \[{ "match": { "CityName": { query: req.p… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=902) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=904)