# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=917 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 918 --- ## [ML Jobs Permissions](https://discuss.elastic.co/t/ml-jobs-permissions/229578)
**Author:** [@KoettingSimon](https://discuss.elastic.co/u/KoettingSimon)\ **Replies:** 5\ **Last updated:** [May 19, 2020, 11:22am UTC](https://discuss.elastic.co/t/ml-jobs-permissions/229578 "2020-05-19T11:22:52Z")
Hi All, Im playing arround with the ML-Feature of the Elastic Stack. We use our Stack with multiple Kibana Spaces/Indicies. So person A has access to Index A and Space A, person B has access to Index B and Space B and… --- ## [How to inprove the cpu usage?](https://discuss.elastic.co/t/how-to-inprove-the-cpu-usage/233277)
**Author:** [@ted\_ye](https://discuss.elastic.co/u/ted_ye)\ **Replies:** 5\ **Last updated:** [May 19, 2020, 11:10am UTC](https://discuss.elastic.co/t/how-to-inprove-the-cpu-usage/233277 "2020-05-19T11:10:01Z")
hello, I have a server with 40 cpu cores and 126GB memory, I installed three elasticsearch data nodes on this server, but I found that the total cpu usage is very low. So how to inprove the cpu usage of elasticsearch, c… --- ## [Extract portion of string from log file](https://discuss.elastic.co/t/extract-portion-of-string-from-log-file/233294)
**Author:** [@muthucse](https://discuss.elastic.co/u/muthucse)\ **Replies:** 0\ **Last updated:** [May 19, 2020, 10:22am UTC](https://discuss.elastic.co/t/extract-portion-of-string-from-log-file/233294 "2020-05-19T10:22:51Z")
Trying to process the IIS logs. Need to extract the URL extensions to generate dashboard. This is to perform aggregations on how many documents has .png extension and how many comes with .jpeg extension ? URL: /image.pn… --- ## [Fd pings start timing out, causing multiple nodes to be kicked out and cluster going red](https://discuss.elastic.co/t/fd-pings-start-timing-out-causing-multiple-nodes-to-be-kicked-out-and-cluster-going-red/233293)
**Author:** [@shwetathareja](https://discuss.elastic.co/u/shwetathareja)\ **Replies:** 0\ **Last updated:** [May 19, 2020, 10:18am UTC](https://discuss.elastic.co/t/fd-pings-start-timing-out-causing-multiple-nodes-to-be-kicked-out-and-cluster-going-red/233293 "2020-05-19T10:18:07Z")
Hi Team, ES version: 6.8 No. of nodes: 103 No. of shards: ~10K We are observing an issue in this cluster where fd pings will start failing (due to timeout) with 3 retries on both master and data node. This would resu… --- ## [Query On Composite Aggregation](https://discuss.elastic.co/t/query-on-composite-aggregation/233292)
**Author:** [@ananth](https://discuss.elastic.co/u/ananth)\ **Replies:** 0\ **Last updated:** [May 19, 2020, 10:16am UTC](https://discuss.elastic.co/t/query-on-composite-aggregation/233292 "2020-05-19T10:16:11Z")
Hi, Is the composite Aggregation keeps any meta in memory? or keep the search context open similarly to what scroll does? In other terms, Is the 'after\_key' used as one of the criteria along with the original query? A… --- ## [Elasticsearch dump using python](https://discuss.elastic.co/t/elasticsearch-dump-using-python/233254)
**Author:** [@vikasmastud](https://discuss.elastic.co/u/vikasmastud)\ **Replies:** 4\ **Last updated:** [May 19, 2020, 9:47am UTC](https://discuss.elastic.co/t/elasticsearch-dump-using-python/233254 "2020-05-19T09:47:36Z")
i am trying to dump elastic search from one Elasticsearch and import this dump to different Elasticsearch is there any way to do that using python --- ## [Sending data to elasticsearch](https://discuss.elastic.co/t/sending-data-to-elasticsearch/232941)
**Author:** [@nityaraj06](https://discuss.elastic.co/u/nityaraj06)\ **Replies:** 19\ **Last updated:** [May 19, 2020, 8:43am UTC](https://discuss.elastic.co/t/sending-data-to-elasticsearch/232941 "2020-05-19T08:43:25Z")
Hi, Below is the configuration I have for my 2 node elasticsearch cluster. Pls let me know how I should configure the logstash elasticsearch output. Should the data be sent to both the below nodes? I am fully aware th… --- ## [Upgrade to 7.7 removed LOGSTASH\_KEYSTORE\_PASS= from /etc/default/logstash - Keystore](https://discuss.elastic.co/t/upgrade-to-7-7-removed-logstash-keystore-pass-from-etc-default-logstash-keystore/233280)
**Author:** [@probson](https://discuss.elastic.co/u/probson)\ **Replies:** 0\ **Last updated:** [May 19, 2020, 8:42am UTC](https://discuss.elastic.co/t/upgrade-to-7-7-removed-logstash-keystore-pass-from-etc-default-logstash-keystore/233280 "2020-05-19T08:42:46Z")
Hi, I upgraded to 7.7 from 7.6.1 yesterday, i have been using the keystore in logstash and storing the value in /etc/default/logstash. After upgrading i had some fun with Logstash not staring, the LOGSTASH\_KEYSTORE\_PA… --- ## [How does the intervals query resolve the need for first manually breaking up a search text into phrases?](https://discuss.elastic.co/t/how-does-the-intervals-query-resolve-the-need-for-first-manually-breaking-up-a-search-text-into-phrases/233274)
**Author:** [@gideongrossman](https://discuss.elastic.co/u/gideongrossman)\ **Replies:** 0\ **Last updated:** [May 19, 2020, 8:21am UTC](https://discuss.elastic.co/t/how-does-the-intervals-query-resolve-the-need-for-first-manually-breaking-up-a-search-text-into-phrases/233274 "2020-05-19T08:21:36Z")
How does the interval query handle the issue described here? https://github.com/elastic/elasticsearch/issues/16796 Don't we still need to break up our search text into phrases before passing them into the intervals query… --- ## [X-Pack Installation with Elasticsearch and Graylog](https://discuss.elastic.co/t/x-pack-installation-with-elasticsearch-and-graylog/232195)
**Author:** [@rafaelcabralvo](https://discuss.elastic.co/u/rafaelcabralvo)\ **Replies:** 10\ **Last updated:** [May 19, 2020, 7:38am UTC](https://discuss.elastic.co/t/x-pack-installation-with-elasticsearch-and-graylog/232195 "2020-05-19T07:38:50Z")
Hello, I am trying to install x-pack in elasticsearch trough debian 9. But I am not using Kibana as web interface, I'm using Graylog. I found something like this: But that didn't worked. There came an error when I t… --- ## [Elasticsearch Keystore Authentication Failure](https://discuss.elastic.co/t/elasticsearch-keystore-authentication-failure/233259)
**Author:** [@Aidan\_Li](https://discuss.elastic.co/u/Aidan_Li)\ **Replies:** 0\ **Last updated:** [May 19, 2020, 7:19am UTC](https://discuss.elastic.co/t/elasticsearch-keystore-authentication-failure/233259 "2020-05-19T07:19:18Z")
I have a GCP bucket, and machines running with ES 7.6.1 in two separate clusters: cluster 0, with machines "machine 0" cluster 1, with machines "machine 1" GCP Bucket My goal is: register a repository with this GCP … --- ## [Grafana can't see ES indexes](https://discuss.elastic.co/t/grafana-cant-see-es-indexes/233170)
**Author:** [@Albert\_Aleksandrov](https://discuss.elastic.co/u/Albert_Aleksandrov)\ **Replies:** 2\ **Last updated:** [May 19, 2020, 6:18am UTC](https://discuss.elastic.co/t/grafana-cant-see-es-indexes/233170 "2020-05-19T06:18:30Z")
Hi all! Just started using Grafana + ES. I run ES in docker: docker run -d --name es -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elasticsearch:7.7.0 Then generated some … --- ## [SAML role mapping with wildcard](https://discuss.elastic.co/t/saml-role-mapping-with-wildcard/233107)
**Author:** [@raphperrin](https://discuss.elastic.co/u/raphperrin)\ **Replies:** 4\ **Last updated:** [May 19, 2020, 6:18am UTC](https://discuss.elastic.co/t/saml-role-mapping-with-wildcard/233107 "2020-05-19T06:18:10Z")
Hi I am configuring role mapping on my cluster. As the user has multiple roles/groupes, I am trying to map the role with wildcard. How should I do it ? From the API : POST /\_xpack/security/role\_mapping/plateform-admi… --- ## [Elasticsearch query is too slow](https://discuss.elastic.co/t/elasticsearch-query-is-too-slow/233003)
**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\ **Replies:** 4\ **Last updated:** [May 19, 2020, 6:10am UTC](https://discuss.elastic.co/t/elasticsearch-query-is-too-slow/233003 "2020-05-19T06:10:54Z")
Hi , I am using a python script to pull the data from elasticsearch and process it. It has around 5000k records , but it's more then 24 hrs and it's still running. What i can do to make it fast. Here is the query I am … --- ## [Restart on daily basis](https://discuss.elastic.co/t/restart-on-daily-basis/233116)
**Author:** [@mu44ly](https://discuss.elastic.co/u/mu44ly)\ **Replies:** 6\ **Last updated:** [May 19, 2020, 5:51am UTC](https://discuss.elastic.co/t/restart-on-daily-basis/233116 "2020-05-19T05:51:10Z")
Hello everyone, Recently we got issues with circuit.breaker exception on multiple clusters, right after upgrade from 6.8 to 7.4. It was found that problem can be fixed by jvm option tuning. However, due to other issues … --- ## [Encryption at rest support in x-pack platinum](https://discuss.elastic.co/t/encryption-at-rest-support-in-x-pack-platinum/100111)
**Author:** [@nkoothrappahli](https://discuss.elastic.co/u/nkoothrappahli)\ **Replies:** 3\ **Last updated:** [May 19, 2020, 5:49am UTC](https://discuss.elastic.co/t/encryption-at-rest-support-in-x-pack-platinum/100111 "2020-05-19T05:49:17Z")
According to https://www.elastic.co/subscriptions there is "Encryption at rest support" in Platinum x-pack security (formerly Shield). I cannot find any documentation about it or how to enable or configure it. Can you pl… --- ## [Get a list of dashboards](https://discuss.elastic.co/t/get-a-list-of-dashboards/233031)
**Author:** [@mudricd](https://discuss.elastic.co/u/mudricd)\ **Replies:** 3\ **Last updated:** [May 19, 2020, 5:00am UTC](https://discuss.elastic.co/t/get-a-list-of-dashboards/233031 "2020-05-19T05:00:37Z")
I am trying to get a list of dashboards. Here is my command: curl -u 'elastic:xxxxx' -XGET --cacert /opt/ssl-certs/client-ca.cer -s https://x.x.x.x:9201/.kibana/\_search?type=dashboard&size=40 | grep Metricbeat But all… --- ## [No highlighting with intervals/fuzzy queries](https://discuss.elastic.co/t/no-highlighting-with-intervals-fuzzy-queries/229259)
**Author:** [@val](https://discuss.elastic.co/u/val)\ **Replies:** 6\ **Last updated:** [May 19, 2020, 3:30am UTC](https://discuss.elastic.co/t/no-highlighting-with-intervals-fuzzy-queries/229259 "2020-05-19T03:30:31Z")
In a recent feature request, the intervals query was extended to support fuzzy rules. I'm now trying to figure out why highlighting doesn't work with intervals/fuzzy whereas it does work with intervals/match and span\_ne… --- ## [Translog files not clearing, each associated with an open file descriptor](https://discuss.elastic.co/t/translog-files-not-clearing-each-associated-with-an-open-file-descriptor/231791)
**Author:** [@hhsuey](https://discuss.elastic.co/u/hhsuey)\ **Replies:** 7\ **Last updated:** [May 19, 2020, 3:14am UTC](https://discuss.elastic.co/t/translog-files-not-clearing-each-associated-with-an-open-file-descriptor/231791 "2020-05-19T03:14:12Z")
One of our clusters is in a bad state where the nodes appear to have thousands of file descriptors open. I found out there are many open translog files since filename translog-1 and now up to translog-2358. Every hour ab… --- ## [Why my query matching too slow ? Urgent project need help please](https://discuss.elastic.co/t/why-my-query-matching-too-slow-urgent-project-need-help-please/233216)
**Author:** [@Newbieuser](https://discuss.elastic.co/u/Newbieuser)\ **Replies:** 3\ **Last updated:** [May 19, 2020, 1:23am UTC](https://discuss.elastic.co/t/why-my-query-matching-too-slow-urgent-project-need-help-please/233216 "2020-05-19T01:23:29Z")
So i made indice like this(via python, language not important just want to see mapping scheme); \`\`\`def index\_create(es, index\_name): # create an empty index with the defined mapping - no documents added if not es.indice… --- ## [What are the fields in the text field of this index mapping?](https://discuss.elastic.co/t/what-are-the-fields-in-the-text-field-of-this-index-mapping/233202)
**Author:** [@aorona](https://discuss.elastic.co/u/aorona)\ **Replies:** 2\ **Last updated:** [May 18, 2020, 11:57pm UTC](https://discuss.elastic.co/t/what-are-the-fields-in-the-text-field-of-this-index-mapping/233202 "2020-05-18T23:57:31Z")
"mappings": { "my\_doc": { "properties": { "content": { "type": "text", "fields": { "ngram": { "type": "text", … --- ## [Allow read only access to a specific kibana dashboard](https://discuss.elastic.co/t/allow-read-only-access-to-a-specific-kibana-dashboard/233173)
**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\ **Replies:** 3\ **Last updated:** [May 18, 2020, 11:24pm UTC](https://discuss.elastic.co/t/allow-read-only-access-to-a-specific-kibana-dashboard/233173 "2020-05-18T23:24:11Z")
Hello, Is it possible to give only read access to a specific dashboard in Kibana for a set of users? Any advice is much appreciated --- ## [Weekly index with date\_index\_name processor](https://discuss.elastic.co/t/weekly-index-with-date-index-name-processor/233215)
**Author:** [@Arol](https://discuss.elastic.co/u/Arol)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 10:56pm UTC](https://discuss.elastic.co/t/weekly-index-with-date-index-name-processor/233215 "2020-05-18T22:56:08Z")
I implement weakly-routing using elaticsearch processors. I need to generate the formy index yyyy-MM-W, i.e. for the date 05/19/2020, the index -2020-05-4 must be created. I use the processor: "date\_index\_name" … --- ## [Python Elasticsearch Client Authentication - Connection Refused](https://discuss.elastic.co/t/python-elasticsearch-client-authentication-connection-refused/233211)
**Author:** [@Fernando1](https://discuss.elastic.co/u/Fernando1)\ **Replies:** 2\ **Last updated:** [May 18, 2020, 10:46pm UTC](https://discuss.elastic.co/t/python-elasticsearch-client-authentication-connection-refused/233211 "2020-05-18T22:46:56Z")
Hello!! How is going? I'm using python client to connect to my elasticsearch database host at IBM Cloud's Openshift Instance. Then when I try to connect to it I got several errors. About my elasticsearch database: Ve… --- ## [Error Visualization Request Timeout](https://discuss.elastic.co/t/error-visualization-request-timeout/233184)
**Author:** [@nzn\_cngz](https://discuss.elastic.co/u/nzn_cngz)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 7:12pm UTC](https://discuss.elastic.co/t/error-visualization-request-timeout/233184 "2020-05-18T19:12:34Z")
Hi all, @Christian\_Dahlqvist @Lukas Olson On cluster fluentbit send log fluentd ant then elasticsearch visualize to Kibana. EFK stack summary topology elastic master(3 node) -Xms 1G -Xmx 8G elastic data(3 node)--\>p… --- ## [How to query dynamic index settings?](https://discuss.elastic.co/t/how-to-query-dynamic-index-settings/233181)
**Author:** [@rgelb](https://discuss.elastic.co/u/rgelb)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 7:07pm UTC](https://discuss.elastic.co/t/how-to-query-dynamic-index-settings/233181 "2020-05-18T19:07:03Z")
Index Modules page lists all the available settings for an index. How do i query them? For instance, I'd like to know the setting for max\_result\_window. --- ## [Elasticsearch Gist Operator so you can declare your indices and templates as a Kubernetes custom resource, feedback welcome!](https://discuss.elastic.co/t/elasticsearch-gist-operator-so-you-can-declare-your-indices-and-templates-as-a-kubernetes-custom-resource-feedback-welcome/233175)
**Author:** [@frankkoornstra](https://discuss.elastic.co/u/frankkoornstra)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 6:24pm UTC](https://discuss.elastic.co/t/elasticsearch-gist-operator-so-you-can-declare-your-indices-and-templates-as-a-kubernetes-custom-resource-feedback-welcome/233175 "2020-05-18T18:24:35Z")
Hi :wave: Just wanted to let you know that I've released the first alpha version of a new Kubernetes Operator that manages the gist of the cluster, namely indices and templates (so far). You can find it here: https://gi… --- ## [MultiMatchQuery useDisMax](https://discuss.elastic.co/t/multimatchquery-usedismax/233172)
**Author:** [@Dave\_Maiman](https://discuss.elastic.co/u/Dave_Maiman)\ **Replies:** 0\ **Last updated:** [May 18, 2020, 6:12pm UTC](https://discuss.elastic.co/t/multimatchquery-usedismax/233172 "2020-05-18T18:12:51Z")
Hello, We are in the process of upgrading to elastic cloud 7.x from 1.6. We have code that creates a MultiMatchQuery as follows: QueryBuilders.multiMatchQuery(searchQuery, ElasticQueryCreator.SEARCH\_FIELDS) … --- ## [Why is my index not growing past 4GB when using fscrawler?](https://discuss.elastic.co/t/why-is-my-index-not-growing-past-4gb-when-using-fscrawler/232838)
**Author:** [@Denn](https://discuss.elastic.co/u/Denn)\ **Replies:** 6\ **Last updated:** [May 18, 2020, 5:43pm UTC](https://discuss.elastic.co/t/why-is-my-index-not-growing-past-4gb-when-using-fscrawler/232838 "2020-05-18T17:43:59Z")
So I am trying to index about 2.5TB of data using fscrawler that is about 3 million files.. I have 40GB of ram of which I have set aside 20GB heap for fscrawler for maximum throughput. C:\\Elastic\\fscrawler-MAR15\\bin\>fsc… --- ## [Query to get and Sort based on Most occurrence of a field value](https://discuss.elastic.co/t/query-to-get-and-sort-based-on-most-occurrence-of-a-field-value/233004)
**Author:** [@KVN\_REDDY](https://discuss.elastic.co/u/KVN_REDDY)\ **Replies:** 1\ **Last updated:** [May 18, 2020, 5:28pm UTC](https://discuss.elastic.co/t/query-to-get-and-sort-based-on-most-occurrence-of-a-field-value/233004 "2020-05-18T17:28:23Z")
Hi, I am working on Recommendation engine where trying to retrieve the purchase data, I need to sort the data based on most occurrence means in order index productId is one of the field. For ex : o111, prod111, o222,… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=916) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=918)