# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=488 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 489 --- ## [Reading from Elasticsearch index using spark ( es-hadoop ) connectors](https://discuss.elastic.co/t/reading-from-elasticsearch-index-using-spark-es-hadoop-connectors/297590)
**Author:** [@Khushboo\_Kaul](https://discuss.elastic.co/u/Khushboo_Kaul)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 3:04pm UTC](https://discuss.elastic.co/t/reading-from-elasticsearch-index-using-spark-es-hadoop-connectors/297590 "2022-02-22T15:04:39Z")
HI Team, I was trying to read the index from Elasticsearch using es-hadoop connectors using spark using the below code- The index contains millions of records and the read is super slow. is there anything I can do t… --- ## [Elastic with Azure private link](https://discuss.elastic.co/t/elastic-with-azure-private-link/297910)
**Author:** [@Ced](https://discuss.elastic.co/u/Ced)\ **Replies:** 0\ **Last updated:** [February 22, 2022, 2:17pm UTC](https://discuss.elastic.co/t/elastic-with-azure-private-link/297910 "2022-02-22T14:17:17Z")
Hello everybody, I use this link to secure my deployments on Elastic cloud with Azure private link but I can't deploy my elastic agents (error 404). Everything is correct when I didn't use private link and traffic filte… --- ## [Need help with highlight api performance](https://discuss.elastic.co/t/need-help-with-highlight-api-performance/295381)
**Author:** [@SheetalM](https://discuss.elastic.co/u/SheetalM)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 2:14pm UTC](https://discuss.elastic.co/t/need-help-with-highlight-api-performance/295381 "2022-02-22T14:14:01Z")
We are trying to find which fields matched a given user search string that is sent as a query\_string query. We have been using the explain=true in the request, where the response in the explanation section contains each … --- ## [Error while running esrally for benchmarking es](https://discuss.elastic.co/t/error-while-running-esrally-for-benchmarking-es/297862)
**Author:** [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Replies:** 2\ **Last updated:** [February 22, 2022, 1:24pm UTC](https://discuss.elastic.co/t/error-while-running-esrally-for-benchmarking-es/297862 "2022-02-22T13:24:06Z")
Hi All, Getting below error while running esrally on Elasticsearch single node \[WARNING\] Error rate is 100.0 for operation 'refresh-after-index'. Please check the logs. \[WARNING\] No throughput metrics available for \[r… --- ## [How to dynamically add fields to index using the Java Client API?](https://discuss.elastic.co/t/how-to-dynamically-add-fields-to-index-using-the-java-client-api/297342)
**Author:** [@vmassol](https://discuss.elastic.co/u/vmassol)\ **Replies:** 2\ **Last updated:** [February 22, 2022, 1:08pm UTC](https://discuss.elastic.co/t/how-to-dynamically-add-fields-to-index-using-the-java-client-api/297342 "2022-02-22T13:08:48Z")
Hi, I'd like to index some data in a modular way using the new Java Client API and I don't see how to achieve this by passing a Java object. The issue is that this object needs to contain all fields and that doesn't mak… --- ## [Terms aggregation with ICU multi-field and arrays](https://discuss.elastic.co/t/terms-aggregation-with-icu-multi-field-and-arrays/297899)
**Author:** [@mhugo](https://discuss.elastic.co/u/mhugo)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 1:07pm UTC](https://discuss.elastic.co/t/terms-aggregation-with-icu-multi-field-and-arrays/297899 "2022-02-22T13:07:12Z")
Hi. I struggle to sort buckets of a terms aggregation based on ICU collation to respect the ordering of accented words. And especially when some the text field to sort is indexed as arrays. I started with a simple term… --- ## [Rollover between lifecycle states](https://discuss.elastic.co/t/rollover-between-lifecycle-states/297860)
**Author:** [@shinobu](https://discuss.elastic.co/u/shinobu)\ **Replies:** 0\ **Last updated:** [February 22, 2022, 8:32am UTC](https://discuss.elastic.co/t/rollover-between-lifecycle-states/297860 "2022-02-22T08:32:31Z")
Hello, I have configured my indexes to work with ILM policy to automatically move between states like hot and warm. Also I want them to get automatically removed when they get too old. For this the default policies are … --- ## [Manage an Elastic Cloud resource in Azure](https://discuss.elastic.co/t/manage-an-elastic-cloud-resource-in-azure/297240)
**Author:** [@sc12](https://discuss.elastic.co/u/sc12)\ **Replies:** 2\ **Last updated:** [February 22, 2022, 11:59am UTC](https://discuss.elastic.co/t/manage-an-elastic-cloud-resource-in-azure/297240 "2022-02-22T11:59:57Z")
I recently had Elasticsearch deployed on Azure as a marketplace app on a Pay as you go subscription. We were able to install Elastic agents straight from Azure which was a big help for VMs. I have now got the full licens… --- ## [Index does not accept docs from the start](https://discuss.elastic.co/t/index-does-not-accept-docs-from-the-start/296206)
**Author:** [@notgurev](https://discuss.elastic.co/u/notgurev)\ **Replies:** 3\ **Last updated:** [February 22, 2022, 11:44am UTC](https://discuss.elastic.co/t/index-does-not-accept-docs-from-the-start/296206 "2022-02-22T11:44:46Z")
I create indices hourly and bulk insert a lot of data. It usually works well, but I've experienced those spikes where the number of documents just drops to 0. That's when the index is created. What is this? =( The sc… --- ## [Again trying to restore backup from 6.5.11 to 7.16.3](https://discuss.elastic.co/t/again-trying-to-restore-backup-from-6-5-11-to-7-16-3/297863)
**Author:** [@fribse](https://discuss.elastic.co/u/fribse)\ **Replies:** 0\ **Last updated:** [February 22, 2022, 9:27am UTC](https://discuss.elastic.co/t/again-trying-to-restore-backup-from-6-5-11-to-7-16-3/297863 "2022-02-22T09:27:00Z")
So I've finally gotten my Elasticsearch and kibana up and running again, darned that was tough. So I'm back to my real task of trying to figure out how to get my snapshot back into Elasticsearch. I've set up path.repo … --- ## [Indexing slowlog investigation](https://discuss.elastic.co/t/indexing-slowlog-investigation/297752)
**Author:** [@Itay\_Bittan](https://discuss.elastic.co/u/Itay_Bittan)\ **Replies:** 7\ **Last updated:** [February 22, 2022, 9:31am UTC](https://discuss.elastic.co/t/indexing-slowlog-investigation/297752 "2022-02-22T09:31:18Z")
Hi! We have a very old Elasticsearch cluster v1.6.0 (we will hopefully upgrade soon) with 20 nodes: 3 master nodes and 17 data nodes. As a B2B service, each index represents a different business (customer). This clust… --- ## [Elasticsearch.service: Main process exited, code=exited, status=1](https://discuss.elastic.co/t/elasticsearch-service-main-process-exited-code-exited-status-1/297845)
**Author:** [@kiran\_t](https://discuss.elastic.co/u/kiran_t)\ **Replies:** 2\ **Last updated:** [February 22, 2022, 8:33am UTC](https://discuss.elastic.co/t/elasticsearch-service-main-process-exited-code-exited-status-1/297845 "2022-02-22T08:33:17Z")
Hello, Elasticsearch starts failing with following error and then GCP node gets restarted. sudo systemctl status Elasticsearch.service ● elasticsearch.service - Elasticsearch Loaded: loaded (/lib/systemd/system/e… --- ## [Configure multi node configuration with enrollment token - Elasticsearch 8.0.0](https://discuss.elastic.co/t/configure-multi-node-configuration-with-enrollment-token-elasticsearch-8-0-0/297486)
**Author:** [@Abdul\_Gaffar\_Shaikh](https://discuss.elastic.co/u/Abdul_Gaffar_Shaikh)\ **Replies:** 6\ **Last updated:** [February 22, 2022, 7:07am UTC](https://discuss.elastic.co/t/configure-multi-node-configuration-with-enrollment-token-elasticsearch-8-0-0/297486 "2022-02-22T07:07:20Z")
hi team, i am trying to install Elasticsearch 8.0.0 and form a multi node cluster, but using enrollment token , the other node is not accepting and joining the cluster. the error i faced is it does not support multi no… --- ## [Main process exited, code=exited, status=1/FAILURE](https://discuss.elastic.co/t/main-process-exited-code-exited-status-1-failure/297751)
**Author:** [@allamsettiramesh](https://discuss.elastic.co/u/allamsettiramesh)\ **Replies:** 11\ **Last updated:** [February 22, 2022, 6:55am UTC](https://discuss.elastic.co/t/main-process-exited-code-exited-status-1-failure/297751 "2022-02-22T06:55:44Z")
Elasticsearch throwing below issue Version 7.17.0, Job for Elasticsearch.service failed because the control process exited with error code. See "systemctl status Elasticsearch.service" and "journalctl -xe" for detail… --- ## [Is it possible to send email alerts to specific user for their login failure](https://discuss.elastic.co/t/is-it-possible-to-send-email-alerts-to-specific-user-for-their-login-failure/297849)
**Author:** [@calista](https://discuss.elastic.co/u/calista)\ **Replies:** 0\ **Last updated:** [February 22, 2022, 6:27am UTC](https://discuss.elastic.co/t/is-it-possible-to-send-email-alerts-to-specific-user-for-their-login-failure/297849 "2022-02-22T06:27:59Z")
Hi Team, May I check if it is possible to send email alerts to specific user for their OS login failure in the stack management watcher? Example a server has multiple users and when user 'john' login using the wrong pas… --- ## [Detect Open ports](https://discuss.elastic.co/t/detect-open-ports/297832)
**Author:** [@jubin03](https://discuss.elastic.co/u/jubin03)\ **Replies:** 0\ **Last updated:** [February 22, 2022, 4:00am UTC](https://discuss.elastic.co/t/detect-open-ports/297832 "2022-02-22T04:00:18Z")
I have a log message that I get once per day \[timestamp\] | \[host name\]| Open ports: 80, 22,443, 8080 A few days later I found an additional port is open \[timestamp\] | \[host name\]| Open ports: 80, 22,443, 8080, \*\*8220\*… --- ## [How to find some elasticsearch architecture image](https://discuss.elastic.co/t/how-to-find-some-elasticsearch-architecture-image/297692)
**Author:** [@Zephery\_Wen](https://discuss.elastic.co/u/Zephery_Wen)\ **Replies:** 3\ **Last updated:** [February 22, 2022, 2:30am UTC](https://discuss.elastic.co/t/how-to-find-some-elasticsearch-architecture-image/297692 "2022-02-22T02:30:51Z")
I can't find any architecture images about query, write, election and so on in the offical website. I'm a little confused Some articles like this say this image come from the offical website, but i can't find it in the… --- ## [Sending BulkRequest in Java API Client Elasticsearch version 7.16.3](https://discuss.elastic.co/t/sending-bulkrequest-in-java-api-client-elasticsearch-version-7-16-3/297715)
**Author:** [@shanky25](https://discuss.elastic.co/u/shanky25)\ **Replies:** 2\ **Last updated:** [February 22, 2022, 2:48am UTC](https://discuss.elastic.co/t/sending-bulkrequest-in-java-api-client-elasticsearch-version-7-16-3/297715 "2022-02-22T02:48:44Z")
Hi everyone, I have an java application which uses Elasticsearch and RestHighLevelClient. The application simply reads csv files and creates a List of Maps java using Jackson CSV Mapper. After that the Map is indexed … --- ## [How to get date to format correctly](https://discuss.elastic.co/t/how-to-get-date-to-format-correctly/297818)
**Author:** [@gentle\_ghost](https://discuss.elastic.co/u/gentle_ghost)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 1:28am UTC](https://discuss.elastic.co/t/how-to-get-date-to-format-correctly/297818 "2022-02-22T01:28:15Z")
Hello, In transforms can you specify an index template for mappings? Or set the date format? My source index has a timestamp properly formatted using strict\_date\_optional\_time||epoch\_millis. When it goes to the trans… --- ## [How to create my index to not tokenize on slash "/"?](https://discuss.elastic.co/t/how-to-create-my-index-to-not-tokenize-on-slash/297793)
**Author:** [@rakotomandimby](https://discuss.elastic.co/u/rakotomandimby)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 1:23am UTC](https://discuss.elastic.co/t/how-to-create-my-index-to-not-tokenize-on-slash/297793 "2022-02-22T01:23:30Z")
Hello, The default behaviour of ES to tokenize on slash does not suit me, because my data is really full of slashes. Tokenizing on space is more relevent in my case, but how to copy the index with the good tokinizing s… --- ## [ES 7.9.2 Installation failed to upgrade](https://discuss.elastic.co/t/es-7-9-2-installation-failed-to-upgrade/297642)
**Author:** [@Juan\_2022](https://discuss.elastic.co/u/Juan_2022)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 12:23am UTC](https://discuss.elastic.co/t/es-7-9-2-installation-failed-to-upgrade/297642 "2022-02-22T00:23:39Z")
Hi All, I'm using ES 6.8.4 version and wanted to upgrade to 7.9.2 and after running ES installer it fails, the error message is "An error occurred during upgrade!" I appreciate if someone can help me to troubleshoot. … --- ## [Logs are not showing in Kibana only for one application log path](https://discuss.elastic.co/t/logs-are-not-showing-in-kibana-only-for-one-application-log-path/297691)
**Author:** [@rajneesh134](https://discuss.elastic.co/u/rajneesh134)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 12:23am UTC](https://discuss.elastic.co/t/logs-are-not-showing-in-kibana-only-for-one-application-log-path/297691 "2022-02-22T00:23:01Z")
Hi Team, We have done setup for ELK and can see logs for all the applications, But one application logs are not reflecting in Kibana. If we send top command output in same log file , we can see in Kibana. But not sure… --- ## [BulkIndexError: ('2 document(s) failed to index.') Elasticsearch](https://discuss.elastic.co/t/bulkindexerror-2-document-s-failed-to-index-elasticsearch/297682)
**Author:** [@anarchy1923](https://discuss.elastic.co/u/anarchy1923)\ **Replies:** 1\ **Last updated:** [February 22, 2022, 12:22am UTC](https://discuss.elastic.co/t/bulkindexerror-2-document-s-failed-to-index-elasticsearch/297682 "2022-02-22T00:22:08Z")
At first I found some null values in my preprocessed data, so removed those. (Here's my Data Cleaning Code - and the respective outputs enclosed in '''Comments''') Cleaning and Preprocessing df\_merged\[df\_merged.abstrac… --- ## [Starting to plan indexes for many filebeats](https://discuss.elastic.co/t/starting-to-plan-indexes-for-many-filebeats/297820)
**Author:** [@pavvelj](https://discuss.elastic.co/u/pavvelj)\ **Replies:** 0\ **Last updated:** [February 21, 2022, 11:49pm UTC](https://discuss.elastic.co/t/starting-to-plan-indexes-for-many-filebeats/297820 "2022-02-21T23:49:19Z")
Hi, Im planning the way to organizing my data collection in terms of indexing and organizing flows in some way. Im goin to collect large amounts of data of 3 main sorts - system logs, application/proxy/loadbalncer logs a… --- ## [Too\_many\_clauses error in Elasticsearch 6.6.1](https://discuss.elastic.co/t/too-many-clauses-error-in-elasticsearch-6-6-1/297748)
**Author:** [@chaitra\_hegde](https://discuss.elastic.co/u/chaitra_hegde)\ **Replies:** 2\ **Last updated:** [February 21, 2022, 11:23pm UTC](https://discuss.elastic.co/t/too-many-clauses-error-in-elasticsearch-6-6-1/297748 "2022-02-21T23:23:43Z")
Hi, I am using ES 6.6.1. Getting below error too\_many\_clauses: maxClauseCount is set to 1024 From Search Settings | Elasticsearch Guide \[6.6\] | Elastic , In case you consider to increase this setting, make sure you … --- ## [Elastic search backup](https://discuss.elastic.co/t/elastic-search-backup/297718)
**Author:** [@Arpita11](https://discuss.elastic.co/u/Arpita11)\ **Replies:** 4\ **Last updated:** [February 21, 2022, 11:18pm UTC](https://discuss.elastic.co/t/elastic-search-backup/297718 "2022-02-21T23:18:27Z")
Elasticsearch for my project is hosted on AWS EC2 machine. AMI backups are taken for EC2. If the Elasticsearch server goes down, can I restore it from AMI backup and get it working? --- ## [Elasticsearch dashboard not showing results](https://discuss.elastic.co/t/elasticsearch-dashboard-not-showing-results/297757)
**Author:** [@hapkoek](https://discuss.elastic.co/u/hapkoek)\ **Replies:** 1\ **Last updated:** [February 21, 2022, 11:17pm UTC](https://discuss.elastic.co/t/elasticsearch-dashboard-not-showing-results/297757 "2022-02-21T23:17:56Z")
Hi all, Some time ago I created a dashboard with kibana and Elasticsearch importing DMARC mails with parsedmarc. I had some issues with kibana and nginx but those seem to be solved now. But when I open the dashboard, I… --- ## [Histogram range aggragation keys](https://discuss.elastic.co/t/histogram-range-aggragation-keys/297453)
**Author:** [@Akaren](https://discuss.elastic.co/u/Akaren)\ **Replies:** 6\ **Last updated:** [February 21, 2022, 9:01pm UTC](https://discuss.elastic.co/t/histogram-range-aggragation-keys/297453 "2022-02-21T21:01:48Z")
Hi, after update to latest ES version, my range aggregation query started to work weird way. I need histogram with predefine range values. My query looks like: "aggs" : { "agg" : { … --- ## [Too many shards?](https://discuss.elastic.co/t/too-many-shards/297226)
**Author:** [@Samir\_Sabri](https://discuss.elastic.co/u/Samir_Sabri)\ **Replies:** 7\ **Last updated:** [February 21, 2022, 8:25pm UTC](https://discuss.elastic.co/t/too-many-shards/297226 "2022-02-21T20:25:15Z")
Hello We are having unhealthy deployment, I tried to check the shards state, it seems we have too many shards ?? /\_cat/shards?h=index,shard,prirep,state,unassigned.reason The head size we have: "jvm": { "mem":… --- ## [Crash after upgrading to es 8.0.0](https://discuss.elastic.co/t/crash-after-upgrading-to-es-8-0-0/297728)
**Author:** [@ilkkao](https://discuss.elastic.co/u/ilkkao)\ **Replies:** 6\ **Last updated:** [February 21, 2022, 7:47pm UTC](https://discuss.elastic.co/t/crash-after-upgrading-to-es-8-0-0/297728 "2022-02-21T19:47:41Z")
I was about to add a github issue but as I'm not sure what counts as a confirmed bug I report my issue here: I was running es & kibana 7.17.0 and used kibana migration assistant to re-index my main index called "message… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=487) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=489)