# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=870 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 871 --- ## [Upgrade elasticsearch from 6.8 to 7.8 date format](https://discuss.elastic.co/t/upgrade-elasticsearch-from-6-8-to-7-8-date-format/240072)
**Author:** [@krishm](https://discuss.elastic.co/u/krishm)\ **Replies:** 0\ **Last updated:** [July 7, 2020, 1:18am UTC](https://discuss.elastic.co/t/upgrade-elasticsearch-from-6-8-to-7-8-date-format/240072 "2020-07-07T01:18:25Z")
Hello There, I am working on elasticsearch upgrade from 6.8 to 7.x. i have a date field using format below and i understand that i need to change the mapping to "uuuu-MM-dd HH:mm:ss" before upgrading to elasticsearch 7.… --- ## [ML jobs with missing documents](https://discuss.elastic.co/t/ml-jobs-with-missing-documents/239966)
**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\ **Replies:** 2\ **Last updated:** [July 6, 2020, 11:58pm UTC](https://discuss.elastic.co/t/ml-jobs-with-missing-documents/239966 "2020-07-06T23:58:32Z")
We have some jobs running with high numbers of documents missing. As per elastic ML documents, those checks are done after buckets with the missed documents have been processed and anomaly scores are finalized and “If th… --- ## [Customized document to term scoring](https://discuss.elastic.co/t/customized-document-to-term-scoring/239559)
**Author:** [@snakeztc](https://discuss.elastic.co/u/snakeztc)\ **Replies:** 0\ **Last updated:** [July 2, 2020, 12:49am UTC](https://discuss.elastic.co/t/customized-document-to-term-scoring/239559 "2020-07-02T00:49:22Z")
Hi, I am using ES to do research for my learning to rank algorithm. Essentially instead of using TF-IDF or BM25, my scoring function looks like: TF(D, t) = model(D, t) where t is each term in the document. Instead of j… --- ## [ILM run after a change](https://discuss.elastic.co/t/ilm-run-after-a-change/239576)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 0\ **Last updated:** [July 2, 2020, 6:50am UTC](https://discuss.elastic.co/t/ilm-run-after-a-change/239576 "2020-07-02T06:50:32Z")
hello, I have changed the ILM policy, and added a warm/cold phases after 30 days. is there a way to run it over all current indices, so they will be moved to warm/cold storage? for example for this one: GET data-8-00… --- ## [Elk API , scheduled task, Empty Response from search](https://discuss.elastic.co/t/elk-api-scheduled-task-empty-response-from-search/239588)
**Author:** [@itamar\_medyoni](https://discuss.elastic.co/u/itamar_medyoni)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 11:19pm UTC](https://discuss.elastic.co/t/elk-api-scheduled-task-empty-response-from-search/239588 "2020-07-06T23:19:23Z")
Hello all, I have created a python script, which receives data from our cluster, calculates it and labels documents. I use the search , and update by query functions in the script. The script runs well, and the functi… --- ## [Snapshot and Restore 6.8.8 - Null Pointer Exception after Upgrade from 6.2.4 to 6.8.8](https://discuss.elastic.co/t/snapshot-and-restore-6-8-8-null-pointer-exception-after-upgrade-from-6-2-4-to-6-8-8/239628)
**Author:** [@Neha\_Wagholikar](https://discuss.elastic.co/u/Neha_Wagholikar)\ **Replies:** 0\ **Last updated:** [July 2, 2020, 12:07pm UTC](https://discuss.elastic.co/t/snapshot-and-restore-6-8-8-null-pointer-exception-after-upgrade-from-6-2-4-to-6-8-8/239628 "2020-07-02T12:07:25Z")
Hi, I have upgraded my ELK from 6.2.4 to 6.8.8. Used Azure plugin for Snapshot Before Upgrade, my backup was working fine on both Public and Azure Stack. After Upgrade ,On public I am able to take backup but on Azure… --- ## [Recomendations to an offline instalation of ElasticStack](https://discuss.elastic.co/t/recomendations-to-an-offline-instalation-of-elasticstack/239722)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 5\ **Last updated:** [July 6, 2020, 11:11pm UTC](https://discuss.elastic.co/t/recomendations-to-an-offline-instalation-of-elasticstack/239722 "2020-07-06T23:11:38Z")
Hi, Im going to try to install the ElasticStack in an enviroment with no internet access, do you have any recomendation or things to have in mind before the instalation? Thanks. --- ## [Watcher with Heartbeat and monitor status up](https://discuss.elastic.co/t/watcher-with-heartbeat-and-monitor-status-up/239636)
**Author:** [@maadhav](https://discuss.elastic.co/u/maadhav)\ **Replies:** 0\ **Last updated:** [July 2, 2020, 12:52pm UTC](https://discuss.elastic.co/t/watcher-with-heartbeat-and-monitor-status-up/239636 "2020-07-02T12:52:07Z")
Hi Team We've configured Heartbeat to monitor services and got setup Watcher to monitor heartbeat monitor.status to send alert on a Slack channel. Following is the configuration: { "trigger": { "schedule": { … --- ## [Elasticsearch analysis on kibana without logstash ( + alerts or notifications)](https://discuss.elastic.co/t/elasticsearch-analysis-on-kibana-without-logstash-alerts-or-notifications/239613)
**Author:** [@Feriel\_Mufti](https://discuss.elastic.co/u/Feriel_Mufti)\ **Replies:** 11\ **Last updated:** [July 6, 2020, 11:09pm UTC](https://discuss.elastic.co/t/elasticsearch-analysis-on-kibana-without-logstash-alerts-or-notifications/239613 "2020-07-06T23:09:41Z")
Hello, i am using elasticsearch and kibana version 6.8 , and all different other beats , without logstash , so beats passes directly through elasticsearch to visualize the given data on kibana , i want to know how can i… --- ## [How to make elasticsearch turn on automatically](https://discuss.elastic.co/t/how-to-make-elasticsearch-turn-on-automatically/240048)
**Author:** [@Splunk](https://discuss.elastic.co/u/Splunk)\ **Replies:** 5\ **Last updated:** [July 6, 2020, 9:56pm UTC](https://discuss.elastic.co/t/how-to-make-elasticsearch-turn-on-automatically/240048 "2020-07-06T21:56:42Z")
Hi All, I have a prob with elasticsearch, I believe it is installed properly on my mac when I shut down and turn on the laptop it won't turn on again I did installation few time same issues, how u are guys handling this… --- ## [Complicated Nested Query](https://discuss.elastic.co/t/complicated-nested-query/239925)
**Author:** [@jacksonpv](https://discuss.elastic.co/u/jacksonpv)\ **Replies:** 0\ **Last updated:** [July 5, 2020, 1:33pm UTC](https://discuss.elastic.co/t/complicated-nested-query/239925 "2020-07-05T13:33:10Z")
Hi Guys Please suggest a query or approach for this problem below Here I have two records in my type called "journey" Record 1 { "journeyid":1, "journeyname":"test1", "journeydetail:\[ { "pickupcode":"Banglore", "… --- ## [Rescorer plugin. How to parse inner hits with original scores](https://discuss.elastic.co/t/rescorer-plugin-how-to-parse-inner-hits-with-original-scores/239976)
**Author:** [@tarmo](https://discuss.elastic.co/u/tarmo)\ **Replies:** 0\ **Last updated:** [July 6, 2020, 8:41am UTC](https://discuss.elastic.co/t/rescorer-plugin-how-to-parse-inner-hits-with-original-scores/239976 "2020-07-06T08:41:14Z")
I create a query to ES: GET my-index/\_search { "query": { "nested": { "inner\_hits": {}, "score\_mode": "max", "path": "my\_nested\_field", "query": { "bool"… --- ## [Disk used space is higher than the indices used space](https://discuss.elastic.co/t/disk-used-space-is-higher-than-the-indices-used-space/240025)
**Author:** [@Oxygen\_13](https://discuss.elastic.co/u/Oxygen_13)\ **Replies:** 5\ **Last updated:** [July 6, 2020, 6:34pm UTC](https://discuss.elastic.co/t/disk-used-space-is-higher-than-the-indices-used-space/240025 "2020-07-06T18:34:51Z")
My elk server is having 1000 GB space. When I check the available space showing 96% utilized. however indices used only 160 GB. Could you please help me how can I clear/delete used space, so that I will have more space. … --- ## [High system load on one node in three node cluster](https://discuss.elastic.co/t/high-system-load-on-one-node-in-three-node-cluster/239552)
**Author:** [@kernelpanic](https://discuss.elastic.co/u/kernelpanic)\ **Replies:** 6\ **Last updated:** [July 6, 2020, 5:12pm UTC](https://discuss.elastic.co/t/high-system-load-on-one-node-in-three-node-cluster/239552 "2020-07-06T17:12:33Z")
Hello, I'll detail my cluster specs first Versions: All servers use CentOS 8 and Elasticstack 7.6.1 Logstash nodes: LOGSTASH-BEATS (used for sending beats data to Elasticsearch) LOGSTASH-SYSLOG (used for sending vari… --- ## [Machine Learning Analytics Job error](https://discuss.elastic.co/t/machine-learning-analytics-job-error/239884)
**Author:** [@MisterLamp](https://discuss.elastic.co/u/MisterLamp)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 4:55pm UTC](https://discuss.elastic.co/t/machine-learning-analytics-job-error/239884 "2020-07-06T16:55:56Z")
Hi everyone, I have a question concerning Machine Learning Analytics Jobs. I have already created an auditbeat index and data in it. Created also Machine Learning Jobs which I can browse within the Anomaly Detection. We… --- ## [Where are my backsups?](https://discuss.elastic.co/t/where-are-my-backsups/240039)
**Author:** [@Matias\_Gerstner](https://discuss.elastic.co/u/Matias_Gerstner)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 4:47pm UTC](https://discuss.elastic.co/t/where-are-my-backsups/240039 "2020-07-06T16:47:45Z")
hello good afternoon, I wanted to ask you if anyone knows where the back ups (snapshots) are kept because I can't find them, and I need to migrate to another server. thank you --- ## [ILM update settings](https://discuss.elastic.co/t/ilm-update-settings/239999)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 4:42pm UTC](https://discuss.elastic.co/t/ilm-update-settings/239999 "2020-07-06T16:42:53Z")
Hi anyone knows if I added a cold storage phase to my ILM, will it take into account current indices which were move to warm phase before? for example, indices which were moved to warm phase 100 days ago --- ## [Anomaly Score Formular](https://discuss.elastic.co/t/anomaly-score-formular/240030)
**Author:** [@MisterLamp](https://discuss.elastic.co/u/MisterLamp)\ **Replies:** 2\ **Last updated:** [July 6, 2020, 3:45pm UTC](https://discuss.elastic.co/t/anomaly-score-formular/240030 "2020-07-06T15:45:46Z")
Hello, I am searching for the exact formular concerning the anomaly score. I have read that this is a 2 part calculation of mean and a quantile regressionanalysis. I am writing my masterthesis with some analysis on data… --- ## [Query to check if nestedobject contains values or not exist](https://discuss.elastic.co/t/query-to-check-if-nestedobject-contains-values-or-not-exist/239993)
**Author:** [@buka\_bidzina](https://discuss.elastic.co/u/buka_bidzina)\ **Replies:** 8\ **Last updated:** [July 6, 2020, 3:43pm UTC](https://discuss.elastic.co/t/query-to-check-if-nestedobject-contains-values-or-not-exist/239993 "2020-07-06T15:43:05Z")
Hello everyone, I am interested if something like this is possible in elastic search... So, I want to search for documents, which manufacturer.Id is in 1225 or manufacturer object doesn't exist. Manufacturer is a nested… --- ## [Machine learning typical value not set at the moment of firing watcher](https://discuss.elastic.co/t/machine-learning-typical-value-not-set-at-the-moment-of-firing-watcher/239462)
**Author:** [@Josip\_Cagalj](https://discuss.elastic.co/u/Josip_Cagalj)\ **Replies:** 4\ **Last updated:** [July 6, 2020, 3:12pm UTC](https://discuss.elastic.co/t/machine-learning-typical-value-not-set-at-the-moment-of-firing-watcher/239462 "2020-07-06T15:12:22Z")
Hi, I'm on Elastic Cloud v7.7 and I'm exploring the machine learning features. I have a simple job for monitoring the counts of requests our API endpoint receives over time. The goal is to get alerted when an anomaly o… --- ## [Alerting using opendistro webhook way](https://discuss.elastic.co/t/alerting-using-opendistro-webhook-way/240024)
**Author:** [@Rushabh\_Doshi](https://discuss.elastic.co/u/Rushabh_Doshi)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 3:11pm UTC](https://discuss.elastic.co/t/alerting-using-opendistro-webhook-way/240024 "2020-07-06T15:11:08Z")
What values should i give in path and query parameters (Key/value) if i need to send an alert to gmail, what will be the values in host and port number, i dont have any clue please guide --- ## [Elasticsearch will not properly boot without localhost settings](https://discuss.elastic.co/t/elasticsearch-will-not-properly-boot-without-localhost-settings/238881)
**Author:** [@mevans1101](https://discuss.elastic.co/u/mevans1101)\ **Replies:** 10\ **Last updated:** [July 6, 2020, 2:44pm UTC](https://discuss.elastic.co/t/elasticsearch-will-not-properly-boot-without-localhost-settings/238881 "2020-07-06T14:44:13Z")
Hello everyone. I've exhausted nearly all forms of documentation and forum searches, and I've yet been able to get elasticsearch to outside of local settings. For some background: I need elasticsearch to be able to com… --- ## [NEST search not working with wildcards or spaces or special chars like -](https://discuss.elastic.co/t/nest-search-not-working-with-wildcards-or-spaces-or-special-chars-like/239781)
**Author:** [@agonzalez](https://discuss.elastic.co/u/agonzalez)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 2:30pm UTC](https://discuss.elastic.co/t/nest-search-not-working-with-wildcards-or-spaces-or-special-chars-like/239781 "2020-07-06T14:30:59Z")
I have in elasticsearch index with software instaleld in my pc like this: Microsoft .NET Core Runtime - 3.1.5 (x64) But later when searching the index using NEST it doesnt get any result when I search for full or parti… --- ## [Error : mapper of different type, current\_type \[text\], merged\_type \[ObjectMapper\]","type":"illegal\_argument\_exception"](https://discuss.elastic.co/t/error-mapper-of-different-type-current-type-text-merged-type-objectmapper-type-illegal-argument-exception/240018)
**Author:** [@imene](https://discuss.elastic.co/u/imene)\ **Replies:** 0\ **Last updated:** [July 6, 2020, 2:01pm UTC](https://discuss.elastic.co/t/error-mapper-of-different-type-current-type-text-merged-type-objectmapper-type-illegal-argument-exception/240018 "2020-07-06T14:01:21Z")
i want to index my data to elasticsearch so i create a pipeline in java to do that My data is in form for example : {"insertId":"..........6PUYlYY.05Ku1RDDSQJmsg","jsonPayload":{"AssJRes.time":"","C4-begin.time":"","… --- ## [Split the array that contains one string](https://discuss.elastic.co/t/split-the-array-that-contains-one-string/239981)
**Author:** [@Yaho](https://discuss.elastic.co/u/Yaho)\ **Replies:** 0\ **Last updated:** [July 6, 2020, 9:34am UTC](https://discuss.elastic.co/t/split-the-array-that-contains-one-string/239981 "2020-07-06T09:34:54Z")
I have a field "umi\_app.keyword" as string but i need to convert to two variables/objects/arrays to be able to add another string to each one (\_Critical). The part of the script looks like this '+doc\['umi\_app.keyword'\]… --- ## [High number of org.elasticsearch.index.IndexNotFoundException exceptions detected by Dynatrace](https://discuss.elastic.co/t/high-number-of-org-elasticsearch-index-indexnotfoundexception-exceptions-detected-by-dynatrace/239702)
**Author:** [@GSmith](https://discuss.elastic.co/u/GSmith)\ **Replies:** 4\ **Last updated:** [July 6, 2020, 1:30pm UTC](https://discuss.elastic.co/t/high-number-of-org-elasticsearch-index-indexnotfoundexception-exceptions-detected-by-dynatrace/239702 "2020-07-06T13:30:23Z")
We have deployed Elasticsearch 7.6.1 onto a Kubernetes cluster for log monitoring. Logs are collected using Fluent Bit and sent to Elasticsearch. Everything seems to be working fine. But yesterday, one of the admins c… --- ## [Ml jobs stuck in deleting state](https://discuss.elastic.co/t/ml-jobs-stuck-in-deleting-state/239912)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 1:26pm UTC](https://discuss.elastic.co/t/ml-jobs-stuck-in-deleting-state/239912 "2020-07-06T13:26:52Z")
Hi, I would like to remove these limbo ml jobs. interface doesn't allow that. any advice will be appreciated --- ## [Fetch million doc in seconds](https://discuss.elastic.co/t/fetch-million-doc-in-seconds/239611)
**Author:** [@saurabhbhatt](https://discuss.elastic.co/u/saurabhbhatt)\ **Replies:** 10\ **Last updated:** [July 6, 2020, 1:25pm UTC](https://discuss.elastic.co/t/fetch-million-doc-in-seconds/239611 "2020-07-06T13:25:00Z")
Hi, To give brief, I have an index "allreportingdataindex" (example) and it has over 7,50,000 records. Each document has about about 20 columns and about 15 columns with array values. The ES instance is installed on ser… --- ## [Effect of extraneous analyzers or filters in settings - any negative consequences?](https://discuss.elastic.co/t/effect-of-extraneous-analyzers-or-filters-in-settings-any-negative-consequences/239897)
**Author:** [@pmallela](https://discuss.elastic.co/u/pmallela)\ **Replies:** 1\ **Last updated:** [July 6, 2020, 12:34pm UTC](https://discuss.elastic.co/t/effect-of-extraneous-analyzers-or-filters-in-settings-any-negative-consequences/239897 "2020-07-06T12:34:51Z")
Hi, does adding multiple analyzers/filters to the settings of an index use up lot of space, or add any burden on the index? (i wouldn’t think so, as it’s just configuration). I want to keep the “settings” common across … --- ## [Index design for large lists of document references](https://discuss.elastic.co/t/index-design-for-large-lists-of-document-references/240001)
**Author:** [@buckethead](https://discuss.elastic.co/u/buckethead)\ **Replies:** 0\ **Last updated:** [July 6, 2020, 12:26pm UTC](https://discuss.elastic.co/t/index-design-for-large-lists-of-document-references/240001 "2020-07-06T12:26:45Z")
Hi, I'm kind of new to elasticsearch and I wonder if i overlook a better solution to my Problem: I have an index of quite large documents (\< 1mb) with \> 100,000 entries, lets call them "products" and a lot of "customers… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=869) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=871)