# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1036 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1037 --- ## [Delete automatically One year old data from elastic search](https://discuss.elastic.co/t/delete-automatically-one-year-old-data-from-elastic-search/216384)
**Author:** [@Abhishek\_Pratap\_Sing](https://discuss.elastic.co/u/Abhishek_Pratap_Sing)\ **Replies:** 2\ **Last updated:** [January 26, 2020, 2:30pm UTC](https://discuss.elastic.co/t/delete-automatically-one-year-old-data-from-elastic-search/216384 "2020-01-26T14:30:48Z")
Hi Team I would like to automatically delete one year old data from Elastic Search, I didn't find any proper way. Please anyone help out me. Thanks!! --- ## [Preprocess data with python](https://discuss.elastic.co/t/preprocess-data-with-python/216523)
**Author:** [@Cristian\_Bovino](https://discuss.elastic.co/u/Cristian_Bovino)\ **Replies:** 2\ **Last updated:** [January 26, 2020, 12:36pm UTC](https://discuss.elastic.co/t/preprocess-data-with-python/216523 "2020-01-26T12:36:06Z")
Hi Everyone, I'm quite new to the Elastic suite. My current situation is: Data --\> Logstash (with filters) --\> Elasticsearch --\> Kibana I would like to process data with a python script (ML Model) before store it into… --- ## [Errors related to http requests](https://discuss.elastic.co/t/errors-related-to-http-requests/216515)
**Author:** [@George\_Wainwright](https://discuss.elastic.co/u/George_Wainwright)\ **Replies:** 2\ **Last updated:** [January 26, 2020, 10:08am UTC](https://discuss.elastic.co/t/errors-related-to-http-requests/216515 "2020-01-26T10:08:21Z")
Hello, from time to time I see the next errors among elasticsearch logs: \[2020-01-25T01:20:41,285\]\[ERROR\]\[o.e.r.RestController \] failed to send failure response for uri \[/\] java.lang.IllegalArgumentException: Unex… --- ## [How to query elasticsearch using array index?](https://discuss.elastic.co/t/how-to-query-elasticsearch-using-array-index/216458)
**Author:** [@meallhour](https://discuss.elastic.co/u/meallhour)\ **Replies:** 3\ **Last updated:** [January 26, 2020, 8:46am UTC](https://discuss.elastic.co/t/how-to-query-elasticsearch-using-array-index/216458 "2020-01-26T08:46:49Z")
My Json Response looks as below: { "took": 41, "timed\_out": false, "\_shards": { "total": 3, "successful": 3, "skipped": 0, "failed": 0 }, "hits": { "total": 1, "max\_score": null, "h… --- ## [NEST API SUCKS](https://discuss.elastic.co/t/nest-api-sucks/214128)
**Author:** [@han1](https://discuss.elastic.co/u/han1)\ **Replies:** 5\ **Last updated:** [January 26, 2020, 4:33am UTC](https://discuss.elastic.co/t/nest-api-sucks/214128 "2020-01-26T04:33:13Z")
Not only is there no Documentation for important things we need to do, even when we ask a question due to lack of docs, No one bothers to respond. NEST seems to be not only useless as far as providing an API it actually… --- ## [Undocumented breaking change in integTest runner in 7.5](https://discuss.elastic.co/t/undocumented-breaking-change-in-integtest-runner-in-7-5/216544)
**Author:** [@Itamar\_Syn\_Hershko](https://discuss.elastic.co/u/Itamar_Syn_Hershko)\ **Replies:** 0\ **Last updated:** [January 25, 2020, 9:02pm UTC](https://discuss.elastic.co/t/undocumented-breaking-change-in-integtest-runner-in-7-5/216544 "2020-01-25T21:02:51Z")
Hi all, We are experiencing the same build issues as in https://discuss.elastic.co/t/task-integtestcluster-did-not-run-automatically-when-run-task-integtest-on-version-7-5/212637 . We have a couple of plugins with YamlT… --- ## [Is it possible to exclude the health/status page from username/pwd when using buckler or xpac as my load balancer doesn’t support credentials](https://discuss.elastic.co/t/is-it-possible-to-exclude-the-health-status-page-from-username-pwd-when-using-buckler-or-xpac-as-my-load-balancer-doesn-t-support-credentials/216501)
**Author:** [@nandersen674](https://discuss.elastic.co/u/nandersen674)\ **Replies:** 4\ **Last updated:** [January 25, 2020, 8:50pm UTC](https://discuss.elastic.co/t/is-it-possible-to-exclude-the-health-status-page-from-username-pwd-when-using-buckler-or-xpac-as-my-load-balancer-doesn-t-support-credentials/216501 "2020-01-25T20:50:59Z")
Is it possible to exclude the health/status page from username/pwd when using buckler or space as my load balancer doesn’t support credentials Like an exclude tag in buckler.yml --- ## [Request of field + value & samefield + anothervalue combinations using bool must or query\_string - ask for help](https://discuss.elastic.co/t/request-of-field-value-samefield-anothervalue-combinations-using-bool-must-or-query-string-ask-for-help/215395)
**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\ **Replies:** 4\ **Last updated:** [January 25, 2020, 10:53am UTC](https://discuss.elastic.co/t/request-of-field-value-samefield-anothervalue-combinations-using-bool-must-or-query-string-ask-for-help/215395 "2020-01-25T10:53:11Z")
Hi, i just tried to build following request to count documents containing player active status but no match found: GET /players/\_search { "size": 0, "query": { "bool": { "must" : \[ {"ter… --- ## [Elasticsearch public access failure with self-signed certificate. xpack.security is it really needed](https://discuss.elastic.co/t/elasticsearch-public-access-failure-with-self-signed-certificate-xpack-security-is-it-really-needed/215392)
**Author:** [@O\_K](https://discuss.elastic.co/u/O_K)\ **Replies:** 2\ **Last updated:** [January 25, 2020, 4:39am UTC](https://discuss.elastic.co/t/elasticsearch-public-access-failure-with-self-signed-certificate-xpack-security-is-it-really-needed/215392 "2020-01-25T04:39:14Z")
Hi Everyone, Based on my previous post Elasticsearch with xpack.security.enabled throws Cluster is not yet ready I configured xpack.security and selfsigned certificate for elasticsearch. I wonder whether xpack.securit… --- ## [How can I set the date type with create.indices in elasticsearch?](https://discuss.elastic.co/t/how-can-i-set-the-date-type-with-create-indices-in-elasticsearch/216505)
**Author:** [@securisec](https://discuss.elastic.co/u/securisec)\ **Replies:** 0\ **Last updated:** [January 25, 2020, 2:41am UTC](https://discuss.elastic.co/t/how-can-i-set-the-date-type-with-create-indices-in-elasticsearch/216505 "2020-01-25T02:41:55Z")
I am having trouble setting the date type specially for nested objects in elasticsearch withe nodejs. The data field in my example holds the time in epoch in seconds. I am using the create.indices endpoint along with the… --- ## [Python Elasticsearch-DSL UpdateByQuery Syntax](https://discuss.elastic.co/t/python-elasticsearch-dsl-updatebyquery-syntax/216349)
**Author:** [@\_Joe](https://discuss.elastic.co/u/_Joe)\ **Replies:** 1\ **Last updated:** [January 25, 2020, 1:53am UTC](https://discuss.elastic.co/t/python-elasticsearch-dsl-updatebyquery-syntax/216349 "2020-01-25T01:53:12Z")
ElasticSearch 7.5 Indices are firewall log data. I am experiencing too many failed GeoIP lookups using GeoLite2-City.mmdb. To fix these issues, I am working on a Python script that will do lookups for documents with m… --- ## [Restrict data forwarding to elasticsearch index](https://discuss.elastic.co/t/restrict-data-forwarding-to-elasticsearch-index/216488)
**Author:** [@bhargav](https://discuss.elastic.co/u/bhargav)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 8:43pm UTC](https://discuss.elastic.co/t/restrict-data-forwarding-to-elasticsearch-index/216488 "2020-01-24T20:43:37Z")
Greetings, We are storing logs from some applications in our elasticsearch cluster, and every day we index the data to a new index with increased number in the end of the name. E.g.: app-data-0001, app-data-0002 ... U… --- ## [Suggestions from long text fields](https://discuss.elastic.co/t/suggestions-from-long-text-fields/216494)
**Author:** [@hjklo](https://discuss.elastic.co/u/hjklo)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 10:16pm UTC](https://discuss.elastic.co/t/suggestions-from-long-text-fields/216494 "2020-01-24T22:16:25Z")
We have an ES index that contains a large and constantly increasing number of documents (PDFs, word processord files etc). The index stores several details about each document, including the complete contents of the docu… --- ## [Ingest of data hammering one node only](https://discuss.elastic.co/t/ingest-of-data-hammering-one-node-only/216341)
**Author:** [@Philip\_Brown](https://discuss.elastic.co/u/Philip_Brown)\ **Replies:** 7\ **Last updated:** [January 24, 2020, 10:05pm UTC](https://discuss.elastic.co/t/ingest-of-data-hammering-one-node-only/216341 "2020-01-24T22:05:24Z")
We have a 14-datanode elastic cluster running version (censored for embarassment), and 3 master nodes We have a bunch of machines sending logfile output, into the cluster, via filebeat and logstash. logstash is pointed… --- ## ["The field \[metricset.name\] must be aggregatable across all indices" and a huge rolled-up index](https://discuss.elastic.co/t/the-field-metricset-name-must-be-aggregatable-across-all-indices-and-a-huge-rolled-up-index/216319)
**Author:** [@yagodorea](https://discuss.elastic.co/u/yagodorea)\ **Replies:** 1\ **Last updated:** [January 24, 2020, 9:01pm UTC](https://discuss.elastic.co/t/the-field-metricset-name-must-be-aggregatable-across-all-indices-and-a-huge-rolled-up-index/216319 "2020-01-24T21:01:48Z")
I'm using an on-prem version of Elasticsearch in a GCP instance, and I'm having to deal with the huge amounts of data quickly accumulating into my instance's storage. Especially Metricbeat data, that is far to extensive … --- ## [Null\_value in mapping for individual components of date\_range](https://discuss.elastic.co/t/null-value-in-mapping-for-individual-components-of-date-range/215632)
**Author:** [@dougbergh](https://discuss.elastic.co/u/dougbergh)\ **Replies:** 2\ **Last updated:** [January 24, 2020, 8:38pm UTC](https://discuss.elastic.co/t/null-value-in-mapping-for-individual-components-of-date-range/215632 "2020-01-24T20:38:30Z")
Mapping below. Docs need to be able to have non-null start date and null end date. How do I specify null\_value for each date in date\_range individually? { "de-mr-j-2019.06" : { "mappings" : { "date\_det… --- ## [Upgrade ES and Kibana on Windows Server](https://discuss.elastic.co/t/upgrade-es-and-kibana-on-windows-server/216484)
**Author:** [@RunningSmurf](https://discuss.elastic.co/u/RunningSmurf)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 8:00pm UTC](https://discuss.elastic.co/t/upgrade-es-and-kibana-on-windows-server/216484 "2020-01-24T20:00:20Z")
Good afternoon, I currently have ES 6.5 installed on Windows Server 2012, and want to upgrade to 7.5. Since this is a single node, I assume that this will not be a rolling upgrade, but rather a full-cluster restart up… --- ## [Terminal blocked on \[2020-01-24T15:37:25,971\]\[INFO \]\[o.e.c.r.a.AllocationService\] \[LAPTOP-TRA6NOPS\] Cluster health status changed from \[RED\] to \[GREEN\] (reason: \[shards started \[\[.kibana\_task\_manager\_1\]\[0\], \[.kibana\_1\]\[0\]\]\])](https://discuss.elastic.co/t/terminal-blocked-on-2020-01-24t1525-971-info-o-e-c-r-a-allocationservice-laptop-tra6nops-cluster-health-status-changed-from-red-to-green-reason-shards-started-kibana-task-manager-1-0-kibana-1-0/216446)
**Author:** [@pierrejutard](https://discuss.elastic.co/u/pierrejutard)\ **Replies:** 5\ **Last updated:** [January 24, 2020, 7:12pm UTC](https://discuss.elastic.co/t/terminal-blocked-on-2020-01-24t1525-971-info-o-e-c-r-a-allocationservice-laptop-tra6nops-cluster-health-status-changed-from-red-to-green-reason-shards-started-kibana-task-manager-1-0-kibana-1-0/216446 "2020-01-24T19:12:48Z")
Hello, i just set up elastic search 7.5.2 on my computer and when runnning on the terminal comand elastic search on windows the terminal stops at this sentence: \[2020-01-24T15:37:25,971\]\[INFO \]\[o.e.c.r.a.AllocationServi… --- ## [Randomly performance issue](https://discuss.elastic.co/t/randomly-performance-issue/214009)
**Author:** [@nmathur](https://discuss.elastic.co/u/nmathur)\ **Replies:** 6\ **Last updated:** [January 24, 2020, 6:44pm UTC](https://discuss.elastic.co/t/randomly-performance-issue/214009 "2020-01-24T18:44:35Z")
Hello All, We are randomly facing performance issue in elasticsearch read/write operations. The elasticsearch in installed on Azure VM (Linux). This is not constant. Generally a common method to insert/update in elastic… --- ## [Virtual Machine Hosts and ECS](https://discuss.elastic.co/t/virtual-machine-hosts-and-ecs/216477)
**Author:** [@Micah\_Hunsberger](https://discuss.elastic.co/u/Micah_Hunsberger)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 6:33pm UTC](https://discuss.elastic.co/t/virtual-machine-hosts-and-ecs/216477 "2020-01-24T18:33:59Z")
If I have events coming from a Virtual Machine and want to enrich the events with information about the host it is running on, in ECS, where would I put that information? For example, the add\_host\_metadata processor for… --- ## [How to create settings and mappings via API call? (via Java/Spring Boot)](https://discuss.elastic.co/t/how-to-create-settings-and-mappings-via-api-call-via-java-spring-boot/216476)
**Author:** [@franzisk](https://discuss.elastic.co/u/franzisk)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 6:17pm UTC](https://discuss.elastic.co/t/how-to-create-settings-and-mappings-via-api-call-via-java-spring-boot/216476 "2020-01-24T18:17:00Z")
Hi all, Before, in ElasticSearch 2.3.1, I was checking if some index existed and if not I was making a PUT request to create it with my settings and my mappings, just like below: String synonymFiltersName = "filtro\_de\_… --- ## [Query and/or access object property](https://discuss.elastic.co/t/query-and-or-access-object-property/216472)
**Author:** [@styxtb1598](https://discuss.elastic.co/u/styxtb1598)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 5:35pm UTC](https://discuss.elastic.co/t/query-and-or-access-object-property/216472 "2020-01-24T17:35:23Z")
I'm very new to ES and using the API for searching. I have an set of logs that have an object's properties In my c# query, I am trying to access the fields.ui.Message field. How can I do that? I get the top level stuf… --- ## [Ingest pipeline, rename a field that has a dynamic part](https://discuss.elastic.co/t/ingest-pipeline-rename-a-field-that-has-a-dynamic-part/215488)
**Author:** [@wedkarz014](https://discuss.elastic.co/u/wedkarz014)\ **Replies:** 4\ **Last updated:** [January 24, 2020, 4:37pm UTC](https://discuss.elastic.co/t/ingest-pipeline-rename-a-field-that-has-a-dynamic-part/215488 "2020-01-24T16:37:55Z")
hi, I have a metrics with fields which look like that: prometheus.xyz-dev.label.name prometheus.xyz-dev.tomcat\_global\_error\_total.value prometheus.xyz-dev.tomcat\_global\_received\_bytes\_total.value prometheus.xyz-dev.to… --- ## [Search on "copy\_to"-"keyword" Field and Get/View indexed data of the "copy\_to"-"keyword"-Field (not "\_source")](https://discuss.elastic.co/t/search-on-copy-to-keyword-field-and-get-view-indexed-data-of-the-copy-to-keyword-field-not-source/216419)
**Author:** [@mero](https://discuss.elastic.co/u/mero)\ **Replies:** 1\ **Last updated:** [January 24, 2020, 4:22pm UTC](https://discuss.elastic.co/t/search-on-copy-to-keyword-field-and-get-view-indexed-data-of-the-copy-to-keyword-field-not-source/216419 "2020-01-24T16:22:45Z")
Hi together, is there a possibility to see or view the indexed data stored in an elasticsearch index? I have a Field which is filled by using "copy\_to" of other Fields ("Keyword") and now i have a query that is not fin… --- ## [Audit authentication failed](https://discuss.elastic.co/t/audit-authentication-failed/216467)
**Author:** [@Ludovic9](https://discuss.elastic.co/u/Ludovic9)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 4:05pm UTC](https://discuss.elastic.co/t/audit-authentication-failed/216467 "2020-01-24T16:05:23Z")
Hi, I'm using elk stack in version 6.8.3, I have enabled security function, it's OK. Each beats needs an account to send logs to elasticsearch. But I would like to track the authentication failed from agent and from Ki… --- ## [ILM questions2](https://discuss.elastic.co/t/ilm-questions2/216451)
**Author:** [@dennys\_84](https://discuss.elastic.co/u/dennys_84)\ **Replies:** 2\ **Last updated:** [January 24, 2020, 3:57pm UTC](https://discuss.elastic.co/t/ilm-questions2/216451 "2020-01-24T15:57:39Z")
Hi all. Can someone explain how ILM works? The options are pretty staight-forward but there are some questions: Do we need ILM if we have a small installation? We need to store our logs about 2 years, than autoremove i… --- ## [Fetch search history from cluster in Elasticsearch 7.5](https://discuss.elastic.co/t/fetch-search-history-from-cluster-in-elasticsearch-7-5/216431)
**Author:** [@Palani\_rajan\_Ravicha](https://discuss.elastic.co/u/Palani_rajan_Ravicha)\ **Replies:** 1\ **Last updated:** [January 24, 2020, 3:16pm UTC](https://discuss.elastic.co/t/fetch-search-history-from-cluster-in-elasticsearch-7-5/216431 "2020-01-24T15:16:05Z")
I need to show all search history in front-end.Is there any api to fetch all search history in Elasticsearch 7.5? --- ## [Multiple size attributes in a query per index](https://discuss.elastic.co/t/multiple-size-attributes-in-a-query-per-index/216440)
**Author:** [@negiadventures](https://discuss.elastic.co/u/negiadventures)\ **Replies:** 3\ **Last updated:** [January 24, 2020, 3:01pm UTC](https://discuss.elastic.co/t/multiple-size-attributes-in-a-query-per-index/216440 "2020-01-24T15:01:00Z")
Hi, I want to display results from two indices with same structure and put a limit of 500 records. The problem is that out of 500, I want to show 450 from index1 and 50 from index2. Is there a way in which we can achiev… --- ## [Query cache gets invalidated](https://discuss.elastic.co/t/query-cache-gets-invalidated/216032)
**Author:** [@royal\_man](https://discuss.elastic.co/u/royal_man)\ **Replies:** 10\ **Last updated:** [January 24, 2020, 1:41pm UTC](https://discuss.elastic.co/t/query-cache-gets-invalidated/216032 "2020-01-24T13:41:43Z")
I am making this query with request\_cache=true { "query": { "bool": { "should": \[ { "term": { "status": "online" } }, { "term": { … --- ## [Elastic request timeout after disconnecting half cluster](https://discuss.elastic.co/t/elastic-request-timeout-after-disconnecting-half-cluster/216418)
**Author:** [@d4nnyx](https://discuss.elastic.co/u/d4nnyx)\ **Replies:** 0\ **Last updated:** [January 24, 2020, 12:46pm UTC](https://discuss.elastic.co/t/elastic-request-timeout-after-disconnecting-half-cluster/216418 "2020-01-24T12:46:57Z")
Hello guys, I have 16 data nodes in Elastic Stack cluster divided to 2 datacenters, all indices have one replica (2 copies in each DC). If I disconnect all nodes from one DC, Elastic is unavailable for a while, Kibana c… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1035) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1037)