# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=606 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 607 --- ## [DateFormat throws null Pointer in 4.2.x](https://discuss.elastic.co/t/dateformat-throws-null-pointer-in-4-2-x/277483)
**Author:** [@Kst](https://discuss.elastic.co/u/Kst)\ **Replies:** 2\ **Last updated:** [July 20, 2021, 6:31am UTC](https://discuss.elastic.co/t/dateformat-throws-null-pointer-in-4-2-x/277483 "2021-07-20T06:31:08Z")
Hi, I am trying to upgrade spring data Elasticsearch from 4.1.10 to 4.2.2 I have a date field definition like below @Field(type = FieldType.Date, format = DateFormat.date\_optional\_time, index = false) private LocalD… --- ## [Auto Delete index log ElasticSearch by period](https://discuss.elastic.co/t/auto-delete-index-log-elasticsearch-by-period/279086)
**Author:** [@java\_dev](https://discuss.elastic.co/u/java_dev)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 4:49pm UTC](https://discuss.elastic.co/t/auto-delete-index-log-elasticsearch-by-period/279086 "2021-07-19T16:49:47Z")
How can i configure ElasticSearch to delete logs passed 1 month, or if there is no sush conf, how can i call api delete from java client i want to send post with authentification and with query for delete : json = { "… --- ## [How can I reindex the results of an aggregation into another index?](https://discuss.elastic.co/t/how-can-i-reindex-the-results-of-an-aggregation-into-another-index/278896)
**Author:** [@Vaishnavi\_Nandakumar](https://discuss.elastic.co/u/Vaishnavi_Nandakumar)\ **Replies:** 10\ **Last updated:** [July 19, 2021, 12:58pm UTC](https://discuss.elastic.co/t/how-can-i-reindex-the-results-of-an-aggregation-into-another-index/278896 "2021-07-19T12:58:58Z")
Hello, I'm using the 7.7.0 version of Elasticsearch. I have an aggregation query that works on the ingested data to produce the output but I am not able to re-index it. Data Context The given dataset has around 500,00… --- ## [How to run elassandra on windows](https://discuss.elastic.co/t/how-to-run-elassandra-on-windows/279058)
**Author:** [@Pramod\_Kumar3](https://discuss.elastic.co/u/Pramod_Kumar3)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 12:19pm UTC](https://discuss.elastic.co/t/how-to-run-elassandra-on-windows/279058 "2021-07-19T12:19:12Z")
I am try to run elassandra on windows by using Cassandra -e command, it's throwing invalid parameters : empty value. I believe the run command should be different. Can you please share the command to run on windows. T… --- ## [Execute script while in maintenance mode](https://discuss.elastic.co/t/execute-script-while-in-maintenance-mode/279050)
**Author:** [@crl](https://discuss.elastic.co/u/crl)\ **Replies:** 0\ **Last updated:** [July 19, 2021, 11:19am UTC](https://discuss.elastic.co/t/execute-script-while-in-maintenance-mode/279050 "2021-07-19T11:19:11Z")
I have a cluster hosted in AWS that I have had to place in maintenance mode (stop routing requests) as the incoming requests prevent any work on the cluster in its current state. Some of the issues are caused by mapping… --- ## [Failed to start elastic search](https://discuss.elastic.co/t/failed-to-start-elastic-search/278983)
**Author:** [@Jedrick](https://discuss.elastic.co/u/Jedrick)\ **Replies:** 8\ **Last updated:** [July 19, 2021, 10:48am UTC](https://discuss.elastic.co/t/failed-to-start-elastic-search/278983 "2021-07-19T10:48:42Z")
Hi, Good day. Can you help me with my problem with elastic search? Currently, i am building a Wazuh siem that uses elastic search functions. As I checked, Filebeat, kibana services are running. But the elasticsearch … --- ## [Prefix of special character on the id](https://discuss.elastic.co/t/prefix-of-special-character-on-the-id/278567)
**Author:** [@stexxen](https://discuss.elastic.co/u/stexxen)\ **Replies:** 2\ **Last updated:** [July 19, 2021, 9:58am UTC](https://discuss.elastic.co/t/prefix-of-special-character-on-the-id/278567 "2021-07-19T09:58:49Z")
I have inadvertently loaded some documents without sanitising the field that was meant to be the id. So some records now have an id that begins with the ascii 09 i.e. the tab character I can extract an individual recor… --- ## [Script query is not returning whole double value](https://discuss.elastic.co/t/script-query-is-not-returning-whole-double-value/278871)
**Author:** [@RamPrasadKM](https://discuss.elastic.co/u/RamPrasadKM)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 9:50am UTC](https://discuss.elastic.co/t/script-query-is-not-returning-whole-double-value/278871 "2021-07-19T09:50:26Z")
POST gs011\_carea\_area/\_search { "from": 0, "size": 0, "version": true, "aggregations": { "filters": { "filter": { "bool": { "must": \[ { "terms": { "id": \[ 76701 \], "boost": 1 } } \], "adjust\_pure\_negati… --- ## [Missing org.elasticsearch.test:logger-usage:7.10.2](https://discuss.elastic.co/t/missing-org-elasticsearch-test7-10-2/278893)
**Author:** [@p4paul](https://discuss.elastic.co/u/p4paul)\ **Replies:** 2\ **Last updated:** [July 19, 2021, 9:48am UTC](https://discuss.elastic.co/t/missing-org-elasticsearch-test7-10-2/278893 "2021-07-19T09:48:13Z")
It seems a few Jars are missing in mavenCentral.... To start with: org.elasticsearch.test:logger-usage:7.10.2 I was trying to build a esplugin for Elastic 7.10.2 Error: Execution failed for task ':loggerUsageCheck'. … --- ## [Index in certain set of nodes](https://discuss.elastic.co/t/index-in-certain-set-of-nodes/278920)
**Author:** [@Roman\_Kagan](https://discuss.elastic.co/u/Roman_Kagan)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 9:45am UTC](https://discuss.elastic.co/t/index-in-certain-set-of-nodes/278920 "2021-07-19T09:45:34Z")
Hello: I have 5 nodes cluster - would it be possible to set the primary and replicas to be on certain nodes and not others. For example, I'd like to achieve that index-1 would be on node-a, node-b and node-c and NOT on… --- ## [TimeValue - number\_format\_exception - Java client](https://discuss.elastic.co/t/timevalue-number-format-exception-java-client/279015)
**Author:** [@Leuteris](https://discuss.elastic.co/u/Leuteris)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 9:36am UTC](https://discuss.elastic.co/t/timevalue-number-format-exception-java-client/279015 "2021-07-19T09:36:43Z")
I have a search request using PointInTimeBuilder: PointInTimeBuilder pointInTimeBuilder = new PointInTimeBuilder("id..."); pointInTimeBuilder.setKeepAlive(TimeValue.timeValueSeconds(66)); The keep\_alive value is 66 sec… --- ## [How to add http response header in Elasticsearch](https://discuss.elastic.co/t/how-to-add-http-response-header-in-elasticsearch/278981)
**Author:** [@yupengj](https://discuss.elastic.co/u/yupengj)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 9:12am UTC](https://discuss.elastic.co/t/how-to-add-http-response-header-in-elasticsearch/278981 "2021-07-19T09:12:23Z")
I encountered three security-related issues when using elasticserrch version 7.6.1. Thank you for your help. How does elasticserrch configure http response headers, such as X-Content-Type-Options, X-XSS-Protection, Con… --- ## [Performance issue in Azure](https://discuss.elastic.co/t/performance-issue-in-azure/279026)
**Author:** [@Kai\_Shen](https://discuss.elastic.co/u/Kai_Shen)\ **Replies:** 0\ **Last updated:** [July 19, 2021, 7:24am UTC](https://discuss.elastic.co/t/performance-issue-in-azure/279026 "2021-07-19T07:24:08Z")
Hi, a customer is running into performance issues on Azure. His environment: 3 nodes cluster, 8 GB RAM each. 1 index (around 10 fields), 4 GB storage for this index, so very small. Here are his observations: A query i… --- ## [What is the best way to store unique values of a field](https://discuss.elastic.co/t/what-is-the-best-way-to-store-unique-values-of-a-field/278548)
**Author:** [@OmarDacca](https://discuss.elastic.co/u/OmarDacca)\ **Replies:** 6\ **Last updated:** [July 19, 2021, 7:28am UTC](https://discuss.elastic.co/t/what-is-the-best-way-to-store-unique-values-of-a-field/278548 "2021-07-19T07:28:51Z")
Hi, I have a raw data index, every document has the fields: device, country, browser, utm and many more... I need a way to extract the unique values of each field and store all of them in an index lets call it 'lookups… --- ## [Query for specific pair of fields in Elastic](https://discuss.elastic.co/t/query-for-specific-pair-of-fields-in-elastic/279025)
**Author:** [@saif3r](https://discuss.elastic.co/u/saif3r)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 7:28am UTC](https://discuss.elastic.co/t/query-for-specific-pair-of-fields-in-elastic/279025 "2021-07-19T07:28:20Z")
Hello, I have two documents: POST query\_test/\_doc { "field": \[ { "field1": "Pam", "field2": "Beesly" }, { "field1": "Jim", "field2": "Halpert" } \] } POST query\_test/\_doc { … --- ## [Elasticsearch storage problem](https://discuss.elastic.co/t/elasticsearch-storage-problem/277850)
**Author:** [@bab](https://discuss.elastic.co/u/bab)\ **Replies:** 5\ **Last updated:** [July 19, 2021, 5:27am UTC](https://discuss.elastic.co/t/elasticsearch-storage-problem/277850 "2021-07-19T05:27:27Z")
Hi guys, I am facing this problem from time to time, would like to know where does this come from and how can I get rid of this completely. the problem stays a few minutes u d after that goes away and can access my ES i… --- ## [Index.final\_pipeline not working as expected](https://discuss.elastic.co/t/index-final-pipeline-not-working-as-expected/276195)
**Author:** [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Replies:** 6\ **Last updated:** [July 19, 2021, 2:19am UTC](https://discuss.elastic.co/t/index-final-pipeline-not-working-as-expected/276195 "2021-07-19T02:19:46Z")
Hello, I have a filebeat that uses a module with a ingest pipeline, since I still need to make some transformations I'm trying to use another ingest pipeline with the setting index.final\_pipeline in the index settings. … --- ## [Can we create alias for other aliases?](https://discuss.elastic.co/t/can-we-create-alias-for-other-aliases/278994)
**Author:** [@im-pratham](https://discuss.elastic.co/u/im-pratham)\ **Replies:** 1\ **Last updated:** [July 19, 2021, 2:11am UTC](https://discuss.elastic.co/t/can-we-create-alias-for-other-aliases/278994 "2021-07-19T02:11:38Z")
How can i create alias with other aliases? Is this possible? --- ## [Increase in response time for aggregations in 7.10.1](https://discuss.elastic.co/t/increase-in-response-time-for-aggregations-in-7-10-1/276295)
**Author:** [@rgopalan](https://discuss.elastic.co/u/rgopalan)\ **Replies:** 6\ **Last updated:** [July 19, 2021, 12:54am UTC](https://discuss.elastic.co/t/increase-in-response-time-for-aggregations-in-7-10-1/276295 "2021-07-19T00:54:56Z")
Hi, We recently upgraded our ElasticSearch cluster from 7.7 to 7.10.1 and we are seeing an increase in the response time. One query that uses aggregations has seen the response time increase by 1-1.5s. Setup \* 3 Mast… --- ## [Writing DSL Query to find documents for dyanmic fields in the index](https://discuss.elastic.co/t/writing-dsl-query-to-find-documents-for-dyanmic-fields-in-the-index/278985)
**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\ **Replies:** 1\ **Last updated:** [July 18, 2021, 4:35pm UTC](https://discuss.elastic.co/t/writing-dsl-query-to-find-documents-for-dyanmic-fields-in-the-index/278985 "2021-07-18T16:35:06Z")
Hi All, I want to write a DSL Query that will fetch results from fields. GET condition/\_search { "query": { "range" : { "tag.value" : { "gte" : "operational.threshold", … --- ## [Unknown issue with Elastic snapshots](https://discuss.elastic.co/t/unknown-issue-with-elastic-snapshots/278442)
**Author:** [@kcarsey](https://discuss.elastic.co/u/kcarsey)\ **Replies:** 1\ **Last updated:** [July 18, 2021, 1:49pm UTC](https://discuss.elastic.co/t/unknown-issue-with-elastic-snapshots/278442 "2021-07-18T13:49:27Z")
I will provide a bit of backstory information here as I think it could be relevant. I run several ec2 Elastic clusters in AWS, all being backed up by snapshot to aws s3. I have recently created two new clusters in us-e… --- ## [S3 bucket size holding the snapshots is 2-2.5x of the total disk used of the cluster](https://discuss.elastic.co/t/s3-bucket-size-holding-the-snapshots-is-2-2-5x-of-the-total-disk-used-of-the-cluster/278944)
**Author:** [@MitParekh](https://discuss.elastic.co/u/MitParekh)\ **Replies:** 3\ **Last updated:** [July 17, 2021, 8:01pm UTC](https://discuss.elastic.co/t/s3-bucket-size-holding-the-snapshots-is-2-2-5x-of-the-total-disk-used-of-the-cluster/278944 "2021-07-17T20:01:49Z")
Hi, I have a cluster (ES 7.11.1) with 6 nodes and the total disk used is roughly ~4.5TB. I store logging data in it using data streams. My data stream patterns are like abc-lmn-xyz. The data retention period is 14 days. … --- ## [Composite aggregation on runtime field in 6.2](https://discuss.elastic.co/t/composite-aggregation-on-runtime-field-in-6-2/278990)
**Author:** [@strutdepot-discsn](https://discuss.elastic.co/u/strutdepot-discsn)\ **Replies:** 0\ **Last updated:** [July 18, 2021, 1:15pm UTC](https://discuss.elastic.co/t/composite-aggregation-on-runtime-field-in-6-2/278990 "2021-07-18T13:15:09Z")
I have "city", "state" and "country" fields in the index and need to calculate the document count by each city. The index contains more than 2 million documents. This was my first stab at it: get students/\_search { "… --- ## [Expected \[SRART\_OBJECT\] but found \[START\_ARRAY\]](https://discuss.elastic.co/t/expected-srart-object-but-found-start-array/278667)
**Author:** [@Eran1](https://discuss.elastic.co/u/Eran1)\ **Replies:** 4\ **Last updated:** [July 18, 2021, 12:23pm UTC](https://discuss.elastic.co/t/expected-srart-object-but-found-start-array/278667 "2021-07-18T12:23:13Z")
Hi, I'm using python to connect to elastic as following: import urllib3 from elasticsearch import Elasticsearch from elasticsearch.connection import create\_ssl\_context import configparser def get\_es\_session(es\_u… --- ## [Could Update/Get/Delete an document on an alias accociated to multiple indexes?](https://discuss.elastic.co/t/could-update-get-delete-an-document-on-an-alias-accociated-to-multiple-indexes/278986)
**Author:** [@light\_chen](https://discuss.elastic.co/u/light_chen)\ **Replies:** 1\ **Last updated:** [July 18, 2021, 12:02pm UTC](https://discuss.elastic.co/t/could-update-get-delete-an-document-on-an-alias-accociated-to-multiple-indexes/278986 "2021-07-18T12:02:25Z")
In order to reduce the size of index (I hear that it is better to keep the size lower than 25~30GB per index), I split the data into several indexes using Rollover API. Then I create two alias, in my expectation, the on… --- ## [Reindexing Old index](https://discuss.elastic.co/t/reindexing-old-index/278360)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 3\ **Last updated:** [July 18, 2021, 3:50am UTC](https://discuss.elastic.co/t/reindexing-old-index/278360 "2021-07-18T03:50:51Z")
I want to reindex old index but the problem my alias is writing to current index health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green ope… --- ## [Data Format Problem in Elastic: Direct Beats vs Logstash](https://discuss.elastic.co/t/data-format-problem-in-elastic-direct-beats-vs-logstash/278972)
**Author:** [@fynex](https://discuss.elastic.co/u/fynex)\ **Replies:** 0\ **Last updated:** [July 17, 2021, 1:20pm UTC](https://discuss.elastic.co/t/data-format-problem-in-elastic-direct-beats-vs-logstash/278972 "2021-07-17T13:20:36Z")
Hi everyone, I have currently a problem to ingest my logs into elasticsearch the correct way, because the logs look different from the beats=\>logstash=\>elastic input than the beats=\>elastic input (I set up two elasticse… --- ## [Version conflict for bulk index - do the all the docs included into the bulk index fail?](https://discuss.elastic.co/t/version-conflict-for-bulk-index-do-the-all-the-docs-included-into-the-bulk-index-fail/278951)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 3\ **Last updated:** [July 17, 2021, 10:07am UTC](https://discuss.elastic.co/t/version-conflict-for-bulk-index-do-the-all-the-docs-included-into-the-bulk-index-fail/278951 "2021-07-17T10:07:14Z")
From time to time, I’ve seen bulk index fails because of version conflicts. Because of how things are, I’m ok with some docs failing to index because it exists already. However, in these cases, do all the documents get r… --- ## [Bulk insert is too slow](https://discuss.elastic.co/t/bulk-insert-is-too-slow/278794)
**Author:** [@Hooman\_Bahreini](https://discuss.elastic.co/u/Hooman_Bahreini)\ **Replies:** 8\ **Last updated:** [July 17, 2021, 9:35am UTC](https://discuss.elastic.co/t/bulk-insert-is-too-slow/278794 "2021-07-17T09:35:32Z")
I have a 2 node Elasticsearch (Version 6.8) cluster (they are running on 2 Ubuntu servers with 4GB RAM) and I am running MySQL on the same servers. The bulk insert is writing 100 documents at a time and each insert take… --- ## [Wrong examples in the rank feature query documentation](https://discuss.elastic.co/t/wrong-examples-in-the-rank-feature-query-documentation/278956)
**Author:** [@rueian](https://discuss.elastic.co/u/rueian)\ **Replies:** 0\ **Last updated:** [July 17, 2021, 4:52am UTC](https://discuss.elastic.co/t/wrong-examples-in-the-rank-feature-query-documentation/278956 "2021-07-17T04:52:01Z")
Hi, I noticed that the rank feature query documentation contains the following examples: PUT /test/\_doc/2?refresh { .... "topics": { "sports": 35, "formula one": 65, "brazil": 20 } } PUT /test/\_doc/3?… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=605) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=607)