# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=698 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 699 --- ## [Painless processor add field and set name from variable](https://discuss.elastic.co/t/painless-processor-add-field-and-set-name-from-variable/265074)
**Author:** [@ella.danielsson](https://discuss.elastic.co/u/ella.danielsson)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 2:11pm UTC](https://discuss.elastic.co/t/painless-processor-add-field-and-set-name-from-variable/265074 "2021-02-22T14:11:41Z")
Hi, I'm trying to use a painless script processor to split the content of a field and use the result of the split to add new fields to the document. The problem is that I can't figure out how to set a new field, the nam… --- ## [Snapshot: repository\_verification\_exception](https://discuss.elastic.co/t/snapshot-repository-verification-exception/265059)
**Author:** [@rojin](https://discuss.elastic.co/u/rojin)\ **Replies:** 4\ **Last updated:** [February 22, 2021, 1:52pm UTC](https://discuss.elastic.co/t/snapshot-repository-verification-exception/265059 "2021-02-22T13:52:29Z")
Hi! I am trying to do a snapshot for my cluster including 2 nodes. I have a shared file on both of my nodes. node-1 as an NFS server and node-2 as the client. if I add a file to the specified shared directory which is /v… --- ## [File realm users and cluster state size](https://discuss.elastic.co/t/file-realm-users-and-cluster-state-size/265050)
**Author:** [@zvonimir](https://discuss.elastic.co/u/zvonimir)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 1:47pm UTC](https://discuss.elastic.co/t/file-realm-users-and-cluster-state-size/265050 "2021-02-22T13:47:37Z")
Hi. Question about file realm authentication in Elasticsearch... My cluster is deployed in Docker and every time I am deploying changes I recreate containers and on each node execute command for adding user to file real… --- ## [Phrase Suggester Returns Suggestions from Deleted Documents as of 7.0.0](https://discuss.elastic.co/t/phrase-suggester-returns-suggestions-from-deleted-documents-as-of-7-0-0/265068)
**Author:** [@bencody](https://discuss.elastic.co/u/bencody)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 1:39pm UTC](https://discuss.elastic.co/t/phrase-suggester-returns-suggestions-from-deleted-documents-as-of-7-0-0/265068 "2021-02-22T13:39:20Z")
Issue As of Elasticsearch 7.0.0, the Phrase Suggester returns suggestions of deleted documents. I assume this is a bug. However, the documentation on Suggesters | Elasticsearch Reference \[7.11\] | Elastic does not state… --- ## [\[s3-repository\] path is not accessible on master node](https://discuss.elastic.co/t/s3-repository-path-is-not-accessible-on-master-node/264942)
**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\ **Replies:** 5\ **Last updated:** [February 22, 2021, 1:15pm UTC](https://discuss.elastic.co/t/s3-repository-path-is-not-accessible-on-master-node/264942 "2021-02-22T13:15:01Z")
Hello Team, We are trying to configure the snapshot of indices and store over S3 bucket. But we are facing issue when we are trying to configure repository. We are using 3 node cluster and we instlled the repository-s3 … --- ## [Schedule a Job in Elasticsearch](https://discuss.elastic.co/t/schedule-a-job-in-elasticsearch/265032)
**Author:** [@gruselglatz](https://discuss.elastic.co/u/gruselglatz)\ **Replies:** 9\ **Last updated:** [February 22, 2021, 12:56pm UTC](https://discuss.elastic.co/t/schedule-a-job-in-elasticsearch/265032 "2021-02-22T12:56:32Z")
Hi, is it possible to schedule a job in elasticsearch and save it? My requirements are that the team only wants to keep certain messages after xy days to reduce the storage capacity. Can i realize it with rollover, il… --- ## [Use Enrich policy and enrich pipeline processor to check secondary index and update a value](https://discuss.elastic.co/t/use-enrich-policy-and-enrich-pipeline-processor-to-check-secondary-index-and-update-a-value/264840)
**Author:** [@sam3546](https://discuss.elastic.co/u/sam3546)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 11:47am UTC](https://discuss.elastic.co/t/use-enrich-policy-and-enrich-pipeline-processor-to-check-secondary-index-and-update-a-value/264840 "2021-02-22T11:47:43Z")
So i have 2 indexes, A which is periodically updated and contains docs with two fields which are email and reviewed. My second index B has lots of fields including email and reviewed, this index im constantly adding to. … --- ## [Count of unique events](https://discuss.elastic.co/t/count-of-unique-events/265037)
**Author:** [@artobstrel](https://discuss.elastic.co/u/artobstrel)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 10:51am UTC](https://discuss.elastic.co/t/count-of-unique-events/265037 "2021-02-22T10:51:08Z")
I have 5000 unique events. If I try to unique count with default precision value, I get the wrong value: How can I calculate truly unique values without changing the precision? --- ## [Can't merge a non object mapping with an object mapping](https://discuss.elastic.co/t/cant-merge-a-non-object-mapping-with-an-object-mapping/264066)
**Author:** [@Infoxd](https://discuss.elastic.co/u/Infoxd)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 10:25am UTC](https://discuss.elastic.co/t/cant-merge-a-non-object-mapping-with-an-object-mapping/264066 "2021-02-22T10:25:43Z")
Hello, When I'm trying to import this json: { "data": { "args": \["v7.0/4529900134935424/feed", { "limit": 100 }\] }, "@timestamp": "2021-02-11T11:07:02.189Z", "@version": "1" } I'm getting this error: can't… --- ## [Accessing field values in script processor](https://discuss.elastic.co/t/accessing-field-values-in-script-processor/265048)
**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 9:38am UTC](https://discuss.elastic.co/t/accessing-field-values-in-script-processor/265048 "2021-02-22T09:38:32Z")
Hi, I'm studding for the ECE and when reading about script processors to be used in ingestion pipelines I see in the documentation that in order to access the field value I should use the ctx variables You can access th… --- ## [Indices won't close](https://discuss.elastic.co/t/indices-wont-close/262254)
**Author:** [@JuddyBuddy77](https://discuss.elastic.co/u/JuddyBuddy77)\ **Replies:** 3\ **Last updated:** [February 22, 2021, 9:33am UTC](https://discuss.elastic.co/t/indices-wont-close/262254 "2021-02-22T09:33:48Z")
Hello, first post, still learning. Having an issue closing "random" indices, after removing replica shards and using shard allocation awareness. ES 6.8.3, although indices may have been created in ES 5 (I know). Remov… --- ## [Elasticsearch seach using wildcard, range and terms](https://discuss.elastic.co/t/elasticsearch-seach-using-wildcard-range-and-terms/264811)
**Author:** [@lalitesh](https://discuss.elastic.co/u/lalitesh)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 9:28am UTC](https://discuss.elastic.co/t/elasticsearch-seach-using-wildcard-range-and-terms/264811 "2021-02-22T09:28:15Z")
I am trying to write a search DSL query on a Elasticsearch ( Version 7.1 ) index that has fields like, product\_name, exported\_at and category\_id. From the document I understand that I would need to use the wildcard, ran… --- ## [Elasticsearch bulk operation: insert if not existing, otherwise update or add a nested element](https://discuss.elastic.co/t/elasticsearch-bulk-operation-insert-if-not-existing-otherwise-update-or-add-a-nested-element/265034)
**Author:** [@corlee](https://discuss.elastic.co/u/corlee)\ **Replies:** 0\ **Last updated:** [February 22, 2021, 7:50am UTC](https://discuss.elastic.co/t/elasticsearch-bulk-operation-insert-if-not-existing-otherwise-update-or-add-a-nested-element/265034 "2021-02-22T07:50:24Z")
In elasticsearch 7.11.0 I have products as described. { "\_index" : "products", "\_type" : "\_doc", "\_id" : "1234567890123", "\_source" : { "ean" : "1234567890123", "title" : "Very nice product", "mercha… --- ## [Create search request from available json unit test](https://discuss.elastic.co/t/create-search-request-from-available-json-unit-test/264952)
**Author:** [@Rohit\_Sharma](https://discuss.elastic.co/u/Rohit_Sharma)\ **Replies:** 3\ **Last updated:** [February 22, 2021, 6:58am UTC](https://discuss.elastic.co/t/create-search-request-from-available-json-unit-test/264952 "2021-02-22T06:58:27Z")
Hi, I'm new to elastic search. I need to write unit test where I need to create search request object and search response object. I have search response and search request available in JSON. My search request contain… --- ## [Is Xpack related to "master\_not\_discovered\_exception"? 503](https://discuss.elastic.co/t/is-xpack-related-to-master-not-discovered-exception-503/264539)
**Author:** [@rojin](https://discuss.elastic.co/u/rojin)\ **Replies:** 4\ **Last updated:** [February 22, 2021, 6:48am UTC](https://discuss.elastic.co/t/is-xpack-related-to-master-not-discovered-exception-503/264539 "2021-02-22T06:48:01Z")
Hello everyone! I have a single-node cluster running which I have enabled the Xpack security on. I'd like to add a node to this cluster, but I get "master\_not\_discovered\_exception". I have set the discovery.seed\_hosts as… --- ## [java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-12](https://discuss.elastic.co/t/java-net-sockettimeoutexception-30-000-milliseconds-timeout-on-connection-http-outgoing-12/264657)
**Author:** [@vands](https://discuss.elastic.co/u/vands)\ **Replies:** 0\ **Last updated:** [February 18, 2021, 7:58am UTC](https://discuss.elastic.co/t/java-net-sockettimeoutexception-30-000-milliseconds-timeout-on-connection-http-outgoing-12/264657 "2021-02-18T07:58:17Z")
Hi All, Facing the below issue while fetching bulk records using high level rest client builder . java.net.SocketTimeoutException: 30,000 milliseconds timeout on connection http-outgoing-12 . Do I need to change any c… --- ## [How to enable shards allocation of node that was disabled the shards allocation](https://discuss.elastic.co/t/how-to-enable-shards-allocation-of-node-that-was-disabled-the-shards-allocation/264790)
**Author:** [@testsemd\_email](https://discuss.elastic.co/u/testsemd_email)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 5:23am UTC](https://discuss.elastic.co/t/how-to-enable-shards-allocation-of-node-that-was-disabled-the-shards-allocation/264790 "2021-02-22T05:23:03Z")
I disabled shards allocation using curl -XPUT “http://username:password@host:port/\_cluster/settings” -d '{ "transient" :{ "cluster.routing.allocation.exclude.\_ip" : "X.X.X.X" } }' command. Then again enabled usin… --- ## [Elastic node not connecting to master](https://discuss.elastic.co/t/elastic-node-not-connecting-to-master/265026)
**Author:** [@jelbatn](https://discuss.elastic.co/u/jelbatn)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 4:26am UTC](https://discuss.elastic.co/t/elastic-node-not-connecting-to-master/265026 "2021-02-22T04:26:08Z")
I have the following configuration for a multi node elastic cluster. both nodes are running part of a docker swarm. here is the docker yaml config elasticsearch: image: {imagerepo}/elasticsearch:0.0.7-6892bb5 … --- ## [Increase size limit - Python ElasticSearch](https://discuss.elastic.co/t/increase-size-limit-python-elasticsearch/264830)
**Author:** [@test\_tester](https://discuss.elastic.co/u/test_tester)\ **Replies:** 7\ **Last updated:** [February 22, 2021, 4:02am UTC](https://discuss.elastic.co/t/increase-size-limit-python-elasticsearch/264830 "2021-02-22T04:02:16Z")
Hi, I'm currently writing a python script to extract out my elasticsearch documents and the following are my ES parameters that involves the sizing response = es.search(index= es\_index\_list,scroll='5m', size='10000', b… --- ## [Does Index/Shard size affects the performance of search/insert/update query?](https://discuss.elastic.co/t/does-index-shard-size-affects-the-performance-of-search-insert-update-query/264878)
**Author:** [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 3:59am UTC](https://discuss.elastic.co/t/does-index-shard-size-affects-the-performance-of-search-insert-update-query/264878 "2021-02-22T03:59:07Z")
Does Index/Shard size affects the performance of search/create/update query? So suppose I have 2 indexes. In one index I have 2 GB data and in another index I have 10 GB data. If I fire same search/insert/update query on… --- ## [In rollover, Is it possible to update the document of old indexes?](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512)
**Author:** [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Replies:** 16\ **Last updated:** [February 22, 2021, 3:57am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512 "2021-02-22T03:57:41Z")
Hello community.I have implemented rollover feature of elastic search. It will create a new index every day. Below is my question Is it possible to update the document of old indexes ? I have read somewhere that old in… --- ## [ECS Logging for PHP / Question](https://discuss.elastic.co/t/ecs-logging-for-php-question/265006)
**Author:** [@leostereo](https://discuss.elastic.co/u/leostereo)\ **Replies:** 2\ **Last updated:** [February 22, 2021, 3:48am UTC](https://discuss.elastic.co/t/ecs-logging-for-php-question/265006 "2021-02-22T03:48:20Z")
Hi guys, Im trying to ship my application events to my elasticsearch platform. My app and elk are running on different servers (ping reachable). I already have the php library working on a little example script taken f… --- ## [Test and Dev Migration Best Practice](https://discuss.elastic.co/t/test-and-dev-migration-best-practice/264774)
**Author:** [@johnwood](https://discuss.elastic.co/u/johnwood)\ **Replies:** 6\ **Last updated:** [February 22, 2021, 2:43am UTC](https://discuss.elastic.co/t/test-and-dev-migration-best-practice/264774 "2021-02-22T02:43:12Z")
Hi All, Does anyone have and good references for how people are handing the cycle of refreshes from production instances in the cloud back to Dev and Test instances on developer laptops. We are keen to keep dev/test la… --- ## [Elasticsearch cluster performance degradation](https://discuss.elastic.co/t/elasticsearch-cluster-performance-degradation/264915)
**Author:** [@mario12](https://discuss.elastic.co/u/mario12)\ **Replies:** 5\ **Last updated:** [February 22, 2021, 2:37am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-performance-degradation/264915 "2021-02-22T02:37:01Z")
We had a performance degradation for 5-10 minutes intervals. We looked into our monitoring tool and found there was high CPU utilization on the elasticsearch cluster. During this time we also noticed high fetch requests … --- ## [Jre crash after running for days or hours](https://discuss.elastic.co/t/jre-crash-after-running-for-days-or-hours/262439)
**Author:** [@billhong-just](https://discuss.elastic.co/u/billhong-just)\ **Replies:** 8\ **Last updated:** [February 22, 2021, 1:19am UTC](https://discuss.elastic.co/t/jre-crash-after-running-for-days-or-hours/262439 "2021-02-22T01:19:19Z")
Hi community, My single node elasticsearch cluster crashed after running for days or hours. And here are relevant information and logs. Elasticsearch version (bin/elasticsearch --version): 7.10.2 Plugins installed: I… --- ## [Could not connect to SMTP host: xxx, port: nn, response: 554](https://discuss.elastic.co/t/could-not-connect-to-smtp-host-xxx-port-nn-response-554/264761)
**Author:** [@xyz2](https://discuss.elastic.co/u/xyz2)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 12:56am UTC](https://discuss.elastic.co/t/could-not-connect-to-smtp-host-xxx-port-nn-response-554/264761 "2021-02-22T00:56:38Z")
Hi, I am getting below error on watcher email alert. Hosts and port are defined in elasticsearch.yml Could not connect to SMTP host: xxx, port: nn, response: 554" smtp: auth: False starttls.enable: False --- ## [What are the best practices for data retention?](https://discuss.elastic.co/t/what-are-the-best-practices-for-data-retention/264858)
**Author:** [@lachezar.uzunov](https://discuss.elastic.co/u/lachezar.uzunov)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 12:49am UTC](https://discuss.elastic.co/t/what-are-the-best-practices-for-data-retention/264858 "2021-02-22T00:49:42Z")
Hello, I am wondering what is the best practices for handling a big data indexes. For example if a firewall sends way too much logs to elastic stack, what is the best way to handle this situation? Is it possible to arch… --- ## [Cluster rebalancing parameters](https://discuss.elastic.co/t/cluster-rebalancing-parameters/264868)
**Author:** [@gorek](https://discuss.elastic.co/u/gorek)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 12:47am UTC](https://discuss.elastic.co/t/cluster-rebalancing-parameters/264868 "2021-02-22T00:47:23Z")
Currently we have one-node-cluster. This node has high heap usage (from time to time we even see "circuit breaking exception") and high disk usage (currently over high disk watermark value) because it keep lots of indice… --- ## [Simple Search by field query](https://discuss.elastic.co/t/simple-search-by-field-query/264879)
**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\ **Replies:** 0\ **Last updated:** [February 19, 2021, 3:53pm UTC](https://discuss.elastic.co/t/simple-search-by-field-query/264879 "2021-02-19T15:53:07Z")
I'm using the C# library to query a string in my cluster, but keep getting back results thats outside the string i want to search for. I basically want something on the lines of 'Select \* where field = 'some value' In … --- ## [Summing Timeseries](https://discuss.elastic.co/t/summing-timeseries/264883)
**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\ **Replies:** 1\ **Last updated:** [February 22, 2021, 12:42am UTC](https://discuss.elastic.co/t/summing-timeseries/264883 "2021-02-22T00:42:55Z")
Hi, How, in an aggregation, can I sum or do any other calculation across more than one timeseries? Thx D [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=697) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=699)