# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=579 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 580 --- ## [Sending logs to ElasticSearch directly](https://discuss.elastic.co/t/sending-logs-to-elasticsearch-directly/283640)
**Author:** [@adm3](https://discuss.elastic.co/u/adm3)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 9:42am UTC](https://discuss.elastic.co/t/sending-logs-to-elasticsearch-directly/283640 "2021-09-08T09:42:38Z")
I'm trying to send logs directly to elasticsearch from Velocirpator, but I'm getting the below error when enabled xpack security features. below is my elastic config file ---------------------------------- Security -----… --- ## [Elastic can't connect remote cluster](https://discuss.elastic.co/t/elastic-cant-connect-remote-cluster/283003)
**Author:** [@lisiyu](https://discuss.elastic.co/u/lisiyu)\ **Replies:** 4\ **Last updated:** [September 8, 2021, 8:47am UTC](https://discuss.elastic.co/t/elastic-cant-connect-remote-cluster/283003 "2021-09-08T08:47:09Z")
Verison elasticsearch: 7.13.1 cluster-one and cluster-two have same config. apiVersion: apps/v1 kind: StatefulSet metadata: name: elasticsearch labels: app: elasticsearch spec: selector: matchLabels: … --- ## [Updation and deletion of fields from ingest attachment arrays](https://discuss.elastic.co/t/updation-and-deletion-of-fields-from-ingest-attachment-arrays/283619)
**Author:** [@Reghu\_Shanker](https://discuss.elastic.co/u/Reghu_Shanker)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 8:06am UTC](https://discuss.elastic.co/t/updation-and-deletion-of-fields-from-ingest-attachment-arrays/283619 "2021-09-08T08:06:01Z")
Hi, I have documents with multiple attachments in each of them. I am using ingest attachment processor to extract data and store it in elastic search document. These attachments are stored in ingest attachment arrays.… --- ## [Disk space not reducing after snapshot deletion](https://discuss.elastic.co/t/disk-space-not-reducing-after-snapshot-deletion/283301)
**Author:** [@arun\_sharma2](https://discuss.elastic.co/u/arun_sharma2)\ **Replies:** 7\ **Last updated:** [September 8, 2021, 6:59am UTC](https://discuss.elastic.co/t/disk-space-not-reducing-after-snapshot-deletion/283301 "2021-09-08T06:59:01Z")
Deleted snapshot of the indices but still the disk space is not reducing . --- ## [Property mapping elasticsearch](https://discuss.elastic.co/t/property-mapping-elasticsearch/283580)
**Author:** [@woal\_idal](https://discuss.elastic.co/u/woal_idal)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 6:57am UTC](https://discuss.elastic.co/t/property-mapping-elasticsearch/283580 "2021-09-08T06:57:52Z")
When trying to read certain fields from ElasticSearch, I noticed that if I do not include a text attribute then it will not map the variable name to the field. It will read null for that specific field. Lets say I have a… --- ## [Change snapshot directory](https://discuss.elastic.co/t/change-snapshot-directory/283055)
**Author:** [@Cihan\_Tunali](https://discuss.elastic.co/u/Cihan_Tunali)\ **Replies:** 1\ **Last updated:** [September 8, 2021, 6:22am UTC](https://discuss.elastic.co/t/change-snapshot-directory/283055 "2021-09-08T06:22:40Z")
Hello I am using a shared folder to store snapshots which is a nfs. I need to change NFS directory but I dont want to lose existing backups. I copied existing data to new folder and added that new folder as new reposito… --- ## [Configure Email using watcher](https://discuss.elastic.co/t/configure-email-using-watcher/283498)
**Author:** [@Bryce\_Fernandes](https://discuss.elastic.co/u/Bryce_Fernandes)\ **Replies:** 4\ **Last updated:** [September 8, 2021, 3:37am UTC](https://discuss.elastic.co/t/configure-email-using-watcher/283498 "2021-09-08T03:37:19Z")
Hi, I want to setup email alerting on cluster using watcher. I have done this before on single node cluster and worked fine. Have query regarding the setup on multi node cluster. Do i have to update the email settings … --- ## [Clarify behavior of FunctionScoreQuery when there are more than \`size\` matches to the \`query\`](https://discuss.elastic.co/t/clarify-behavior-of-functionscorequery-when-there-are-more-than-size-matches-to-the-query/283596)
**Author:** [@alexklibisz](https://discuss.elastic.co/u/alexklibisz)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 2:25am UTC](https://discuss.elastic.co/t/clarify-behavior-of-functionscorequery-when-there-are-more-than-size-matches-to-the-query/283596 "2021-09-08T02:25:21Z")
I'm running into an issue with the FunctionScoreQuery and would appreciate some clarification of the query behavior. Say I'm running a function\_score query with size=100. The actual query matches 101 documents. How many… --- ## [Best way to index human names?](https://discuss.elastic.co/t/best-way-to-index-human-names/283591)
**Author:** [@rdate](https://discuss.elastic.co/u/rdate)\ **Replies:** 0\ **Last updated:** [September 8, 2021, 12:30am UTC](https://discuss.elastic.co/t/best-way-to-index-human-names/283591 "2021-09-08T00:30:07Z")
Hello! I am building an index that includes personal names and after a bunch of searching around I haven't been able to find the best way to index these names to allow for the large amount of variation in name constructi… --- ## [Validation\_exception: Validation Failed: 1: this action would add \[2\] total shards, but this cluster currently has \[2000\]/\[2000\] maximum shards open;](https://discuss.elastic.co/t/validation-exception-validation-failed-1-this-action-would-add-2-total-shards-but-this-cluster-currently-has-2000-2000-maximum-shards-open/283462)
**Author:** [@Danilo\_Camargo](https://discuss.elastic.co/u/Danilo_Camargo)\ **Replies:** 7\ **Last updated:** [September 7, 2021, 11:53pm UTC](https://discuss.elastic.co/t/validation-exception-validation-failed-1-this-action-would-add-2-total-shards-but-this-cluster-currently-has-2000-2000-maximum-shards-open/283462 "2021-09-07T23:53:23Z")
Hi everyone. I know this is a similar topic to others, but so far it seems odd to me still. I have the message above on my instance, however when I query for \_cluster/stats I have this: "cluster\_name" : "docker-cluster"… --- ## [If condtion not working in ingest pipeline](https://discuss.elastic.co/t/if-condtion-not-working-in-ingest-pipeline/283589)
**Author:** [@venkat\_swaminathan](https://discuss.elastic.co/u/venkat_swaminathan)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 11:12pm UTC](https://discuss.elastic.co/t/if-condtion-not-working-in-ingest-pipeline/283589 "2021-09-07T23:12:11Z")
I am trying to set up a ingest pipelines for my Kubernetes cluster logs, but when I try to evaluate a field in the pipeline processor, fields with no dot works ( "if": "ctx.tags == 'audit'") & field with dot characters … --- ## [Elasticsearch query](https://discuss.elastic.co/t/elasticsearch-query/283575)
**Author:** [@Elk\_huh](https://discuss.elastic.co/u/Elk_huh)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 7:24pm UTC](https://discuss.elastic.co/t/elasticsearch-query/283575 "2021-09-07T19:24:19Z")
My siem only allows any querys inside query{} I need to do a sort by date like this but the sort needs to be inside the query , any ideas GET /index-\*/\_search { "sort" : \[ { "@timestamp" : {"order": "desc"}} \]… --- ## [How to delete a task in Elasticsearch v7.14](https://discuss.elastic.co/t/how-to-delete-a-task-in-elasticsearch-v7-14/283321)
**Author:** [@Tim\_Estes](https://discuss.elastic.co/u/Tim_Estes)\ **Replies:** 7\ **Last updated:** [September 7, 2021, 5:49pm UTC](https://discuss.elastic.co/t/how-to-delete-a-task-in-elasticsearch-v7-14/283321 "2021-09-07T17:49:45Z")
I'm currently running a delete\_by\_query job and setting the wait\_for\_completion argument to false. In the documentation, it says: Running delete by query asynchronously If the request contains wait\_for\_completion=fals… --- ## [Use an Analyzer within a painless script and access the produced terms](https://discuss.elastic.co/t/use-an-analyzer-within-a-painless-script-and-access-the-produced-terms/283474)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 4\ **Last updated:** [September 7, 2021, 5:04pm UTC](https://discuss.elastic.co/t/use-an-analyzer-within-a-painless-script-and-access-the-produced-terms/283474 "2021-09-07T17:04:50Z")
Hi All, I'm trying to find out if something is possible or not within Painless. I'd like to use the English analyzer within a Painless script. I'd then like to use the same painless script to iterate over the created t… --- ## [Search DSL Query value with '(single quote) and space in elastic 6.8](https://discuss.elastic.co/t/search-dsl-query-value-with-single-quote-and-space-in-elastic-6-8/281091)
**Author:** [@joseph-l.amalraj](https://discuss.elastic.co/u/joseph-l.amalraj)\ **Replies:** 6\ **Last updated:** [September 7, 2021, 5:02pm UTC](https://discuss.elastic.co/t/search-dsl-query-value-with-single-quote-and-space-in-elastic-6-8/281091 "2021-09-07T17:02:10Z")
Hi, Actually, i am trying to do Search DSL Query value with '(single quote) like below query (1) and some times with single space Query (2) below, i am not getting expected results, Could you please suggest me for that.… --- ## [How to copy from one nested field to another in elasticsearch?](https://discuss.elastic.co/t/how-to-copy-from-one-nested-field-to-another-in-elasticsearch/283549)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [September 7, 2021, 3:56pm UTC](https://discuss.elastic.co/t/how-to-copy-from-one-nested-field-to-another-in-elasticsearch/283549 "2021-09-07T15:56:57Z")
Hi all, I'm trying to copy from one field to another. I want to copy data from fanLocation.lng to fanLocation.lon in an index. I have already mapped both geo fields with geo\_point i'm unable to use when using nested … --- ## [Cluster stops workning when shutting down master marked with a star? \[7.11.2\]](https://discuss.elastic.co/t/cluster-stops-workning-when-shutting-down-master-marked-with-a-star-7-11-2/283545)
**Author:** [@mbooh](https://discuss.elastic.co/u/mbooh)\ **Replies:** 9\ **Last updated:** [September 7, 2021, 3:40pm UTC](https://discuss.elastic.co/t/cluster-stops-workning-when-shutting-down-master-marked-with-a-star-7-11-2/283545 "2021-09-07T15:40:17Z")
Hi! I have a three node cluster where all nodes are maste nodes and I'm using Kibana for checking status and running queries. Running the command: GET \_cat/nodes Gives me: ip heap.percent ram.percent cpu lo… --- ## [Rally \_bulk error 400 "type is missing"](https://discuss.elastic.co/t/rally-bulk-error-400-type-is-missing/283073)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 6\ **Last updated:** [September 2, 2021, 12:39pm UTC](https://discuss.elastic.co/t/rally-bulk-error-400-type-is-missing/283073 "2021-09-02T12:39:31Z")
Hey there, I'm trying to import a custom track exported from an old ES version (still using 'type' field) into another ES cluster (same version). This is the error I faced: \[ERROR\] Cannot race. Error in load generato… --- ## [ElasticSearch script query incorrect values](https://discuss.elastic.co/t/elasticsearch-script-query-incorrect-values/283547)
**Author:** [@me.mohammed](https://discuss.elastic.co/u/me.mohammed)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 2:32pm UTC](https://discuss.elastic.co/t/elasticsearch-script-query-incorrect-values/283547 "2021-09-07T14:32:01Z")
Hello everyone, I'm trying to apply this query GET rdbms\_sync\_idx/\_search { "query":{ "nested":{ "path":"bogoDeals", "query":{ "bool":{ "filter":\[ … --- ## [How to read Different field names with same field value - Elasticsearch](https://discuss.elastic.co/t/how-to-read-different-field-names-with-same-field-value-elasticsearch/283314)
**Author:** [@woal\_idal](https://discuss.elastic.co/u/woal_idal)\ **Replies:** 2\ **Last updated:** [September 7, 2021, 2:08pm UTC](https://discuss.elastic.co/t/how-to-read-different-field-names-with-same-field-value-elasticsearch/283314 "2021-09-07T14:08:32Z")
I have to separate index patterns that will have their own unique fields. For instance in index1 it will contain a field property CorrelationId index2 it will contain a field property UniqueCorrelationId these two fie… --- ## [How to get the completness of each column by group](https://discuss.elastic.co/t/how-to-get-the-completness-of-each-column-by-group/283542)
**Author:** [@MichaelG](https://discuss.elastic.co/u/MichaelG)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 1:51pm UTC](https://discuss.elastic.co/t/how-to-get-the-completness-of-each-column-by-group/283542 "2021-09-07T13:51:49Z")
I'm trying to get the completeness of every column grouped by a categorical field that know to be 100% complete. Currently I'm able to get the completeness for any given column, grouped by the grouping field like this: … --- ## [FSCrawler not able to connect to elastic search](https://discuss.elastic.co/t/fscrawler-not-able-to-connect-to-elastic-search/283530)
**Author:** [@Reghu\_Shanker](https://discuss.elastic.co/u/Reghu_Shanker)\ **Replies:** 6\ **Last updated:** [September 7, 2021, 1:38pm UTC](https://discuss.elastic.co/t/fscrawler-not-able-to-connect-to-elastic-search/283530 "2021-09-07T13:38:05Z")
Hi, I have an AWS Elastic Search Instance. I am trying to us FSCrawler along with it. My elastic search version is 7.10 and FSCrawler is fscrawler-es7-2.7.zip I am getting the following error: 17:51:21,439 e\[33mWARN e… --- ## [Doesn't match any of the locations specified by path.repo because this setting is empty"](https://discuss.elastic.co/t/doesnt-match-any-of-the-locations-specified-by-path-repo-because-this-setting-is-empty/283527)
**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\ **Replies:** 4\ **Last updated:** [September 7, 2021, 1:06pm UTC](https://discuss.elastic.co/t/doesnt-match-any-of-the-locations-specified-by-path-repo-because-this-setting-is-empty/283527 "2021-09-07T13:06:03Z")
Hello friends i have a problem. I can't backup indices. my elasticsearch.yml file: # ----------------------------------- Paths ------------------------------------ # # Path to directory where to store the data (separat… --- ## [How to assign \_score value to some other field using script\_fields](https://discuss.elastic.co/t/how-to-assign-score-value-to-some-other-field-using-script-fields/283531)
**Author:** [@voldemort02](https://discuss.elastic.co/u/voldemort02)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 12:43pm UTC](https://discuss.elastic.co/t/how-to-assign-score-value-to-some-other-field-using-script-fields/283531 "2021-09-07T12:43:45Z")
I would like to inject \_score in my \_source on runtime. I used this script but it is not working "script\_fields": { "\_score": { "script": { "lang": "painless", "source": "\_score.value" }… --- ## [Is it possible to cumulative\_sum over the metric of a moving interval?](https://discuss.elastic.co/t/is-it-possible-to-cumulative-sum-over-the-metric-of-a-moving-interval/283519)
**Author:** [@di.lu](https://discuss.elastic.co/u/di.lu)\ **Replies:** 1\ **Last updated:** [September 7, 2021, 10:15am UTC](https://discuss.elastic.co/t/is-it-possible-to-cumulative-sum-over-the-metric-of-a-moving-interval/283519 "2021-09-07T10:15:31Z")
Hiii ES community! I've been stuck on a tricky requirement for quite a while.. So I have a time series data capturing when a user has used what feature as which identity, lie this: | feature | is\_free\_trial | trac… --- ## [Upgrade from Basic license to Gold License](https://discuss.elastic.co/t/upgrade-from-basic-license-to-gold-license/283499)
**Author:** [@David\_Dennis](https://discuss.elastic.co/u/David_Dennis)\ **Replies:** 2\ **Last updated:** [September 7, 2021, 10:10am UTC](https://discuss.elastic.co/t/upgrade-from-basic-license-to-gold-license/283499 "2021-09-07T10:10:34Z")
Hi, I will like to seek guidance here. I have an Elasticsearch cluster and Kibana, currently an On-prem deployment. I want to enable Alerting, but the basic license does not provide connectors like Slack, Pagerduty, etc… --- ## [Using fleet agent with proxy](https://discuss.elastic.co/t/using-fleet-agent-with-proxy/283517)
**Author:** [@hugohendriks](https://discuss.elastic.co/u/hugohendriks)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 9:51am UTC](https://discuss.elastic.co/t/using-fleet-agent-with-proxy/283517 "2021-09-07T09:51:58Z")
Hi, I am trying to install the elastic agent 7.14.0 on linux. I am behind a proxy so we tried setting the proxy by doing: EXPORT HTTPS\_PROXY=ip:port As I saw Elastic Agent (Fleet Deployment) behind a proxy only I dont… --- ## [Index stays at massive size after split](https://discuss.elastic.co/t/index-stays-at-massive-size-after-split/283453)
**Author:** [@rcz](https://discuss.elastic.co/u/rcz)\ **Replies:** 5\ **Last updated:** [September 7, 2021, 8:50am UTC](https://discuss.elastic.co/t/index-stays-at-massive-size-after-split/283453 "2021-09-07T08:50:26Z")
Hi, I had mistakenly made a very large index: 1 shard of 406 GB (1.8b documents). Then I split it into 16 shards hoping to get ~25GB sizes. I think the new index triggered a template, since it also got 1 replica shard… --- ## [Client SSL and Server SSL - ES Java Client](https://discuss.elastic.co/t/client-ssl-and-server-ssl-es-java-client/283507)
**Author:** [@Muthukumaran\_Kothand](https://discuss.elastic.co/u/Muthukumaran_Kothand)\ **Replies:** 0\ **Last updated:** [September 7, 2021, 8:40am UTC](https://discuss.elastic.co/t/client-ssl-and-server-ssl-es-java-client/283507 "2021-09-07T08:40:59Z")
Initial excuse - we are still using TransportClient ( PreBuiltXPackTransportClient). Migrating to High Level Rest Client is in progress. This question would still be relevant for High Level Rest Client Meta: Elasticse… --- ## [How do I use Elasticsearch aggregation using python elasticsearch\_dsl library?](https://discuss.elastic.co/t/how-do-i-use-elasticsearch-aggregation-using-python-elasticsearch-dsl-library/283345)
**Author:** [@rafiqul](https://discuss.elastic.co/u/rafiqul)\ **Replies:** 3\ **Last updated:** [September 7, 2021, 8:42am UTC](https://discuss.elastic.co/t/how-do-i-use-elasticsearch-aggregation-using-python-elasticsearch-dsl-library/283345 "2021-09-07T08:42:13Z")
I have a python model that creates the index as class Telemetry(DocType): id = Keyword() imei = Keyword() location = field.GeoPoint() timestamp = Date() I would like to query distinct count of imei. Wha… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=578) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=580)