# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=692 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 693 --- ## [How to get data from elastic using the Collpase method in fluent in C#?](https://discuss.elastic.co/t/how-to-get-data-from-elastic-using-the-collpase-method-in-fluent-in-c/265857)
**Author:** [@Casrlos1815](https://discuss.elastic.co/u/Casrlos1815)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 7:53pm UTC](https://discuss.elastic.co/t/how-to-get-data-from-elastic-using-the-collpase-method-in-fluent-in-c/265857 "2021-03-01T19:53:44Z")
I'm hoping to find the answer to this. I have a C# application that bulk downloads elastic data according to user parameters. Some of the requests can be for all data that don't require parameters. In elastic I have an i… --- ## [New to Ingest Pipeline](https://discuss.elastic.co/t/new-to-ingest-pipeline/265643)
**Author:** [@maheshe](https://discuss.elastic.co/u/maheshe)\ **Replies:** 3\ **Last updated:** [March 1, 2021, 6:46pm UTC](https://discuss.elastic.co/t/new-to-ingest-pipeline/265643 "2021-03-01T18:46:28Z")
Hi: I have an index intune-\* where I need to modify some fields. Once I create the index pipeline how do I tag it to the appropriate Index ? I have a rolling index I read this documentation but wasnt clear on step-9 ..… --- ## [\_update\_by\_query "lenient" flag not recognized](https://discuss.elastic.co/t/update-by-query-lenient-flag-not-recognized/265639)
**Author:** [@dan3](https://discuss.elastic.co/u/dan3)\ **Replies:** 1\ **Last updated:** [March 1, 2021, 3:30pm UTC](https://discuss.elastic.co/t/update-by-query-lenient-flag-not-recognized/265639 "2021-03-01T15:30:36Z")
I'm having an issue with updating an index via \_update\_by\_query. I have certain fields that are causing format errors so I'm trying to skip them using the "lenient" flag outlined in the documentation. I'm using elasticse… --- ## [Dynamic Templates on Documents with Inner Objects](https://discuss.elastic.co/t/dynamic-templates-on-documents-with-inner-objects/265821)
**Author:** [@Eduardo\_Iglesias](https://discuss.elastic.co/u/Eduardo_Iglesias)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 2:50pm UTC](https://discuss.elastic.co/t/dynamic-templates-on-documents-with-inner-objects/265821 "2021-03-01T14:50:57Z")
Hello community, I'm trying to apply a dynamic template to my index, even though the console doesn't gives me any error when creating the dynamic template, my documents are still taking the default elasticsearch mappings… --- ## [NLP - Typehead](https://discuss.elastic.co/t/nlp-typehead/265818)
**Author:** [@Chirasmita\_Mallick](https://discuss.elastic.co/u/Chirasmita_Mallick)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 2:28pm UTC](https://discuss.elastic.co/t/nlp-typehead/265818 "2021-03-01T14:28:41Z")
Hi, I am pretty new to Elastic Search and work primarily on the NLP aspects of improving Search on Elastic Search. I wanted to understand if there is any value if the ordered element was selected from the typeahead in t… --- ## [Index names are getting generated as 2021.53](https://discuss.elastic.co/t/index-names-are-getting-generated-as-2021-53/265763)
**Author:** [@prajwalgmpp](https://discuss.elastic.co/u/prajwalgmpp)\ **Replies:** 4\ **Last updated:** [March 1, 2021, 2:18pm UTC](https://discuss.elastic.co/t/index-names-are-getting-generated-as-2021-53/265763 "2021-03-01T14:18:28Z")
Hi All.. The syntax for naming our indices for different applications is "application-YYYY-ww". But we are having some indices that are getting generated as application-2021.53. And they have significant sizes too, the… --- ## [Understanding fielddata mapping parameter](https://discuss.elastic.co/t/understanding-fielddata-mapping-parameter/265798)
**Author:** [@stravag](https://discuss.elastic.co/u/stravag)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 12:58pm UTC](https://discuss.elastic.co/t/understanding-fielddata-mapping-parameter/265798 "2021-03-01T12:58:54Z")
I'm attempting to build a kind of "next word prediction" using elasticsearch. The goal is to have suggest search terms based on different fields of the index. I found a solution based on the work done here https://bilya… --- ## [A question on anomaly detection](https://discuss.elastic.co/t/a-question-on-anomaly-detection/265719)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 4\ **Last updated:** [March 1, 2021, 12:56pm UTC](https://discuss.elastic.co/t/a-question-on-anomaly-detection/265719 "2021-03-01T12:56:06Z")
So we have succeeded in putting in a process which can ingest one line csv logs. Lots of them. Now the next stage is to put in some sort of anomaly detection. However here is the problem I am facing. I am not a domain e… --- ## [Rs.8000.00 withdrawn from ATM using logstash](https://discuss.elastic.co/t/rs-8000-00-withdrawn-from-atm-using-logstash/265778)
**Author:** [@padamrai](https://discuss.elastic.co/u/padamrai)\ **Replies:** 2\ **Last updated:** [March 1, 2021, 12:10pm UTC](https://discuss.elastic.co/t/rs-8000-00-withdrawn-from-atm-using-logstash/265778 "2021-03-01T12:10:19Z")
how to get amount from above sentence and convert into integer. --- ## [How to access data created by Greylog](https://discuss.elastic.co/t/how-to-access-data-created-by-greylog/265786)
**Author:** [@daniel90](https://discuss.elastic.co/u/daniel90)\ **Replies:** 2\ **Last updated:** [March 1, 2021, 11:32am UTC](https://discuss.elastic.co/t/how-to-access-data-created-by-greylog/265786 "2021-03-01T11:32:42Z")
According to I would do a select statement like this: curl -X POST "localhost:9200/\_sql?format=txt&pretty" -H 'Content-Type: application/json' -d' { "query": "SELECT \* FROM greylog\_10" } ' But that gives me an er… --- ## [Elasticsearch Number of Replicas](https://discuss.elastic.co/t/elasticsearch-number-of-replicas/265593)
**Author:** [@dfoot](https://discuss.elastic.co/u/dfoot)\ **Replies:** 2\ **Last updated:** [March 1, 2021, 10:39am UTC](https://discuss.elastic.co/t/elasticsearch-number-of-replicas/265593 "2021-03-01T10:39:18Z")
Elasticsearch only has one node I created template in error e.g. 1 shard (Primary) and 1 replica so I have updated the template for no replica. PUT friday-000012/\_settings {"number\_of\_replicas": 0} I checked the templ… --- ## [Elastalert module error](https://discuss.elastic.co/t/elastalert-module-error/265723)
**Author:** [@Sarmad](https://discuss.elastic.co/u/Sarmad)\ **Replies:** 2\ **Last updated:** [March 1, 2021, 7:16am UTC](https://discuss.elastic.co/t/elastalert-module-error/265723 "2021-03-01T07:16:52Z")
Hi, I am trying to setup elastalert on Amazon Linux ami but getting this screenshot error when I run elastalert python3 -m elastalert.elastalert --verbose --rule example\_rules/example\_frequency.yaml I have tried wit… --- ## [Data loss in bulk update for field type date using painless script](https://discuss.elastic.co/t/data-loss-in-bulk-update-for-field-type-date-using-painless-script/265761)
**Author:** [@Manjunath\_Kadrolli](https://discuss.elastic.co/u/Manjunath_Kadrolli)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 7:16am UTC](https://discuss.elastic.co/t/data-loss-in-bulk-update-for-field-type-date-using-painless-script/265761 "2021-03-01T07:16:01Z")
Following is a row from my bulk update http body When i run the same for small set of records (100) the same works fine but if i trigger the for the entire DB the the valueTimestamp field always null where other values … --- ## [How to configure ingest pipeline with filebeat to send filtered data to elastic search](https://discuss.elastic.co/t/how-to-configure-ingest-pipeline-with-filebeat-to-send-filtered-data-to-elastic-search/265755)
**Author:** [@chintu1411](https://discuss.elastic.co/u/chintu1411)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 6:51am UTC](https://discuss.elastic.co/t/how-to-configure-ingest-pipeline-with-filebeat-to-send-filtered-data-to-elastic-search/265755 "2021-03-01T06:51:24Z")
Hi All, this is very first time we are using ELK with filebeat. we have been instructed to use ingest pipeline to use it with filebeat to filter the data. all over the internet and elastic.co only its given how to wri… --- ## [Elasticsearch IOPS](https://discuss.elastic.co/t/elasticsearch-iops/265680)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 10\ **Last updated:** [March 1, 2021, 6:10am UTC](https://discuss.elastic.co/t/elasticsearch-iops/265680 "2021-03-01T06:10:15Z")
Hello Team I am having Elasticsearch version 5.6.3 running on RHEL 7.4. This Cluster is of 10 nodes. Hardware : 8 CPU and 32 GB RAM. Hard Disk : HDD { CEPH Storage } Elastic Data Paths : Multiple { 7 Different mount … --- ## [CPU running high only on one node at time in the ES cluster](https://discuss.elastic.co/t/cpu-running-high-only-on-one-node-at-time-in-the-es-cluster/265708)
**Author:** [@sbk-elk](https://discuss.elastic.co/u/sbk-elk)\ **Replies:** 5\ **Last updated:** [March 1, 2021, 5:03am UTC](https://discuss.elastic.co/t/cpu-running-high-only-on-one-node-at-time-in-the-es-cluster/265708 "2021-03-01T05:03:53Z")
Not sure why only one node in the cluster has such high CPU when there is nothing happening in the cluster. top - 00:34:43 up 137 days, 17:43, 1 user, load average: 1.24, 2.14, 3.15 Tasks: 198 total, 1 running, 197 … --- ## [ILM how to delete index after days](https://discuss.elastic.co/t/ilm-how-to-delete-index-after-days/265490)
**Author:** [@thewasta](https://discuss.elastic.co/u/thewasta)\ **Replies:** 3\ **Last updated:** [March 1, 2021, 12:09am UTC](https://discuss.elastic.co/t/ilm-how-to-delete-index-after-days/265490 "2021-03-01T00:09:39Z")
My Enviroment { "name" : "5D776AA", "cluster\_name" : "rust-cluster", "cluster\_uuid" : "unlQZ9RcTTy34WDJkHZ1wA", "version" : { "number" : "7.10.2", "build\_flavor" : "default", "build\_type" : "deb", … --- ## [Aggregation to find largest range (diff of min max)](https://discuss.elastic.co/t/aggregation-to-find-largest-range-diff-of-min-max/265710)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 2\ **Last updated:** [March 1, 2021, 12:03am UTC](https://discuss.elastic.co/t/aggregation-to-find-largest-range-diff-of-min-max/265710 "2021-03-01T00:03:16Z")
Is there a way to quickly find the largest range of values (i.e. the difference of min and max within a timeframe)? What I want to do: in a time series with an example doc structured as something like below, find the pr… --- ## [Calculating size of record in queue](https://discuss.elastic.co/t/calculating-size-of-record-in-queue/265727)
**Author:** [@pikomen](https://discuss.elastic.co/u/pikomen)\ **Replies:** 1\ **Last updated:** [February 28, 2021, 11:35pm UTC](https://discuss.elastic.co/t/calculating-size-of-record-in-queue/265727 "2021-02-28T23:35:30Z")
hi, any way to calculate record size in write.queue\_size? from 7.9 the write.queue\_size was updated from 200 to 10000 and I wonder if the heap size of 16 Gb can hold all the 10000 requests (most of them bulk requests) i… --- ## [Multi \_update\_by\_query API like MultiSearch \_msearch - how to? possible?](https://discuss.elastic.co/t/multi-update-by-query-api-like-multisearch-msearch-how-to-possible/261673)
**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\ **Replies:** 3\ **Last updated:** [February 28, 2021, 11:15pm UTC](https://discuss.elastic.co/t/multi-update-by-query-api-like-multisearch-msearch-how-to-possible/261673 "2021-02-28T23:15:28Z")
Hi all, I have following question regarding the multiple search api \_msearch Is there a way to do the same by using the \_update\_by\_query api ? UseCase: change entries of fields based on mutliple bool query like: POST… --- ## [Reindexing error](https://discuss.elastic.co/t/reindexing-error/265736)
**Author:** [@leemase004](https://discuss.elastic.co/u/leemase004)\ **Replies:** 1\ **Last updated:** [February 28, 2021, 10:48pm UTC](https://discuss.elastic.co/t/reindexing-error/265736 "2021-02-28T22:48:13Z")
We are attempting to update the mappings for an index. The new mapping includes multiple aliases (around 36) When we attempt to reindex the old indices to the new mappings we keep receiving this error: Reindex can not… --- ## [Manage connection between source and target clusters for remote index](https://discuss.elastic.co/t/manage-connection-between-source-and-target-clusters-for-remote-index/265701)
**Author:** [@jthoni](https://discuss.elastic.co/u/jthoni)\ **Replies:** 2\ **Last updated:** [February 28, 2021, 10:15pm UTC](https://discuss.elastic.co/t/manage-connection-between-source-and-target-clusters-for-remote-index/265701 "2021-02-28T22:15:17Z")
We are migrating our ES cluster to a new environment (from stand-alone Azure VMs to Service Fabric hosted, updating the OS image, upgrading ES version, adding security etc.). I have my new cluster ready for data and am w… --- ## [Newly inserted document not visible in searches](https://discuss.elastic.co/t/newly-inserted-document-not-visible-in-searches/265734)
**Author:** [@Cesidio\_DiBenedetto](https://discuss.elastic.co/u/Cesidio_DiBenedetto)\ **Replies:** 2\ **Last updated:** [February 28, 2021, 7:23pm UTC](https://discuss.elastic.co/t/newly-inserted-document-not-visible-in-searches/265734 "2021-02-28T19:23:20Z")
PUT https://elasticsearch-url/index-name/\_doc/customID?refresh { my data object } This is the response I get: { "\_index": "index-name", "\_type": "\_doc", "\_id": "customID", "\_version": 1, "result": "created",… --- ## [503 license not available--security](https://discuss.elastic.co/t/503-license-not-available-security/264966)
**Author:** [@John\_McDonnell](https://discuss.elastic.co/u/John_McDonnell)\ **Replies:** 3\ **Last updated:** [February 28, 2021, 5:33pm UTC](https://discuss.elastic.co/t/503-license-not-available-security/264966 "2021-02-28T17:33:42Z")
Okay, I'm confused. Numerous elastic blogs now suggest that security features are available with the basic license, so I thought this would be a great opportunity to check out the features in my home lab. But, when I f… --- ## [Does Elasticsearch fit my project?](https://discuss.elastic.co/t/does-elasticsearch-fit-my-project/265721)
**Author:** [@duck](https://discuss.elastic.co/u/duck)\ **Replies:** 3\ **Last updated:** [February 28, 2021, 3:12pm UTC](https://discuss.elastic.co/t/does-elasticsearch-fit-my-project/265721 "2021-02-28T15:12:42Z")
Hi, I've been working on a project for a while. Recently, we've decided to build a system for logging and analyzing. About Project It's an online game project and type is MMORPG. Since it's a MMORPG, there'd be billion… --- ## [Elasticsearch voter\_only instance is taking 50% memory usage](https://discuss.elastic.co/t/elasticsearch-voter-only-instance-is-taking-50-memory-usage/265715)
**Author:** [@MCRBEm](https://discuss.elastic.co/u/MCRBEm)\ **Replies:** 2\ **Last updated:** [February 28, 2021, 1:41pm UTC](https://discuss.elastic.co/t/elasticsearch-voter-only-instance-is-taking-50-memory-usage/265715 "2021-02-28T13:41:42Z")
Hello everyone. Need some help to understand high memory issue we have and possibly fixed/improve our elastic stack setup (without adding new server). We were given only 2 servers to install elasticsearch and we must se… --- ## [How to generate ssl certificate for new node in existing cluster](https://discuss.elastic.co/t/how-to-generate-ssl-certificate-for-new-node-in-existing-cluster/265689)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 2\ **Last updated:** [February 28, 2021, 11:56am UTC](https://discuss.elastic.co/t/how-to-generate-ssl-certificate-for-new-node-in-existing-cluster/265689 "2021-02-28T11:56:14Z")
I have 7 node cluster and now i want to add another node for previous nodes i have master\_node1.crt and master\_node1.key master\_node2.crt and master\_node2.key master\_node3.crt and master\_node3.key data\_node1.crt and da… --- ## [Godaddy SSL Wildcard Certificate](https://discuss.elastic.co/t/godaddy-ssl-wildcard-certificate/265503)
**Author:** [@francescouk](https://discuss.elastic.co/u/francescouk)\ **Replies:** 2\ **Last updated:** [February 28, 2021, 11:52am UTC](https://discuss.elastic.co/t/godaddy-ssl-wildcard-certificate/265503 "2021-02-28T11:52:54Z")
Hello there, I´m trying to use my godaddy wildcard ssl on elk stack but for some reason is not working. Can someone point me to the right direction? Follow my config: xpack.security.transport.ssl.enabled: true xpack.sec… --- ## [Pipeline aggregation on average aggregation](https://discuss.elastic.co/t/pipeline-aggregation-on-average-aggregation/265718)
**Author:** [@zagmon](https://discuss.elastic.co/u/zagmon)\ **Replies:** 0\ **Last updated:** [February 28, 2021, 11:35am UTC](https://discuss.elastic.co/t/pipeline-aggregation-on-average-aggregation/265718 "2021-02-28T11:35:05Z")
Hello, Having index contain these fields: user\_id and score (integer between 0-100). Need to do the following: 1. Calculate average score per user. 2. Create 4 buckets with the count of users score: Bucket 1: users wi… --- ## [How much disk and memory is my Elasticsearch using and occupying?](https://discuss.elastic.co/t/how-much-disk-and-memory-is-my-elasticsearch-using-and-occupying/263926)
**Author:** [@mahalabobis](https://discuss.elastic.co/u/mahalabobis)\ **Replies:** 3\ **Last updated:** [February 28, 2021, 12:59am UTC](https://discuss.elastic.co/t/how-much-disk-and-memory-is-my-elasticsearch-using-and-occupying/263926 "2021-02-28T00:59:27Z")
I'm trying to determine my hardware needs. So I want to find exactly how much memory and disk space am I using and occupying. What are the commands to use? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=691) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=693)