# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=402 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 403 --- ## [AWS, es-hadoop and 429](https://discuss.elastic.co/t/aws-es-hadoop-and-429/310124)
**Author:** [@matze79](https://discuss.elastic.co/u/matze79)\ **Replies:** 5\ **Last updated:** [July 21, 2022, 12:18pm UTC](https://discuss.elastic.co/t/aws-es-hadoop-and-429/310124 "2022-07-21T12:18:51Z")
Hi forum, I'm on AWS and trying to write ~ 1.2mio documents from an AWS Glue job Python / pyspark job to a managed ElasticSearch. To be fair mentioning that I'm using AWS OpenSearch 1.2 but my question is more or less … --- ## [How to connect postgresql with kibana](https://discuss.elastic.co/t/how-to-connect-postgresql-with-kibana/310273)
**Author:** [@Khadija\_BOUDINAR](https://discuss.elastic.co/u/Khadija_BOUDINAR)\ **Replies:** 3\ **Last updated:** [July 21, 2022, 11:56am UTC](https://discuss.elastic.co/t/how-to-connect-postgresql-with-kibana/310273 "2022-07-21T11:56:45Z")
Hi all, Can postgres connect to kibana --- ## [Not Getting perfect results using multi\_match](https://discuss.elastic.co/t/not-getting-perfect-results-using-multi-match/310272)
**Author:** [@RohitBR\_K](https://discuss.elastic.co/u/RohitBR_K)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 10:38am UTC](https://discuss.elastic.co/t/not-getting-perfect-results-using-multi-match/310272 "2022-07-21T10:38:01Z")
am searching milk but am getting some 5 matched products and getting some other products starting with mi such as milano cigarettes etc --- ## [Elasticsearch Data Nodes](https://discuss.elastic.co/t/elasticsearch-data-nodes/310170)
**Author:** [@Farah\_Bhr](https://discuss.elastic.co/u/Farah_Bhr)\ **Replies:** 2\ **Last updated:** [July 21, 2022, 9:27am UTC](https://discuss.elastic.co/t/elasticsearch-data-nodes/310170 "2022-07-21T09:27:00Z")
Hello I am a beginner at elastic I want to know what are the limits of an elasticsearch cluster, meaning what is the criteria to add another node into the elasticsearch cluster to scale horizontally for example an el… --- ## [5.6 script\_fields painless extract ipaddress then aggregate](https://discuss.elastic.co/t/5-6-script-fields-painless-extract-ipaddress-then-aggregate/310263)
**Author:** [@wachiuri](https://discuss.elastic.co/u/wachiuri)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 9:26am UTC](https://discuss.elastic.co/t/5-6-script-fields-painless-extract-ipaddress-then-aggregate/310263 "2022-07-21T09:26:53Z")
I'm trying to extract a term using a pattern from a text field using a painless script on elasticsearch 5.6. and then I want to aggregate using that scripted field GET \_search { "size": 5, "script\_fie… --- ## [Using the elasticsearch .net NEST client API to get snapshots with query parameters](https://discuss.elastic.co/t/using-the-elasticsearch-net-nest-client-api-to-get-snapshots-with-query-parameters/310021)
**Author:** [@amirmono](https://discuss.elastic.co/u/amirmono)\ **Replies:** 3\ **Last updated:** [July 21, 2022, 8:43am UTC](https://discuss.elastic.co/t/using-the-elasticsearch-net-nest-client-api-to-get-snapshots-with-query-parameters/310021 "2022-07-21T08:43:37Z")
I'm using the Nest client c# API (version 7.0.0.0) to get elasticsearch (8.2.2) snapshots information. response = \_elasticClient.Snapshot.Get( "repository\_name", "\*" ); I… --- ## [Problem migrating HLRC from 7.17.X to 8.X](https://discuss.elastic.co/t/problem-migrating-hlrc-from-7-17-x-to-8-x/310195)
**Author:** [@Gilles\_HURON](https://discuss.elastic.co/u/Gilles_HURON)\ **Replies:** 1\ **Last updated:** [July 21, 2022, 7:54am UTC](https://discuss.elastic.co/t/problem-migrating-hlrc-from-7-17-x-to-8-x/310195 "2022-07-21T07:54:06Z")
Hello I am in this situation: big project using elasticsearch rest high level client, 7.16.X, and want to migrate to 8.2.X or later, so I follow these guidelines Migrating from the High Level Rest Client | Elasticsearch… --- ## [How to send realtime data from csv file to elastiksearch using logstash? How to write logstash.conf file for this task.?](https://discuss.elastic.co/t/how-to-send-realtime-data-from-csv-file-to-elastiksearch-using-logstash-how-to-write-logstash-conf-file-for-this-task/310234)
**Author:** [@bbkunbi](https://discuss.elastic.co/u/bbkunbi)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 5:33am UTC](https://discuss.elastic.co/t/how-to-send-realtime-data-from-csv-file-to-elastiksearch-using-logstash-how-to-write-logstash-conf-file-for-this-task/310234 "2022-07-21T05:33:22Z")
How to do it for multiple .csv file? --- ## [Authorization exception when trying to import model to Elasticsearch cluster](https://discuss.elastic.co/t/authorization-exception-when-trying-to-import-model-to-elasticsearch-cluster/309840)
**Author:** [@green12](https://discuss.elastic.co/u/green12)\ **Replies:** 2\ **Last updated:** [July 21, 2022, 2:04am UTC](https://discuss.elastic.co/t/authorization-exception-when-trying-to-import-model-to-elasticsearch-cluster/309840 "2022-07-21T02:04:51Z")
Hi all. This is my first time using Elasticsearch. Currently I've just deployed a cluster consisted of 3 nodes in my localhost. I'm trying to import a NER NLP model using eland based on https://www.elastic.co/guide/en/e… --- ## [ILM pattern is incrementing by 2 after using delete phase](https://discuss.elastic.co/t/ilm-pattern-is-incrementing-by-2-after-using-delete-phase/310218)
**Author:** [@cl3dson](https://discuss.elastic.co/u/cl3dson)\ **Replies:** 2\ **Last updated:** [July 20, 2022, 11:17pm UTC](https://discuss.elastic.co/t/ilm-pattern-is-incrementing-by-2-after-using-delete-phase/310218 "2022-07-20T23:17:03Z")
Hey Everyone, I am trying ILM as a possible solution for some project at work, everything was working as expected based on the documentation, until the point I described a delete phase in the ILM policy, the indices are … --- ## [The state of 'types' in elasticsearch 7](https://discuss.elastic.co/t/the-state-of-types-in-elasticsearch-7/310146)
**Author:** [@sbruinsje](https://discuss.elastic.co/u/sbruinsje)\ **Replies:** 0\ **Last updated:** [July 20, 2022, 12:28pm UTC](https://discuss.elastic.co/t/the-state-of-types-in-elasticsearch-7/310146 "2022-07-20T12:28:20Z")
I am using Elasticsearch 7.17 and the corresponding javacript client @elastic/elasticsearch@7.17. My understanding is that only one type of document can be stored in an index and as such specifying explicit types is depr… --- ## [Master has not removed previously failed shard. resending shard failure](https://discuss.elastic.co/t/master-has-not-removed-previously-failed-shard-resending-shard-failure/309737)
**Author:** [@hhalei](https://discuss.elastic.co/u/hhalei)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 10:54pm UTC](https://discuss.elastic.co/t/master-has-not-removed-previously-failed-shard-resending-shard-failure/309737 "2022-07-20T22:54:28Z")
ENV Elasticsearch Version: 7.8.0 Description: We run a cluster with three node, Not long ago, the file system of one node was damaged and forced to go offline. Then the cluster ran with two nodes for a period of time, a… --- ## [What is the best strategy to a continuously running aggregation?](https://discuss.elastic.co/t/what-is-the-best-strategy-to-a-continuously-running-aggregation/310113)
**Author:** [@wintercounter](https://discuss.elastic.co/u/wintercounter)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 10:40pm UTC](https://discuss.elastic.co/t/what-is-the-best-strategy-to-a-continuously-running-aggregation/310113 "2022-07-20T22:40:33Z")
I'm about to implement sorting my data by popularity. I'm creating a separate index to log views of all items. I want to sort the items by Popularity{Today,Week,Month,Year,AllTime}. For this I need a continuously running… --- ## [org.elasticsearch.cluster.block.ClusterBlockException: blocked by: \[SERVICE\_UNAVAILABLE/1/state not recovered / initialized\]](https://discuss.elastic.co/t/org-elasticsearch-cluster-block-clusterblockexception-blocked-by-service-unavailable-1-state-not-recovered-initialized/309992)
**Author:** [@RRE](https://discuss.elastic.co/u/RRE)\ **Replies:** 3\ **Last updated:** [July 20, 2022, 10:36pm UTC](https://discuss.elastic.co/t/org-elasticsearch-cluster-block-clusterblockexception-blocked-by-service-unavailable-1-state-not-recovered-initialized/309992 "2022-07-20T22:36:26Z")
Hi, after a server reboot when I try to start elasticsearch I get the following error: org.elasticsearch.cluster.block.ClusterBlockException: blocked by: \[SERVICE\_UNAVAILABLE/1/state not recovered / initialized\] this i… --- ## [Questions on space info](https://discuss.elastic.co/t/questions-on-space-info/309758)
**Author:** [@swchandu](https://discuss.elastic.co/u/swchandu)\ **Replies:** 3\ **Last updated:** [July 20, 2022, 10:33pm UTC](https://discuss.elastic.co/t/questions-on-space-info/309758 "2022-07-20T22:33:17Z")
Hi, I have 2 basic questions. Can some one try to answer these Where does the kibana space info stored? any specific index like .kibana? Is namespace(apm) and kibana spaces same or different? Thanks in advance --- ## [Downgrade 7.16.1 to 7.10](https://discuss.elastic.co/t/downgrade-7-16-1-to-7-10/310144)
**Author:** [@sameer\_khamkar](https://discuss.elastic.co/u/sameer_khamkar)\ **Replies:** 2\ **Last updated:** [July 20, 2022, 9:46pm UTC](https://discuss.elastic.co/t/downgrade-7-16-1-to-7-10/310144 "2022-07-20T21:46:24Z")
Hello Team, We are in situation where we want to downgrade from7.16.1 to 7.10.2 , we are using Graylog 4 , Mongodb & Elasticsearch Do I need to downgrade the whole stack, or can I downgrade partly? Please guide, Reg… --- ## [How to find number of characters in a text field](https://discuss.elastic.co/t/how-to-find-number-of-characters-in-a-text-field/310189)
**Author:** [@nestor1](https://discuss.elastic.co/u/nestor1)\ **Replies:** 2\ **Last updated:** [July 20, 2022, 7:56pm UTC](https://discuss.elastic.co/t/how-to-find-number-of-characters-in-a-text-field/310189 "2022-07-20T19:56:13Z")
I have an application that is writing many documents in Elasticsearch. After a year or two, I figured out that some of these documents are scams because they contain large strings (more than 10000 characters). E.g. one d… --- ## [How to do python analysis on elastic dashboard after applying filters using KQL](https://discuss.elastic.co/t/how-to-do-python-analysis-on-elastic-dashboard-after-applying-filters-using-kql/309594)
**Author:** [@Betty\_Tian](https://discuss.elastic.co/u/Betty_Tian)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 6:47pm UTC](https://discuss.elastic.co/t/how-to-do-python-analysis-on-elastic-dashboard-after-applying-filters-using-kql/309594 "2022-07-20T18:47:36Z")
For example, i have created a dashboard with many plots built on index A\*, then i applied one filter by clicking on a bar chart. (1) How can i export the filtered dataset into python and do some NLP analysis there? (2)… --- ## [Logstash cannot retrieve license information from server](https://discuss.elastic.co/t/logstash-cannot-retrieve-license-information-from-server/310161)
**Author:** [@NadyLeez123](https://discuss.elastic.co/u/NadyLeez123)\ **Replies:** 2\ **Last updated:** [July 20, 2022, 6:01pm UTC](https://discuss.elastic.co/t/logstash-cannot-retrieve-license-information-from-server/310161 "2022-07-20T18:01:11Z")
@sscarduzio There is more than a week that we are having issue with our ELK 7.15.1. Before that, everything were working well since months. Here is the problem: when logstash is stopped, the elasticsearch cluster is he… --- ## [MapperParsingException only when using the Java API Client](https://discuss.elastic.co/t/mapperparsingexception-only-when-using-the-java-api-client/310182)
**Author:** [@Jacob\_Durgin](https://discuss.elastic.co/u/Jacob_Durgin)\ **Replies:** 0\ **Last updated:** [July 20, 2022, 4:51pm UTC](https://discuss.elastic.co/t/mapperparsingexception-only-when-using-the-java-api-client/310182 "2022-07-20T16:51:40Z")
I am running into an issue that I believe has to do with the ES Java API client. I can make the following request to my ES cluster in Postman and receive the intended results: GET resumes/\_search?pretty=true { "… --- ## [Watcher delete document action](https://discuss.elastic.co/t/watcher-delete-document-action/310140)
**Author:** [@Anna\_Foxx](https://discuss.elastic.co/u/Anna_Foxx)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 4:47pm UTC](https://discuss.elastic.co/t/watcher-delete-document-action/310140 "2022-07-20T16:47:54Z")
Hi! Is there possibility to delete index document from watcher as action? I haven't found a guide or documentation of how to do it. Maybe scripts can invoke elastic API, can't they? My case is I want to have a static l… --- ## [Segregate Multiple Applications per each ELK Instance](https://discuss.elastic.co/t/segregate-multiple-applications-per-each-elk-instance/310019)
**Author:** [@amseshadri](https://discuss.elastic.co/u/amseshadri)\ **Replies:** 5\ **Last updated:** [July 20, 2022, 4:25pm UTC](https://discuss.elastic.co/t/segregate-multiple-applications-per-each-elk-instance/310019 "2022-07-20T16:25:37Z")
Hi, I am a newbie to ELK, exploring the things from few days. Using the ELK 8.1.4 version We recently got the ELK Stack installed as a SaaS in our Azure Cloud Subscription. So we have one instance of ELK in each envir… --- ## [Minimum access required by developer to ELK tool](https://discuss.elastic.co/t/minimum-access-required-by-developer-to-elk-tool/310024)
**Author:** [@amseshadri](https://discuss.elastic.co/u/amseshadri)\ **Replies:** 4\ **Last updated:** [July 20, 2022, 4:06pm UTC](https://discuss.elastic.co/t/minimum-access-required-by-developer-to-elk-tool/310024 "2022-07-20T16:06:01Z")
Hi, We are using ELK 8.1.4 running on cluster. Setting up the roles and permissions for users utilising spaces and all. Just want to know what is minimum level of access privilege required by a developer? Thanks Ses… --- ## [Inter-node transfer is 25% of the Elastic Cloud bill](https://discuss.elastic.co/t/inter-node-transfer-is-25-of-the-elastic-cloud-bill/306892)
**Author:** [@schapman](https://discuss.elastic.co/u/schapman)\ **Replies:** 10\ **Last updated:** [July 20, 2022, 3:30pm UTC](https://discuss.elastic.co/t/inter-node-transfer-is-25-of-the-elastic-cloud-bill/306892 "2022-07-20T15:30:28Z")
This is a small Elastic Cloud deployment with 3 Hot Nodes (2GB RAM / 30GB Disk each) and a single Frozen node (4GB RAM, 320GB Disk cache), plus we have a small (single hot node) monitoring deployment. The May bill (when … --- ## [Top\_metric for Geo\_Point](https://discuss.elastic.co/t/top-metric-for-geo-point/310164)
**Author:** [@bianca6](https://discuss.elastic.co/u/bianca6)\ **Replies:** 0\ **Last updated:** [July 20, 2022, 2:15pm UTC](https://discuss.elastic.co/t/top-metric-for-geo-point/310164 "2022-07-20T14:15:50Z")
Hi, In the Transform examples we can find the top\_metrics aggregation. Here is an example: POST \_transform/\_preview { "source": { "index": "kibana\_sample\_data\_ecommerce" }, "pivot": { "group\_by": { … --- ## [Average per day for a period](https://discuss.elastic.co/t/average-per-day-for-a-period/308942)
**Author:** [@Igor-lkm](https://discuss.elastic.co/u/Igor-lkm)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 12:53pm UTC](https://discuss.elastic.co/t/average-per-day-for-a-period/308942 "2022-07-20T12:53:20Z")
Hello, I have a quite simple aggregation to get sum and average total price for a period (1 day, 7 days, 30 days etc.) from my index. That works quite good. Aggregation for 30 days looks like this: { "size": 10000, … --- ## [Pipeline containsKey check fails when top-level object does not exist](https://discuss.elastic.co/t/pipeline-containskey-check-fails-when-top-level-object-does-not-exist/310130)
**Author:** [@SecretSquizza](https://discuss.elastic.co/u/SecretSquizza)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 12:34pm UTC](https://discuss.elastic.co/t/pipeline-containskey-check-fails-when-top-level-object-does-not-exist/310130 "2022-07-20T12:34:58Z")
Hi everyone! I'm struggling to find an answer to this issue and i keep receiving the error Cannot invoke "Object.getClass()" because "value" is null The problem occurs when I have an object - in this case error - th… --- ## [Include Fields in Watcher Email Alert](https://discuss.elastic.co/t/include-fields-in-watcher-email-alert/309821)
**Author:** [@rshetty89](https://discuss.elastic.co/u/rshetty89)\ **Replies:** 3\ **Last updated:** [July 20, 2022, 12:33pm UTC](https://discuss.elastic.co/t/include-fields-in-watcher-email-alert/309821 "2022-07-20T12:33:45Z")
From the below API output of my watcher i can only include {{ctx.metadata.name}} in email subject and body . If i try to include any other feild such as {{ctx.payload.hits.total}},{{ctx.metadata.name.xpack.type}} , {{#c… --- ## [Format array object in watcher email body](https://discuss.elastic.co/t/format-array-object-in-watcher-email-body/310080)
**Author:** [@rshetty89](https://discuss.elastic.co/u/rshetty89)\ **Replies:** 1\ **Last updated:** [July 20, 2022, 12:30pm UTC](https://discuss.elastic.co/t/format-array-object-in-watcher-email-body/310080 "2022-07-20T12:30:32Z")
HI, I have an array as output of watcher and i need to include this array in watcher body. the result sample of my wathcer is as follows. . . . . "payload": { "results": \[ { "value": 319… --- ## [Where can I find the docs on "question\_answering"?](https://discuss.elastic.co/t/where-can-i-find-the-docs-on-question-answering/310060)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 2\ **Last updated:** [July 20, 2022, 12:13pm UTC](https://discuss.elastic.co/t/where-can-i-find-the-docs-on-question-answering/310060 "2022-07-20T12:13:51Z")
Hi All, Elasticsearch added question\_answering in 8.3, but I can't seem to find any documentation on how to use/test it. I've looked here: Natural language processing | Machine Learning in the Elastic Stack \[8.3\] | Elas… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=401) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=403)