# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1049 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1050 --- ## [Extra processor in ingest pipeline disappears after upgrade](https://discuss.elastic.co/t/extra-processor-in-ingest-pipeline-disappears-after-upgrade/297290)
**Author:** [@hermlam](https://discuss.elastic.co/u/hermlam)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 8:59am UTC](https://discuss.elastic.co/t/extra-processor-in-ingest-pipeline-disappears-after-upgrade/297290 "2022-02-17T08:59:55Z")
I am looking for a solution for my ingest pipeline, in this case logs-system.syslog-1.6.4. I added a KV-processor for customized syslog of my Raspberry Pies. But with every update of elastic this add processor is gone … --- ## [Elastic Update Script avoid dynamic script compilations](https://discuss.elastic.co/t/elastic-update-script-avoid-dynamic-script-compilations/295236)
**Author:** [@Siegi](https://discuss.elastic.co/u/Siegi)\ **Replies:** 5\ **Last updated:** [February 17, 2022, 8:51am UTC](https://discuss.elastic.co/t/elastic-update-script-avoid-dynamic-script-compilations/295236 "2022-02-17T08:51:42Z")
Hey there, after my elastic usage is growing, I ran into the script.max\_compilations\_rate( TransportError(500, 'general\_script\_exception', '\[script\] Too many dynamic script compilations ) in my updates. I use update… --- ## [Combining Painless and Mustache](https://discuss.elastic.co/t/combining-painless-and-mustache/296209)
**Author:** [@Navanit\_dubey](https://discuss.elastic.co/u/Navanit_dubey)\ **Replies:** 3\ **Last updated:** [February 17, 2022, 8:44am UTC](https://discuss.elastic.co/t/combining-painless-and-mustache/296209 "2022-02-17T08:44:08Z")
Can I make a template using both the painless script and mustache. So as to make a search query where the search is done by mustache template and its done insde the painless language query. --- ## [Remaining shards after using allocation.exclude](https://discuss.elastic.co/t/remaining-shards-after-using-allocation-exclude/297349)
**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\ **Replies:** 3\ **Last updated:** [February 17, 2022, 8:39am UTC](https://discuss.elastic.co/t/remaining-shards-after-using-allocation-exclude/297349 "2022-02-17T08:39:46Z")
Hey! I wanted to drain one out of the 9 nodes and I used allocation.exclude attribute: PUT \_cluster/settings { "transient": { "cluster.routing.allocation.exclude.\_ip" : "1.2.3.4" } } The problem is that after … --- ## [How to extend an existing visualisation in a custom plugin](https://discuss.elastic.co/t/how-to-extend-an-existing-visualisation-in-a-custom-plugin/297452)
**Author:** [@Shreeya\_Rajguru](https://discuss.elastic.co/u/Shreeya_Rajguru)\ **Replies:** 0\ **Last updated:** [February 17, 2022, 8:05am UTC](https://discuss.elastic.co/t/how-to-extend-an-existing-visualisation-in-a-custom-plugin/297452 "2022-02-17T08:05:33Z")
Hi, I want to extend the Control Visualisation in my custom plugin and make following changes in its implementation : Add a Sort Field to sort the Options List according to a field, eg. timestamp to get the latest rec… --- ## [Unable to retrieve version information from Elasticsearch nodes. connect ECONNREFUSED ip:9200](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes-connect-econnrefused-ip-9200/297338)
**Author:** [@devopshulk](https://discuss.elastic.co/u/devopshulk)\ **Replies:** 6\ **Last updated:** [February 17, 2022, 7:46am UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes-connect-econnrefused-ip-9200/297338 "2022-02-17T07:46:09Z")
"message":"Unable to retrieve version information from Elasticsearch nodes. self signed certificate in certificate chain","log":{"level":"ERROR","logger":"Elasticsearch-service"}, --- ## [How to compress data when write into es](https://discuss.elastic.co/t/how-to-compress-data-when-write-into-es/297371)
**Author:** [@dalei2019](https://discuss.elastic.co/u/dalei2019)\ **Replies:** 4\ **Last updated:** [February 17, 2022, 7:42am UTC](https://discuss.elastic.co/t/how-to-compress-data-when-write-into-es/297371 "2022-02-17T07:42:20Z")
Hi team, I want to build an ES cluster for services in other regions, so ES needs to be exposed to the public network. The amount of data transferred is 2 T /day , it's huge . So I expect to compress before writing in… --- ## [Rsyslog with redis =\> ELK is not showing any logs](https://discuss.elastic.co/t/rsyslog-with-redis-elk-is-not-showing-any-logs/297285)
**Author:** [@Iggy](https://discuss.elastic.co/u/Iggy)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 7:27am UTC](https://discuss.elastic.co/t/rsyslog-with-redis-elk-is-not-showing-any-logs/297285 "2022-02-17T07:27:50Z")
If anyone here can help a newbie out, I would be so happy! It kind of feels like hitting a brick wall at this point. I am not in the rush, as I am just learning ELK, but any help would lift my spirits. --- ## [Set a global TLS CA for security, snapshot , reindex etc](https://discuss.elastic.co/t/set-a-global-tls-ca-for-security-snapshot-reindex-etc/297389)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 2\ **Last updated:** [February 17, 2022, 7:18am UTC](https://discuss.elastic.co/t/set-a-global-tls-ca-for-security-snapshot-reindex-etc/297389 "2022-02-17T07:18:38Z")
Dont know if this is possible already? How to setup TLS CA for everything: snapshot S3 against custom repositories clustering security TLS --- ## [Weird Elasticsearch version in kibana (cluster overview) after upgrade to 8](https://discuss.elastic.co/t/weird-elasticsearch-version-in-kibana-cluster-overview-after-upgrade-to-8/297360)
**Author:** [@AlexeyZhuravlev](https://discuss.elastic.co/u/AlexeyZhuravlev)\ **Replies:** 4\ **Last updated:** [February 17, 2022, 7:04am UTC](https://discuss.elastic.co/t/weird-elasticsearch-version-in-kibana-cluster-overview-after-upgrade-to-8/297360 "2022-02-17T07:04:46Z")
Hi, Updated a single-node test installation from 7.17 to 8. Almost all went smooth (got minor issues with kibana's logging.dest parameter stuck in the unit file). And now I see this: --- ## [Shard Failed: marking and sending shard failed due to \[failed recovery\]](https://discuss.elastic.co/t/shard-failed-marking-and-sending-shard-failed-due-to-failed-recovery/297352)
**Author:** [@ethical20](https://discuss.elastic.co/u/ethical20)\ **Replies:** 2\ **Last updated:** [February 17, 2022, 6:24am UTC](https://discuss.elastic.co/t/shard-failed-marking-and-sending-shard-failed-due-to-failed-recovery/297352 "2022-02-17T06:24:21Z")
Hi, I've installed a new windows ELK stack for testing, worked once but then got the below errors when trying to run again. I can see that there are issues with shards, but don't know how to fix this. \[2022-02-16T11:… --- ## [Enable Graph in Kibana 7.17.0](https://discuss.elastic.co/t/enable-graph-in-kibana-7-17-0/297437)
**Author:** [@Scorpion21](https://discuss.elastic.co/u/Scorpion21)\ **Replies:** 2\ **Last updated:** [February 17, 2022, 5:58am UTC](https://discuss.elastic.co/t/enable-graph-in-kibana-7-17-0/297437 "2022-02-17T05:58:38Z")
I'd like to draw a network topology diagram using Graph According to the configuration guide here, seems I should be able to use graph analytics features straight away after deploying Kibana 7.17. However, I cannot f… --- ## [Include & Exclude of 500k ids in a search query](https://discuss.elastic.co/t/include-exclude-of-500k-ids-in-a-search-query/296428)
**Author:** [@sanders\_2345](https://discuss.elastic.co/u/sanders_2345)\ **Replies:** 4\ **Last updated:** [February 8, 2022, 12:32pm UTC](https://discuss.elastic.co/t/include-exclude-of-500k-ids-in-a-search-query/296428 "2022-02-08T12:32:52Z")
Problem statement: We've millions of ids stored in another Id store. These ids we're generating from the application & will be as same es doc id. Here, for certain use-cases, we want to include & exclude these ids in a … --- ## [Logstash not getting rolled over](https://discuss.elastic.co/t/logstash-not-getting-rolled-over/297022)
**Author:** [@jwilfreds](https://discuss.elastic.co/u/jwilfreds)\ **Replies:** 7\ **Last updated:** [February 16, 2022, 2:47pm UTC](https://discuss.elastic.co/t/logstash-not-getting-rolled-over/297022 "2022-02-16T14:47:40Z")
The logstash file is not getting rolled over. the setup was set for 5 MB and the lifecyle policy added to it. But it grew to 100 GB. No one noticed it until we started getting the server utilization alerts. How do I crea… --- ## [Unassigned Shards elastic 7.6.0](https://discuss.elastic.co/t/unassigned-shards-elastic-7-6-0/297431)
**Author:** [@yuswanul](https://discuss.elastic.co/u/yuswanul)\ **Replies:** 4\ **Last updated:** [February 17, 2022, 1:45am UTC](https://discuss.elastic.co/t/unassigned-shards-elastic-7-6-0/297431 "2022-02-17T01:45:02Z")
So, Here is the condition. some of my index are unassigned and the status is red. then i assign it manually using this command POST \_cluster/reroute { "commands": \[ { "allocate\_empty\_primary": { … --- ## [Control data sampling by netflow](https://discuss.elastic.co/t/control-data-sampling-by-netflow/297425)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 0\ **Last updated:** [February 16, 2022, 11:20pm UTC](https://discuss.elastic.co/t/control-data-sampling-by-netflow/297425 "2022-02-16T23:20:57Z")
Good morning I would like to know how I can control the data that is sent by netflow to filebeat-kibana, since it generates many documents per minute, I want to know if I can configure the data sampling and only send me… --- ## [Elastic pod exit code 60](https://discuss.elastic.co/t/elastic-pod-exit-code-60/297322)
**Author:** [@cps598](https://discuss.elastic.co/u/cps598)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:28am UTC](https://discuss.elastic.co/t/elastic-pod-exit-code-60/297322 "2022-02-17T01:28:42Z")
I can't delete one of the indexes and the return value is "60". What is "60" mean in return value? Thanks. --- ## [ES\_API point to Cluster IP](https://discuss.elastic.co/t/es-api-point-to-cluster-ip/297325)
**Author:** [@Wan\_Nur\_Athirah\_Wan](https://discuss.elastic.co/u/Wan_Nur_Athirah_Wan)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:28am UTC](https://discuss.elastic.co/t/es-api-point-to-cluster-ip/297325 "2022-02-17T01:28:36Z")
Hai everyone. Just curious about one thing regarding Elasticsearch. Before this we know that ES\_API can link to ES database IP. Can I get accurate information if ES\_API can also point to cluster IP? Thanks a lot. --- ## [Multi-indice facet filtering](https://discuss.elastic.co/t/multi-indice-facet-filtering/297391)
**Author:** [@merijnkruithof](https://discuss.elastic.co/u/merijnkruithof)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:13am UTC](https://discuss.elastic.co/t/multi-indice-facet-filtering/297391 "2022-02-17T01:13:18Z")
Hi all, I'm very new to Elasticsearch, so I hope that you guys understand what I'm saying. We have two indices (training\_programs and vacancies). Those indices share some fields, such as education\_level, and fields tha… --- ## [API key: unable to find apikey with id \](https://discuss.elastic.co/t/api-key-unable-to-find-apikey-with-id-id/297401)
**Author:** [@inbox.ex](https://discuss.elastic.co/u/inbox.ex)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:11am UTC](https://discuss.elastic.co/t/api-key-unable-to-find-apikey-with-id-id/297401 "2022-02-17T01:11:12Z")
I was able to create ApiKey from Elasticsearch console. But, when i try to Post Document to the ES url using PostMan, i am getting this error. (subject). does it take time for the apikey to become effective ? the url … --- ## [Not loading pipeline - ConfigurationError](https://discuss.elastic.co/t/not-loading-pipeline-configurationerror/297422)
**Author:** [@Sconic](https://discuss.elastic.co/u/Sconic)\ **Replies:** 2\ **Last updated:** [February 16, 2022, 11:56pm UTC](https://discuss.elastic.co/t/not-loading-pipeline-configurationerror/297422 "2022-02-16T23:56:16Z")
I've updated the output of our pipeline to change the index that some documents get added to but I'm getting a configuration error when trying to start Logstash, I can't for the life of me find what I'm missing. I'm usin… --- ## [SQL Module missing in Metricbeat](https://discuss.elastic.co/t/sql-module-missing-in-metricbeat/297423)
**Author:** [@vPilot](https://discuss.elastic.co/u/vPilot)\ **Replies:** 0\ **Last updated:** [February 16, 2022, 10:49pm UTC](https://discuss.elastic.co/t/sql-module-missing-in-metricbeat/297423 "2022-02-16T22:49:52Z")
Since the PostgreSQL module doesn't support replication monitoring, or custom queries like the MySQL module, I am hoping to use the SQL module to connect and run the queries I need against Postgres. However, I am not see… --- ## [Read encrypted windows event logs](https://discuss.elastic.co/t/read-encrypted-windows-event-logs/297380)
**Author:** [@EliWallic](https://discuss.elastic.co/u/EliWallic)\ **Replies:** 4\ **Last updated:** [February 16, 2022, 10:30pm UTC](https://discuss.elastic.co/t/read-encrypted-windows-event-logs/297380 "2022-02-16T22:30:31Z")
Hello community, for security reasons I have some eventlogs encrypted with an certificate. Windows native its possible to decrypt them in order to get access again. Is it also possible with winlogbeat or filebeat? Be… --- ## [Configuring the Transport Client to work with a Secured Cluster](https://discuss.elastic.co/t/configuring-the-transport-client-to-work-with-a-secured-cluster/296476)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 9:40pm UTC](https://discuss.elastic.co/t/configuring-the-transport-client-to-work-with-a-secured-cluster/296476 "2022-02-16T21:40:31Z")
hey there, following this doc page I was trying to use Transport Client. ES cluster is already configured to use SSL and Basic Auth and it works properly. I would like to give an answer to my doubt, following step #4, … --- ## [Error fetching data for metricset linux.pageinfo](https://discuss.elastic.co/t/error-fetching-data-for-metricset-linux-pageinfo/297049)
**Author:** [@CaSi](https://discuss.elastic.co/u/CaSi)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 9:05pm UTC](https://discuss.elastic.co/t/error-fetching-data-for-metricset-linux-pageinfo/297049 "2022-02-16T21:05:33Z")
Hello, I am using metricbeat 7.16.3 on centos 8 stream. The ‘pageinfo’ metricset in the linux module spams my logs with this error message: ERROR module/wrapper.go:259 Error fetching data for metricset li… --- ## [Logstash monitoring data not showing up in Kibana](https://discuss.elastic.co/t/logstash-monitoring-data-not-showing-up-in-kibana/297408)
**Author:** [@Pedro\_Osorio](https://discuss.elastic.co/u/Pedro_Osorio)\ **Replies:** 0\ **Last updated:** [February 16, 2022, 7:14pm UTC](https://discuss.elastic.co/t/logstash-monitoring-data-not-showing-up-in-kibana/297408 "2022-02-16T19:14:56Z")
Hi all, I've been trying to see Logstash metrics in Kibana, but with no success. My setup is as follows: metricbeat daemonset collecting host/pods metrics shipping to elastic metricbeat deployment collecting cluster/l… --- ## [Filter on rank\_features](https://discuss.elastic.co/t/filter-on-rank-features/297181)
**Author:** [@dvisz-inf](https://discuss.elastic.co/u/dvisz-inf)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 7:13pm UTC](https://discuss.elastic.co/t/filter-on-rank-features/297181 "2022-02-16T19:13:05Z")
Hi all Back in 2017/2018 I attended Elasticon in San Francisco and got to meet a bunch of the engineers there. It was a really good experience and I got to have a lot of questions answered. One in particular was buggin… --- ## [Scripted metric aggregation inside nested aggregation: \`params.\_source\` is empty in map script](https://discuss.elastic.co/t/scripted-metric-aggregation-inside-nested-aggregation-params-source-is-empty-in-map-script/297237)
**Author:** [@asupranovich](https://discuss.elastic.co/u/asupranovich)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 2:58pm UTC](https://discuss.elastic.co/t/scripted-metric-aggregation-inside-nested-aggregation-params-source-is-empty-in-map-script/297237 "2022-02-16T14:58:49Z")
Hi community! My Elasticsearch version is 7.7.0. I'm facing a weird issue for my aggregation query. Let's say we have a car index, car data model looks like below: { "vin": "08c00679-8a58-11ec-9745-1aed518f8637", … --- ## [Logstash Pipeline Filter (\*)](https://discuss.elastic.co/t/logstash-pipeline-filter/297266)
**Author:** [@max\_cyril](https://discuss.elastic.co/u/max_cyril)\ **Replies:** 3\ **Last updated:** [February 16, 2022, 6:40pm UTC](https://discuss.elastic.co/t/logstash-pipeline-filter/297266 "2022-02-16T18:40:46Z")
RE: Hi,I am struggling to write a logstash pipeline filter section i have used "TRANSFORMS" from kibana interface, it did not solve the case. \*\*\* i want to filter and only output event that correspond to the maxim… --- ## [Need to Extract field](https://discuss.elastic.co/t/need-to-extract-field/297154)
**Author:** [@SRIGURU\_VEL](https://discuss.elastic.co/u/SRIGURU_VEL)\ **Replies:** 7\ **Last updated:** [February 16, 2022, 6:36pm UTC](https://discuss.elastic.co/t/need-to-extract-field/297154 "2022-02-16T18:36:23Z")
Hi Experts, I am using logstash 7.9.3 and i have written the MongoDb connection with Elasticsearch pipeline. Data's are perfectly pushed into Elasticsearch. In that index I need to split one field. My logstash configu… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1048) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1050)