# Ingested Pipelines **URL:** \ **Category:** Elasticsearch\ **Tags:** ingest-pipeline\ **Created:** [December 17, 2020, 9:58pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037 "2020-12-17T21:58:12Z")\ **Posts on this page:** 17\ **Page:** 1
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 9:58pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/1 "2020-12-17T21:58:13Z")
Hi! I've updated Elastic Stack and now I have an error and I don't know how to manage it. Before I was using ingested pipelines and everything was just fine and now when I want to use them again I get this error `Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [script] Too many dynamic script compilations within, max: [75/5m]; please use indexed, or scripts with parameters instead; this limit can be changed by the [script.context.template.max_compilations_rate] setting` I pretty stuck and I would be grateful to any king of help. Thank you! ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [December 17, 2020, 10:10pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/2 "2020-12-17T22:10:37Z")
> [@Cosmin\_Ciobanu1](#): > > I've updated Elastic Stack From what to what? ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:11pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/3 "2020-12-17T22:11:06Z")
7.9 to 7.10 ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:12pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/4 "2020-12-17T22:12:08Z")
And I've chose to save old configuration for yml files ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [December 17, 2020, 10:20pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/5 "2020-12-17T22:20:00Z")
Is there anything in your Elasticsearch logs? ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:22pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/6 "2020-12-17T22:22:32Z")
I have a big error where is complaining about every ingested pipeline and sometimes it doesn't like a rollover alias from filebeat. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [December 17, 2020, 10:23pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/7 "2020-12-17T22:23:23Z")
Posting it could prove helpful. ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:24pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/8 "2020-12-17T22:24:09Z")
Ok. Just a second to edit it! ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:33pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/9 "2020-12-17T22:33:41Z")
` Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [script] Too many dynamic script compilations within, max: [75/5m]; please use indexed, or scripts with parameters instead; this limit can be changed by the [script.context.template.max_compilations_rate] setting at org.elasticsearch.script.ScriptCache.checkCompilationLimit(ScriptCache.java:179) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.script.ScriptCache.lambda$compile$0(ScriptCache.java:109) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.common.cache.Cache.computeIfAbsent(Cache.java:433) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.script.ScriptCache.compile(ScriptCache.java:99) ~[elasticsearch-7.10.1.jar:7.10.1] ... 22 more Suppressed: org.elasticsearch.script.GeneralScriptException: Failed to compile inline script [{{zeek.ssl.client.subject.state}}] using lang [mustache] at org.elasticsearch.script.ScriptCache.compile(ScriptCache.java:121) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.script.ScriptService.compile(ScriptService.java:384) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.ValueSource.wrap(ValueSource.java:80) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.common.SetProcessor$Factory.create(SetProcessor.java:108) ~[?:?] at org.elasticsearch.ingest.common.SetProcessor$Factory.create(SetProcessor.java:87) ~[?:?] at org.elasticsearch.ingest.ConfigurationUtils.readProcessor(ConfigurationUtils.java:430) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.ConfigurationUtils.readProcessor(ConfigurationUtils.java:399) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.ConfigurationUtils.readProcessorConfigs(ConfigurationUtils.java:337) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.Pipeline.create(Pipeline.java:74) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.IngestService.innerUpdatePipelines(IngestService.java:735) ~[elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.ingest.IngestService.applyClusterState(IngestService.java:710) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateAppliers(ClusterApplierService.java:510) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateAppliers(ClusterApplierService.java:501) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:471) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:418) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.cluster.service.ClusterApplierService.access$000(ClusterApplierService.java:68) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:162) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.10.1.jar:7.10.1] at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.10.1.jar:7.10.1] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]` ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:34pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/10 "2020-12-17T22:34:15Z")
this is for only one pipeline ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:35pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/11 "2020-12-17T22:35:04Z")
And is very strange because after I have this error : `[2020-12-18T00:30:42,675][ERROR][o.e.x.s.a.e.ReservedRealm] [ServerNod] failed to retrieve password hash for reserved user [kibana_system] org.elasticsearch.action.UnavailableShardsException: at least one primary shard for the index [.security-7] is unavailable at org.elasticsearch.xpack.security.support.SecurityIndexManager.getUnavailableReason(SecurityIndexManager.java:181) ~[x-pack-security-7.10.1.jar:7.10.1] at org.elasticsearch.xpack.security.authc.esnative.NativeUsersStore.getReservedUserInfo(NativeUsersStore.java:525) [x-pack-security-7.10.1.jar:7.10.1] at org.elasticsearch.xpack.security.authc.esnative.ReservedRealm.getUserInfo(ReservedRealm.java:225) [x-pack-security-7.10.1.jar:7.10.1]` ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [December 17, 2020, 10:38pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/12 "2020-12-17T22:38:51Z")
Given your other thread about Logstash, I think there's larger issues here. What is the output from `_cluster/stats?pretty&human`? ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:41pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/13 "2020-12-17T22:41:31Z")
Which part of the output ? ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:44pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/15 "2020-12-17T22:44:45Z")
> "cluster\_uuid" : "n9mU4lLWTU6a55nrUAW7QQ", > "timestamp" : 1608244991213, > "status" : "yellow", > "indices" : { > "count" : 24, > "shards" : { > "total" : 24, > "primaries" : 24, > "replication" : 0.0, > "index" : { > "shards" : { > "min" : 1, > "max" : 1, > "avg" : 1.0 > }, > "primaries" : { > "min" : 1, > "max" : 1, > "avg" : 1.0 > }, > "replication" : { > "min" : 0.0, > "max" : 0.0, > "avg" : 0.0 > } > } > }, > "docs" : { > "count" : 127629, > "deleted" : 764 > }, > "store" : { > "size" : "59.2mb", > "size\_in\_bytes" : 62151057, > "reserved" : "0b", > "reserved\_in\_bytes" : 0 > }, > "fielddata" : { > "memory\_size" : "1.1kb", > "memory\_size\_in\_bytes" : 1176, > "evictions" : 0 > }, > "query\_cache" : { > "memory\_size" : "6.1kb", > "memory\_size\_in\_bytes" : 6328, > "total\_count" : 499, > "hit\_count" : 16, > "miss\_count" : 483, > "cache\_size" : 2, > "cache\_count" : 2, > "evictions" : 0 > }, > "completion" : { > "size" : "0b", > "size\_in\_bytes" : 0 > }, > "segments" : { > "count" : 128, > "memory" : "1005.1kb", > "memory\_in\_bytes" : 1029224, > "terms\_memory" : "614.8kb", > "terms\_memory\_in\_bytes" : 629584, > "stored\_fields\_memory" : "61.6kb", > "stored\_fields\_memory\_in\_bytes" : 63120, > "term\_vectors\_memory" : "0b", > "term\_vectors\_memory\_in\_bytes" : 0, > "norms\_memory" : "8.2kb", > "norms\_memory\_in\_bytes" : 8448, > "points\_memory" : "0b", > "points\_memory\_in\_bytes" : 0, > "doc\_values\_memory" : "320.3kb", > "doc\_values\_memory\_in\_bytes" : 328072, > "index\_writer\_memory" : "30.7mb", > "index\_writer\_memory\_in\_bytes" : 32235668, > "version\_map\_memory" : "7.3kb", > "version\_map\_memory\_in\_bytes" : 7540, > "fixed\_bit\_set" : "20.4kb", > "fixed\_bit\_set\_memory\_in\_bytes" : 20920, > "max\_unsafe\_auto\_id\_timestamp" : 1608244817836, > "file\_sizes" : { } > }, ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:45pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/16 "2020-12-17T22:45:40Z")
> "nodes" : { > "count" : { > "total" : 1, > "coordinating\_only" : 0, > "data" : 1, > "data\_cold" : 1, > "data\_content" : 1, > "data\_hot" : 1, > "data\_warm" : 1, > "ingest" : 1, > "master" : 1, > "ml" : 1, > "remote\_cluster\_client" : 1, > "transform" : 1, > "voting\_only" : 0 > }, > "versions" : [ > "7.10.1" > ], > "os" : { > "available\_processors" : 5, > "allocated\_processors" : 5, > "names" : [ > { > "name" : "Linux", > "count" : 1 > } > ], > "pretty\_names" : [ > { > "pretty\_name" : "Kali GNU/Linux Rolling", > "count" : 1 > } > ], > "mem" : { > "total" : "11.7gb", > "total\_in\_bytes" : 12669161472, > "free" : "619.3mb", > "free\_in\_bytes" : 649433088, > "used" : "11.1gb", > "used\_in\_bytes" : 12019728384, > "free\_percent" : 5, > "used\_percent" : 95 > } > }, > "process" : { > "cpu" : { > "percent" : 3 > }, > "open\_file\_descriptors" : { > "min" : 484, > "max" : 484, > "avg" : 484 > } > }, > "jvm" : { > "max\_uptime" : "12.8m", > "max\_uptime\_in\_millis" : 768940, > "versions" : [ > { > "version" : "15.0.1", > "vm\_name" : "OpenJDK 64-Bit Server VM", > "vm\_version" : "15.0.1+9", > "vm\_vendor" : "AdoptOpenJDK", > "bundled\_jdk" : true, > "using\_bundled\_jdk" : true, > "count" : 1 > } > ], > "mem" : { > "heap\_used" : "972.8mb", > "heap\_used\_in\_bytes" : 1020097024, > "heap\_max" : "5gb", > "heap\_max\_in\_bytes" : 5368709120 > }, > "threads" : 75 > }, > "fs" : { > "total" : "145.7gb", > "total\_in\_bytes" : 156449120256, > "free" : "129.5gb", > "free\_in\_bytes" : 139125129216, > "available" : "122.1gb", > "available\_in\_bytes" : 131106566144 > }, > "plugins" : , > "network\_types" : { > "transport\_types" : { > "security4" : 1 > }, > "http\_types" : { > "security4" : 1 > } > }, > "discovery\_types" : { > "single-node" : 1 > }, > "packaging\_types" : [ > { > "flavor" : "default", > "type" : "deb", > "count" : 1 > } > ], > "ingest" : { > "number\_of\_pipelines" : 43, > "processor\_stats" : { > "conditional" : { > "count" : 1611, > "failed" : 0, > "current" : 0, > "time" : "2.7s", > "time\_in\_millis" : 2785 > }, ---
**Author:** ![Cosmin\_Ciobanu1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/cosmin_ciobanu1/32/78785_2.png) [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\ **Post date:** [December 17, 2020, 10:47pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/17 "2020-12-17T22:47:57Z")
And, if helps, when i delete all ingested pipelines and use filebeat directly to Elasticsearch everything works just fine. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 14, 2021, 10:47pm UTC](https://discuss.elastic.co/t/ingested-pipelines/259037/18 "2021-01-14T22:47:59Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.