# Failure Store Released?

**URL:** <https://discuss.elastic.co/t/failure-store-released/362313>\
**Category:** Elasticsearch\
**Created:** [July 1, 2024, 6:18pm UTC](https://discuss.elastic.co/t/failure-store-released/362313 "2024-07-01T18:18:27Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![jsheely](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jsheely/32/135689_2.png) [@jsheely](https://discuss.elastic.co/u/jsheely)\
**Post date:** [July 1, 2024, 6:18pm UTC](https://discuss.elastic.co/t/failure-store-released/362313/1 "2024-07-01T18:18:27Z")

</div>

I have been seeing several commits, PR, and change log release notes, discussions around **failure\_store**.

But I can't find anything in the documentation about it and when I try and utilize it based on the examples I am getting failures about unknown parameter.

Has this feature been released? If is there an example of how to utilize it?

I am currently using version 8.14.1

References:

> <https://github.com/elastic/elasticsearch/pull/103481>
>
> This PR updates the ingest service to detect if a failed ingest document was bou…nd for a data stream configured with a failure store, and in that event, restores the document to its original state, transforms it with its failure information, and redirects it to the failure store for the data stream it was originally targeting.
> 
> Example run with a default pipeline and data stream:
> \`\`\`json
> PUT \_ingest/pipeline/testpipeline
> {
> "processors": \[
> {
> "fail": {
> "message": "This test pipeline fails for all documents"
> }
> }
> \]
> }
> 
> PUT \_index\_template/my\_data\_stream\_template
> {
> "index\_patterns" : \["my\_data\_stream\*"\], 
> "data\_stream": {
> "failure\_store": true
> },
> "priority" : 1,
> "template": {
> "settings" : {
> "number\_of\_shards" : 1, 
> "index.default\_pipeline": "testpipeline"
> }
> }
> }
> 
> POST my\_data\_stream\_1/\_doc
> {
> "key": "value",
> "@timestamp": "2023-12-14T12:00:00Z"
> }
> \>\>\>
> {
> "\_index": ".fs-my\_data\_stream\_1-2023.12.14-000001",
> "\_id": "8es0aowBHIk1gE8HEwcs",
> "\_version": 1,
> "result": "created",
> "\_shards": {
> "total": 2,
> "successful": 1,
> "failed": 0
> },
> "\_seq\_no": 0,
> "\_primary\_term": 1
> }
> 
> POST .fs-my\_data\_stream\_1-2023.12.14-000001/\_search
> \>\>\>
> {
> "took": 47,
> "timed\_out": false,
> "\_shards": {
> "total": 1,
> "successful": 1,
> "skipped": 0,
> "failed": 0
> },
> "hits": {
> "total": {
> "value": 1,
> "relation": "eq"
> },
> "max\_score": 1,
> "hits": \[
> {
> "\_index": ".fs-my\_data\_stream\_1-2023.12.14-000001",
> "\_id": "8es0aowBHIk1gE8HEwcs",
> "\_score": 1,
> "\_source": {
> "@timestamp": "2023-12-14T21:20:46.566Z",
> "document": {
> "index": "my\_data\_stream\_1",
> "source": {
> "@timestamp": "2023-12-14T12:00:00Z",
> "key": "value"
> }
> },
> "error": {
> "type": "fail\_processor\_exception",
> "message": "This test pipeline fails for all documents",
> "stack\_trace": "org.elasticsearch.ingest.common.FailProcessorException: This test pipeline fails for all documents\\n\\tat org.elasticsearch.ingest.common@8.12.0-SNAPSHOT/org.elasticsearch.ingest.common.FailProcessor.execute(FailProcessor.java:41)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.CompoundProcessor.innerExecute(CompoundProcessor.java:165)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.CompoundProcessor.execute(CompoundProcessor.java:141)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.Pipeline.execute(Pipeline.java:129)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.IngestDocument.executePipeline(IngestDocument.java:867)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.IngestService.executePipeline(IngestService.java:1020)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.IngestService.executePipelines(IngestService.java:879)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.ingest.IngestService$1.doRun(IngestService.java:765)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:33)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:983)\\n\\tat org.elasticsearch.server@8.12.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)\\n\\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\\n\\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\\n\\tat java.base/java.lang.Thread.run(Thread.java:1583)\\n"
> }
> }
> }
> \]
> }
> }
> 
> \`\`\`

> [@ES for logs -- field conflict hell fire](https://discuss.elastic.co/t/es-for-logs-field-conflict-hell/355849/14):
>
> I would say that this kind of mapping conflict errors are pretty common, if you search on the forum you will find a lot of topics about this, but in my opinion the root cause for this is a misconception on how Elasticsearch works. Elastiscearch is not schema-less, it is schema-on-write and has some features to also have schema-on-read (like runtime fields), but having a schema (the mappings) it is a requirement. There are some ways to avoid the issues of conflicting mappings, but in the end t…

> **[Elasticsearch version 8.13.0 | Elasticsearch Guide \[8.14\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/release-notes-8.13.0.html#feature-8.13.0)**

---

<div class="post-metadata">

**Author:** ![TimV](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/timv/32/13162_2.png) [@TimV](https://discuss.elastic.co/u/TimV)\
**Post date:** [July 4, 2024, 2:49am UTC](https://discuss.elastic.co/t/failure-store-released/362313/2 "2024-07-04T02:49:47Z")

</div>

> [@jsheely](#):
>
> Has this feature been released?

No, it has not been released, which is why you can't find any documentation for it.  
We will pretty vocal once it's released (though, to set expectations, it is unlikely to be GA when it first lands).

---

<div class="post-metadata">

**Author:** ![ghudgins](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ghudgins/32/138532_2.png) [@ghudgins](https://discuss.elastic.co/u/ghudgins)\
**Post date:** [September 3, 2025, 1:52am UTC](https://discuss.elastic.co/t/failure-store-released/362313/3 "2025-09-03T01:52:02Z")

</div>

failure store is out as of 8.19 and 9.1. woohoo!
