# "TTL value must be \> 0. Illegal value provided" when updating document with \_ttl set **URL:** \ **Category:** Elasticsearch\ **Created:** [June 26, 2013, 9:59pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557 "2013-06-26T21:59:49Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![Brad\_Cavanagh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/brad_cavanagh/32/2255_2.png) [@Brad\_Cavanagh](https://discuss.elastic.co/u/Brad_Cavanagh)\ **Post date:** [June 26, 2013, 9:59pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/1 "2013-06-26T21:59:49Z")
I'm using ES 0.90.1. I've run into a little race condition-ish problem concerning sending an update request for a document after its TTL has expired but before ES has run the TTL cleanup. Here are the replication steps: % curl -XPUT localhost:9200/test-ttl -d '{ "settings" : { "index.number\_of\_shards" : 1, "index.number\_of\_replicas" : 0 }, "mappings" : { "test-doc" : { "\_ttl" : { "enabled" : true, "default" : "1m" } } } }' % curl -XPUT 'localhost:9200/test-ttl/test-doc/1' -d '{ "title" : "test title" }' % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { "title" : "test update title" } }' In another window, I have this running: % while true ; do date ; curl -XGET '[http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,\_ttl](http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,_ttl)' ; sleep 1 ; done While that's running, I can watch the \_ttl field decrease. When it becomes negative, the document is in a state such that its TTL has expired, but ES hasn't yet run the cleanup step. I can still retrieve the document, even though technically speaking it's "expired". When the document is in this state, if I do: % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { "title" : "test update title" } }' ... I get the following error message: {"error":"ElasticSearchIllegalArgumentException[TTL value must be \> 0. Illegal value provided [-209]]","status":400} This is causing me a little bit of grief because the program I have written to update documents in ES doesn't handle this properly, so it just bombs out entirely (which I really need to fix regardless). Is there another way I should be updating documents that could be in this "expired but still available" state? Thanks, Brad. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![brian\_yoder](https://avatars.discourse-cdn.com/v4/letter/b/f1d935/32.png) [@brian\_yoder](https://discuss.elastic.co/u/brian_yoder)\ **Post date:** [June 26, 2013, 10:27pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/2 "2013-06-26T22:27:30Z")
Brad, From my "outside looking in" perspective, I've never encountered this specific case.... so thanks for describing it! But my suggestion would be to handle this specific exception as if the document wasn't there any more. "Expired but still available" really is "expired, or as good as expired". I've noticed that the TTL value goes negative and the document stuck around a little longer in 0.90 than it did in 0.20.4, but I'm guessing it's related to some default configuration change. However, the document still expired and I only noticed it because my test cases created TTL values in minutes. Whereas a real application would typically set TTL values of hours or days or perhaps weeks and not worry too much about the length of time it sepnds in this "expired but still there with a negative TTL" state. Exceptions are much cleaner to handle in Java than via the HTTP interface, I realize. Brian On Wednesday, June 26, 2013 5:59:49 PM UTC-4, Brad Cavanagh wrote: > I'm using ES 0.90.1. I've run into a little race condition-ish problem > concerning sending an update request for a document after its TTL has > expired but before ES has run the TTL cleanup. > > Here are the replication steps: > > % curl -XPUT localhost:9200/test-ttl -d '{ > "settings" : { > "index.number\_of\_shards" : 1, > "index.number\_of\_replicas" : 0 > }, > "mappings" : { > "test-doc" : { > "\_ttl" : { > "enabled" : true, > "default" : "1m" > } > } > } > }' > % curl -XPUT 'localhost:9200/test-ttl/test-doc/1' -d '{ "title" : "test > title" }' > % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { > "title" : "test update title" } }' > > In another window, I have this running: > > % while true ; do date ; curl -XGET ' > [http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,\_ttl](http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,_ttl)' > ; sleep 1 ; done > > While that's running, I can watch the \_ttl field decrease. When it becomes > negative, the document is in a state such that its TTL has expired, but ES > hasn't yet run the cleanup step. I can still retrieve the document, even > though technically speaking it's "expired". > > When the document is in this state, if I do: > > % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { > "title" : "test update title" } }' > > ... I get the following error message: > > {"error":"ElasticSearchIllegalArgumentException[TTL value must be \> 0. > Illegal value provided [-209]]","status":400} > > This is causing me a little bit of grief because the program I have > written to update documents in ES doesn't handle this properly, so it just > bombs out entirely (which I really need to fix regardless). Is there > another way I should be updating documents that could be in this "expired > but still available" state? > > Thanks, > Brad. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Benjamin\_Deveze](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/benjamin_deveze/32/1577_2.png) [@Benjamin\_Deveze](https://discuss.elastic.co/u/Benjamin_Deveze)\ **Post date:** [June 27, 2013, 6:24am UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/3 "2013-06-27T06:24:17Z")
Brad, I think you are right it should probably behave as if the document has been deleted when it is in expired state but not yet expunged, i.e. in your case it should return a DocumentMissingException I guess. Thanks for reporting, would you mind opening an issue for it? On Wednesday, June 26, 2013 11:59:49 PM UTC+2, Brad Cavanagh wrote: > I'm using ES 0.90.1. I've run into a little race condition-ish problem > concerning sending an update request for a document after its TTL has > expired but before ES has run the TTL cleanup. > > Here are the replication steps: > > % curl -XPUT localhost:9200/test-ttl -d '{ > "settings" : { > "index.number\_of\_shards" : 1, > "index.number\_of\_replicas" : 0 > }, > "mappings" : { > "test-doc" : { > "\_ttl" : { > "enabled" : true, > "default" : "1m" > } > } > } > }' > % curl -XPUT 'localhost:9200/test-ttl/test-doc/1' -d '{ "title" : "test > title" }' > % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { > "title" : "test update title" } }' > > In another window, I have this running: > > % while true ; do date ; curl -XGET ' > [http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,\_ttl](http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,_ttl)' > ; sleep 1 ; done > > While that's running, I can watch the \_ttl field decrease. When it becomes > negative, the document is in a state such that its TTL has expired, but ES > hasn't yet run the cleanup step. I can still retrieve the document, even > though technically speaking it's "expired". > > When the document is in this state, if I do: > > % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { > "title" : "test update title" } }' > > ... I get the following error message: > > {"error":"ElasticSearchIllegalArgumentException[TTL value must be \> 0. > Illegal value provided [-209]]","status":400} > > This is causing me a little bit of grief because the program I have > written to update documents in ES doesn't handle this properly, so it just > bombs out entirely (which I really need to fix regardless). Is there > another way I should be updating documents that could be in this "expired > but still available" state? > > Thanks, > Brad. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Brad\_Cavanagh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/brad_cavanagh/32/2255_2.png) [@Brad\_Cavanagh](https://discuss.elastic.co/u/Brad_Cavanagh)\ **Post date:** [June 27, 2013, 9:00pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/4 "2013-06-27T21:00:39Z")
I've opened an issue for it: > > > I'm using ES 0.90.1. I've run into a little race condition-ish problem concernin…g sending an update request for a document after its TTL has expired but before ES has run the TTL cleanup. > > Here are the replication steps: > > \`\`\` shell > % curl -XPUT localhost:9200/test-ttl -d '{ > "settings" : { > "index.number\_of\_shards" : 1, > "index.number\_of\_replicas" : 0 > }, > "mappings" : { > "test-doc" : { > "\_ttl" : { > "enabled" : true, > "default" : "1m" > } > } > } > }' > % curl -XPUT 'localhost:9200/test-ttl/test-doc/1' -d '{ "title" : "test title" }' > % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { "title" : "test update title" } }' > \`\`\` > > In another window, I have this running: > > \`\`\` shell > % while true ; do date ; curl -XGET 'http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,\_ttl' ; sleep 1 ; done > \`\`\` > > While that's running, I can watch the \`\_ttl\` field decrease. When it becomes negative, the document is in a state such that its TTL has expired, but ES hasn't yet run the cleanup step. I can still retrieve the document, even though technically speaking it's "expired". > > When the document is in this state, if I do: > > \`\`\` shell > % curl -XPOST 'localhost:9200/test-ttl/test-doc/1/\_update' -d '{ "doc" : { "title" : "test update title" } }' > \`\`\` > > ... I get the following error message: > > \`\`\` javascript > {"error":"ElasticSearchIllegalArgumentException\[TTL value must be \> 0. Illegal value provided \[-209\]\]","status":400} > \`\`\` > > I raised this on the elasticsearch users mailing list and Benjamin Deveze suggested I open an issue for it, so here it is! On Wed, Jun 26, 2013 at 11:24 PM, Benjamin Devèze \<[benjamin.deveze@gmail.com](mailto:benjamin.deveze@gmail.com) > wrote: > Brad, > > I think you are right it should probably behave as if the document has > been deleted when it is in expired state but not yet expunged, i.e. in your > case it should return a DocumentMissingException I guess. > > Thanks for reporting, would you mind opening an issue for it? > > On Wednesday, June 26, 2013 11:59:49 PM UTC+2, Brad Cavanagh wrote: > > > I'm using ES 0.90.1. I've run into a little race condition-ish problem > > concerning sending an update request for a document after its TTL has > > expired but before ES has run the TTL cleanup. > > > > Here are the replication steps: > > > > % curl -XPUT localhost:9200/test-ttl -d '{ > > "settings" : { > > "index.number\_of\_shards" : 1, > > "index.number\_of\_replicas" : 0 > > }, > > "mappings" : { > > "test-doc" : { > > "\_ttl" : { > > "enabled" : true, > > "default" : "1m" > > } > > } > > } > > }' > > % curl -XPUT 'localhost:9200/test-ttl/test-\*\*doc/1' -d '{ "title" : > > "test title" }' > > % curl -XPOST 'localhost:9200/test-ttl/test-\*\*doc/1/\_update' -d '{ "doc" > > : { "title" : "test update title" } }' > > > > In another window, I have this running: > > > > % while true ; do date ; curl -XGET '[http://localhost:9200/test-](http://localhost:9200/test-)\*\* > > ttl/test-doc/1?pretty=true&\*\*fields=title,\_ttl[http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,\_ttl](http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,_ttl)' > > ; sleep 1 ; done > > > > While that's running, I can watch the \_ttl field decrease. When it > > becomes negative, the document is in a state such that its TTL has expired, > > but ES hasn't yet run the cleanup step. I can still retrieve the document, > > even though technically speaking it's "expired". > > > > When the document is in this state, if I do: > > > > % curl -XPOST 'localhost:9200/test-ttl/test-\*\*doc/1/\_update' -d '{ "doc" > > : { "title" : "test update title" } }' > > > > ... I get the following error message: > > > > {"error":" **ElasticSearchIllegalArgumentEx** ception[TTL value must be \> > > 0. Illegal value provided [-209]]","status":400} > > > > This is causing me a little bit of grief because the program I have > > written to update documents in ES doesn't handle this properly, so it just > > bombs out entirely (which I really need to fix regardless). Is there > > another way I should be updating documents that could be in this "expired > > but still available" state? > > > > Thanks, > > Brad. > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/ifvWZJjQuvU/unsubscribe](https://groups.google.com/d/topic/elasticsearch/ifvWZJjQuvU/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![brian\_yoder](https://avatars.discourse-cdn.com/v4/letter/b/f1d935/32.png) [@brian\_yoder](https://discuss.elastic.co/u/brian_yoder)\ **Post date:** [June 27, 2013, 9:08pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/5 "2013-06-27T21:08:24Z")
Benjamin, In this case, should the document also be omitted from a match-all query or other type of search instead of being returned with a negative TTL? And not just a get-by-id request? Brian On Thursday, June 27, 2013 2:24:17 AM UTC-4, Benjamin Devèze wrote: > Brad, > > I think you are right it should probably behave as if the document has > been deleted when it is in expired state but not yet expunged, i.e. in your > case it should return a DocumentMissingException I guess. > > Thanks for reporting, would you mind opening an issue for it? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Benjamin\_Deveze](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/benjamin_deveze/32/1577_2.png) [@Benjamin\_Deveze](https://discuss.elastic.co/u/Benjamin_Deveze)\ **Post date:** [June 27, 2013, 9:11pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/6 "2013-06-27T21:11:28Z")
Thanks Brad let's continue the technical discussion about this on your issue and wait for some points of view about it. On Thursday, June 27, 2013 11:00:39 PM UTC+2, Brad Cavanagh wrote: > I've opened an issue for it: > [Updating document with expired \_ttl results in "TTL value must be \> 0. Illegal value provided" error · Issue #3256 · elastic/elasticsearch · GitHub](https://github.com/elasticsearch/elasticsearch/issues/3256) > > On Wed, Jun 26, 2013 at 11:24 PM, Benjamin Devèze \<[benjami...@gmail.com](mailto:benjami...@gmail.com)\ > > > wrote: > > > Brad, > > > > I think you are right it should probably behave as if the document has > > been deleted when it is in expired state but not yet expunged, i.e. in your > > case it should return a DocumentMissingException I guess. > > > > Thanks for reporting, would you mind opening an issue for it? > > > > On Wednesday, June 26, 2013 11:59:49 PM UTC+2, Brad Cavanagh wrote: > > > > > I'm using ES 0.90.1. I've run into a little race condition-ish problem > > > concerning sending an update request for a document after its TTL has > > > expired but before ES has run the TTL cleanup. > > > > > > Here are the replication steps: > > > > > > % curl -XPUT localhost:9200/test-ttl -d '{ > > > "settings" : { > > > "index.number\_of\_shards" : 1, > > > "index.number\_of\_replicas" : 0 > > > }, > > > "mappings" : { > > > "test-doc" : { > > > "\_ttl" : { > > > "enabled" : true, > > > "default" : "1m" > > > } > > > } > > > } > > > }' > > > % curl -XPUT 'localhost:9200/test-ttl/test-\*\*doc/1' -d '{ "title" : > > > "test title" }' > > > % curl -XPOST 'localhost:9200/test-ttl/test-\*\*doc/1/\_update' -d '{ > > > "doc" : { "title" : "test update title" } }' > > > > > > In another window, I have this running: > > > > > > % while true ; do date ; curl -XGET '[http://localhost:9200/test-](http://localhost:9200/test-)\*\* > > > ttl/test-doc/1?pretty=true&\*\*fields=title,\_ttl[http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,\_ttl](http://localhost:9200/test-ttl/test-doc/1?pretty=true&fields=title,_ttl)' > > > ; sleep 1 ; done > > > > > > While that's running, I can watch the \_ttl field decrease. When it > > > becomes negative, the document is in a state such that its TTL has expired, > > > but ES hasn't yet run the cleanup step. I can still retrieve the document, > > > even though technically speaking it's "expired". > > > > > > When the document is in this state, if I do: > > > > > > % curl -XPOST 'localhost:9200/test-ttl/test-\*\*doc/1/\_update' -d '{ > > > "doc" : { "title" : "test update title" } }' > > > > > > ... I get the following error message: > > > > > > {"error":" **ElasticSearchIllegalArgumentEx** ception[TTL value must be \> > > > 0. Illegal value provided [-209]]","status":400} > > > > > > This is causing me a little bit of grief because the program I have > > > written to update documents in ES doesn't handle this properly, so it just > > > bombs out entirely (which I really need to fix regardless). Is there > > > another way I should be updating documents that could be in this "expired > > > but still available" state? > > > > > > Thanks, > > > Brad. > > > > -- > > You received this message because you are subscribed to a topic in the > > Google Groups "elasticsearch" group. > > To unsubscribe from this topic, visit > > [https://groups.google.com/d/topic/elasticsearch/ifvWZJjQuvU/unsubscribe](https://groups.google.com/d/topic/elasticsearch/ifvWZJjQuvU/unsubscribe). > > To unsubscribe from this group and all its topics, send an email to > > [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Benjamin\_Deveze](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/benjamin_deveze/32/1577_2.png) [@Benjamin\_Deveze](https://discuss.elastic.co/u/Benjamin_Deveze)\ **Post date:** [June 27, 2013, 9:14pm UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/7 "2013-06-27T21:14:33Z")
InquiringMind yeah you are certainly right and this is more or less what I have begun to talk about in the issue. I think the negative TTL value error message is not very good in any case. On Thursday, June 27, 2013 11:08:24 PM UTC+2, InquiringMind wrote: > Benjamin, > > In this case, should the document also be omitted from a match-all query > or other type of search instead of being returned with a negative TTL? And > not just a get-by-id request? > > Brian > > On Thursday, June 27, 2013 2:24:17 AM UTC-4, Benjamin Devèze wrote: > > > Brad, > > > > I think you are right it should probably behave as if the document has > > been deleted when it is in expired state but not yet expunged, i.e. in your > > case it should return a DocumentMissingException I guess. > > > > Thanks for reporting, would you mind opening an issue for it? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:29am UTC](https://discuss.elastic.co/t/ttl-value-must-be-0-illegal-value-provided-when-updating-document-with--ttl-set/12557/8 "2017-07-06T02:29:10Z")