Getting ElasticsearchIntegrationTest teardown failures :: "Delete Index failed - not acked"

Elastic Stack Elasticsearch
1

I am getting the following intermittent failure on random different tests
(I presume during the teardown) when the build is running on TeamCity.
I cant seem reproduce it locally. I get a failure about 1 in 10-20 test
runs.
Its not clear to me why I am getting the failure. Anyone have any
suggestions of avenues of investigation?
(it does seem to be the same agent most of the time - linux agent (Linux,
version 2.6.18-308.el5) )

Cheers

java.lang.AssertionError: Delete Index failed - not acked
Expected:
but: was
at __randomizedtesting.SeedInfo.seed([96D0029807FBF53F:BBD4E4A226B82353
]:0)
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertAcked(
ElasticsearchAssertions.java:110)
at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertAcked(
ElasticsearchAssertions.java:106)
at org.elasticsearch.test.ImmutableTestCluster.wipeIndices(
ImmutableTestCluster.java:126)
at org.elasticsearch.test.ImmutableTestCluster.wipe(ImmutableTestCluster
.java:68)
at org.elasticsearch.test.ElasticsearchIntegrationTest.afterInternal(
ElasticsearchIntegrationTest.java:513)
at org.elasticsearch.test.ElasticsearchIntegrationTest.after(
ElasticsearchIntegrationTest.java:1364)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(
RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(
RandomizedRunner.java:885)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(
TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(
TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(
AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.
SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:
55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(
TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(
TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(
TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(
StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.
forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(
ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(
RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(
RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(
RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(
RandomizedRunner.java:783)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(
AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(
TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.
SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:
55)
at com.carrotsearch.randomizedtesting.rules.
NoShadowingOrOverridesOnMethodsRule$1.evaluate(
NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.
NoShadowingOrOverridesOnMethodsRule$1.evaluate(
NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(
StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(
TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(
TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(
TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(
TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(
StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b07d1a4a-e2cd-40ac-b7ec-4042ead8132f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Anyone have any insights?

On Friday, 5 September 2014 17:09:15 UTC+1, mooky wrote:

I am getting the following intermittent failure on random different tests
(I presume during the teardown) when the build is running on TeamCity.
I cant seem reproduce it locally. I get a failure about 1 in 10-20 test
runs.
Its not clear to me why I am getting the failure. Anyone have any
suggestions of avenues of investigation?
(it does seem to be the same agent most of the time - linux agent (Linux,
version 2.6.18-308.el5) )

Cheers

java.lang.AssertionError: Delete Index failed - not acked
Expected:
but: was
at __randomizedtesting.SeedInfo.seed([96D0029807FBF53F:
BBD4E4A226B82353]:0)
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertAcked
(ElasticsearchAssertions.java:110)
at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertAcked
(ElasticsearchAssertions.java:106)
at org.elasticsearch.test.ImmutableTestCluster.wipeIndices(
ImmutableTestCluster.java:126)
at org.elasticsearch.test.ImmutableTestCluster.wipe(
ImmutableTestCluster.java:68)
at org.elasticsearch.test.ElasticsearchIntegrationTest.afterInternal(
ElasticsearchIntegrationTest.java:513)
at org.elasticsearch.test.ElasticsearchIntegrationTest.after(
ElasticsearchIntegrationTest.java:1364)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(
RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(
RandomizedRunner.java:885)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(
TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(
TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(
AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.
SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.
java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(
TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(
TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(
TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(
StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.
ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.
forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(
ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(
RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(
RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(
RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(
RandomizedRunner.java:783)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(
AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(
TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.
SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.
java:55)
at com.carrotsearch.randomizedtesting.rules.
NoShadowingOrOverridesOnMethodsRule$1.evaluate(
NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.
NoShadowingOrOverridesOnMethodsRule$1<span style="color: #660;"
class="styled-by-prettify"
...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/87e88ef3-62d4-442c-9ba1-b1ea2ee688a2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

3

No suggestions at all?

On Friday, 5 September 2014 17:09:15 UTC+1, mooky wrote:

I am getting the following intermittent failure on random different tests
(I presume during the teardown) when the build is running on TeamCity.
I cant seem reproduce it locally. I get a failure about 1 in 10-20 test
runs.
Its not clear to me why I am getting the failure. Anyone have any
suggestions of avenues of investigation?
(it does seem to be the same agent most of the time - linux agent (Linux,
version 2.6.18-308.el5) )

Cheers

java.lang.AssertionError: Delete Index failed - not acked
Expected:
but: was
at __randomizedtesting.SeedInfo.seed([96D0029807FBF53F:
BBD4E4A226B82353]:0)
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertAcked
(ElasticsearchAssertions.java:110)
at org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertAcked
(ElasticsearchAssertions.java:106)
at org.elasticsearch.test.ImmutableTestCluster.wipeIndices(
ImmutableTestCluster.java:126)
at org.elasticsearch.test.ImmutableTestCluster.wipe(
ImmutableTestCluster.java:68)
at org.elasticsearch.test.ElasticsearchIntegrationTest.afterInternal(
ElasticsearchIntegrationTest.java:513)
at org.elasticsearch.test.ElasticsearchIntegrationTest.after(
ElasticsearchIntegrationTest.java:1364)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(
RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(
RandomizedRunner.java:885)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(
TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(
TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(
AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.
SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.
java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(
TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(
TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(
TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(
StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.
ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.
forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(
ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(
RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(
RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(
RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(
RandomizedRunner.java:783)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(
AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(
TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.
SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.
java:55)
at com.carrotsearch.randomizedtesting.rules.
NoShadowingOrOverridesOnMethodsRule$1.evaluate(
NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.
NoShadowingOrOverridesOnMethodsRule$1<span style="color: #660;"
class="styled-by-prettify"
...

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c43e1b49-ab82-45c5-996a-daef89a79394%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.