# Big logs files with TFS elasticsearch **URL:** \ **Category:** Elasticsearch\ **Created:** [September 16, 2020, 9:40am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806 "2020-09-16T09:40:08Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![Freud](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/freud/32/75669_2.png) [@Freud](https://discuss.elastic.co/u/Freud)\ **Post date:** [September 16, 2020, 9:40am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/1 "2020-09-16T09:40:08Z")
Hi, We have a TFS 2018 and since a few days elasticsearch create 5Go logs file every days. I don't know what is the matter with it. The log contain 2 type of WARN "cluster.action.shard" and "indices.cluster" Can someone help me? ```auto [codesearchshared_1_0][[codesearchshared_1_0][9]] IndexShardRecoveryException[failed to recovery from gateway]; nested: EngineCreationFailureException[failed to create engine]; nested: EOFException; at org.elasticsearch.index.shard.StoreRecoveryService.recoverFromStore(StoreRecoveryService.java:250) at org.elasticsearch.index.shard.StoreRecoveryService.access$100(StoreRecoveryService.java:56) at org.elasticsearch.index.shard.StoreRecoveryService$1.run(StoreRecoveryService.java:129) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: [codesearchshared_1_0][[codesearchshared_1_0][9]] EngineCreationFailureException[failed to create engine]; nested: EOFException; at org.elasticsearch.index.engine.InternalEngine.(InternalEngine.java:152) at org.elasticsearch.index.engine.InternalEngineFactory.newReadWriteEngine(InternalEngineFactory.java:25) at org.elasticsearch.index.shard.IndexShard.newEngine(IndexShard.java:1509) at org.elasticsearch.index.shard.IndexShard.createNewEngine(IndexShard.java:1493) at org.elasticsearch.index.shard.IndexShard.internalPerformTranslogRecovery(IndexShard.java:966) at org.elasticsearch.index.shard.IndexShard.performTranslogRecovery(IndexShard.java:938) at org.elasticsearch.index.shard.StoreRecoveryService.recoverFromStore(StoreRecoveryService.java:241) ... 5 more Caused by: java.io.EOFException at org.apache.lucene.store.InputStreamDataInput.readByte(InputStreamDataInput.java:37) at org.apache.lucene.store.DataInput.readInt(DataInput.java:101) at org.apache.lucene.store.DataInput.readLong(DataInput.java:157) at org.elasticsearch.index.translog.Checkpoint.(Checkpoint.java:54) at org.elasticsearch.index.translog.Checkpoint.read(Checkpoint.java:83) at org.elasticsearch.index.translog.Translog.recoverFromFiles(Translog.java:337) at org.elasticsearch.index.translog.Translog.(Translog.java:179) at org.elasticsearch.index.engine.InternalEngine.openTranslog(InternalEngine.java:205) at org.elasticsearch.index.engine.InternalEngine.(InternalEngine.java:148) ... 11 more [2020-09-07 09:23:49,864][WARN][cluster.action.shard] [SCHRODINGER] [codesearchshared_1_0][9] received shard failed for target shard [[codesearchshared_1_0][9], node[BOxuVCxDRkK8Yq_sDeLLzg], [P], v[215], s[INITIALIZING], a[id=q_QzCNrTSBm3GET9AlvyrA], unassigned_info[[reason=ALLOCATION_FAILED], at[2020-09-07T07:23:49.802Z], details[failed recovery, failure IndexShardRecoveryException[failed to recovery from gateway]; nested: EngineCreationFailureException[failed to create engine]; nested: EOFException; ]]], indexUUID [6o5xtwntTGG74aLcO99cSw], message [failed recovery], failure [IndexShardRecoveryException[failed to recovery from gateway]; nested: EngineCreationFailureException[failed to create engine]; nested: EOFException; ] [codesearchshared_1_0][[codesearchshared_1_0][9]] IndexShardRecoveryException[failed to recovery from gateway]; nested: EngineCreationFailureException[failed to create engine]; nested: EOFException; at org.elasticsearch.index.shard.StoreRecoveryService.recoverFromStore(StoreRecoveryService.java:250) at org.elasticsearch.index.shard.StoreRecoveryService.access$100(StoreRecoveryService.java:56) at org.elasticsearch.index.shard.StoreRecoveryService$1.run(StoreRecoveryService.java:129) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: [codesearchshared_1_0][[codesearchshared_1_0][9]] EngineCreationFailureException[failed to create engine]; nested: EOFException; at org.elasticsearch.index.engine.InternalEngine.(InternalEngine.java:152) at org.elasticsearch.index.engine.InternalEngineFactory.newReadWriteEngine(InternalEngineFactory.java:25) at org.elasticsearch.index.shard.IndexShard.newEngine(IndexShard.java:1509) at org.elasticsearch.index.shard.IndexShard.createNewEngine(IndexShard.java:1493) at org.elasticsearch.index.shard.IndexShard.internalPerformTranslogRecovery(IndexShard.java:966) at org.elasticsearch.index.shard.IndexShard.performTranslogRecovery(IndexShard.java:938) at org.elasticsearch.index.shard.StoreRecoveryService.recoverFromStore(StoreRecoveryService.java:241) ... 5 more Caused by: java.io.EOFException at org.apache.lucene.store.InputStreamDataInput.readByte(InputStreamDataInput.java:37) at org.apache.lucene.store.DataInput.readInt(DataInput.java:101) at org.apache.lucene.store.DataInput.readLong(DataInput.java:157) at org.elasticsearch.index.translog.Checkpoint.(Checkpoint.java:54) at org.elasticsearch.index.translog.Checkpoint.read(Checkpoint.java:83) at org.elasticsearch.index.translog.Translog.recoverFromFiles(Translog.java:337) at org.elasticsearch.index.translog.Translog.(Translog.java:179) at org.elasticsearch.index.engine.InternalEngine.openTranslog(InternalEngine.java:205) at org.elasticsearch.index.engine.InternalEngine.(InternalEngine.java:148) ... 11 more ``` ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [September 17, 2020, 12:19am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/2 "2020-09-17T00:19:21Z")
What's TFS? What does it have to do with Elasticsearch in this context? ---
**Author:** ![Freud](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/freud/32/75669_2.png) [@Freud](https://discuss.elastic.co/u/Freud)\ **Post date:** [September 17, 2020, 7:10am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/3 "2020-09-17T07:10:52Z")
TFS is Team Foundation Server This is a Microsoft software that use elasticsearch for some of the search that you can do. I was talking about TFS, because we didn't install elasticsearch, we install TFS that install and use elasticsearch ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [September 17, 2020, 7:21am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/4 "2020-09-17T07:21:04Z")
This looks to be a positively ancient version of Elasticsearch, somewhere in the 2.3 or 2.4 range, so literally years past the [end of its supported life](https://www.elastic.co/support/eol). It also looks like the data on disk is fundamentally broken. I'm not sure what to suggest apart from a reinstall since we don't know how TFS is using it and whether it can repair the broken data. Microsoft support are the right people to ask about that. You should also upgrade this to a more recent version of Elasticsearch as a matter of some urgency. ---
**Author:** ![Freud](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/freud/32/75669_2.png) [@Freud](https://discuss.elastic.co/u/Freud)\ **Post date:** [September 21, 2020, 9:01am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/5 "2020-09-21T09:01:08Z")
They said that > Hi, we don’t give support to these kind of issues because it is related to a third-party product. Please [contact](https://www.elastic.co/contact?storm=global-header-en)them directly for assistance. Best regards! ---
**Author:** ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)\ **Post date:** [September 21, 2020, 10:12am UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/6 "2020-09-21T10:12:31Z")
Sorry, I haven't got any better advice than to upgrade to a non-ancient version of Elasticsearch and reinstall whatever needs reinstalling to rebuild the lost data. ---
**Author:** ![Freud](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/freud/32/75669_2.png) [@Freud](https://discuss.elastic.co/u/Freud)\ **Post date:** [September 21, 2020, 2:54pm UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/7 "2020-09-21T14:54:55Z")
Tx, since the search in TFS seems to work fine, we have setup the log on error for now. We will try to add a new ElasticSearch server on day, but not now. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [October 19, 2020, 2:54pm UTC](https://discuss.elastic.co/t/big-logs-files-with-tfs-elasticsearch/248806/8 "2020-10-19T14:54:56Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.