# Source raw files purging after shipping to ELK **URL:** \ **Category:** Beats\ **Tags:** filebeat\ **Created:** [August 3, 2020, 3:05pm UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597 "2020-08-03T15:05:42Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Puneeth\_S\_B\_Gowda1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/puneeth_s_b_gowda1/32/68544_2.png) [@Puneeth\_S\_B\_Gowda1](https://discuss.elastic.co/u/Puneeth_S_B_Gowda1)\ **Post date:** [August 3, 2020, 3:05pm UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/1 "2020-08-03T15:05:42Z")
how to manage physical logs file after moving to ELK if we want to delete text files after moving to ELK how do we do? what tool can i userWe are getting payload logs from GDS channels as response for our request to book a hotel in the XML and JSON format we are longing those logs in log4net .TXT file we are moving those logs from app server to ELK server through file beatThe question here is how do we manage to delete these TBs of data once ELK eat it what tool can we use how do we do If ELK getting data then we don't want one hour of physical files in app server so that we can manage disc space very well [8:29](https://elasticstack.slack.com/archives/CNEDGGJQ3/p1596466767310400) the text file looks like this with response and other column ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/9/09669da33f2f0b5041cccd7f9b78859c0f547f44.png) ![image](https://us1.discourse-cdn.com/elastic/original/3X/7/a/7afef1d64b1b4ce65ac697704c3af8f0de468701.png) ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [August 3, 2020, 10:58pm UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/2 "2020-08-03T22:58:13Z")
This is something that needs to be handled outside of Filebeat, it cannot do that for you. ---
**Author:** ![Puneeth\_S\_B\_Gowda1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/puneeth_s_b_gowda1/32/68544_2.png) [@Puneeth\_S\_B\_Gowda1](https://discuss.elastic.co/u/Puneeth_S_B_Gowda1)\ **Post date:** [August 10, 2020, 3:50am UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/3 "2020-08-10T03:50:18Z")
Can we use any other tool for this? ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [August 10, 2020, 4:17am UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/4 "2020-08-10T04:17:32Z")
Maybe a scheduled job to delete everything after a week? ---
**Author:** ![Puneeth\_S\_B\_Gowda1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/puneeth_s_b_gowda1/32/68544_2.png) [@Puneeth\_S\_B\_Gowda1](https://discuss.elastic.co/u/Puneeth_S_B_Gowda1)\ **Post date:** [August 10, 2020, 10:55am UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/5 "2020-08-10T10:55:42Z")
> [@warkolm](#): > > Maybe a scheduled job to delete everything after a week? Thanks warkolm ---
**Author:** ![Puneeth\_S\_B\_Gowda1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/puneeth_s_b_gowda1/32/68544_2.png) [@Puneeth\_S\_B\_Gowda1](https://discuss.elastic.co/u/Puneeth_S_B_Gowda1)\ **Post date:** [August 17, 2020, 1:05pm UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/6 "2020-08-17T13:05:33Z")
Got the solution thanks all ![image](https://us1.discourse-cdn.com/elastic/original/3X/4/8/4850a0bede36f8ed15dca7ca479439198c0441b2.png) ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [September 14, 2020, 3:05pm UTC](https://discuss.elastic.co/t/source-raw-files-purging-after-shipping-to-elk/243597/7 "2020-09-14T15:05:37Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.