# Filebeat: how to archive data or reduce primary **URL:** \ **Category:** Elasticsearch\ **Created:** [April 6, 2016, 3:43pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558 "2016-04-06T15:43:55Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![timmorris83](https://avatars.discourse-cdn.com/v4/letter/t/3bc359/32.png) [@timmorris83](https://discuss.elastic.co/u/timmorris83)\ **Post date:** [April 6, 2016, 3:43pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558/1 "2016-04-06T15:43:55Z")
I'm brand new to this, so sorry if I use a term wrong. I have set up filebeat on one client to send IIS logs directly to elasticsearch. The problem is I am getting hammered with data, about 500mb in 30minutes. My IIS logs do get pretty large, anywhere form 300mb-1GB in a day. Is there a way I can archive this data in elasticsearch or some other best practices? In the first 30minutes I have 624956 doc.count. I also noticed there are 5 primaries with about the same amount of data per. Are these copies of each other? Can I get that down to just 1 primary? Also, everything as far as configs for both elasticsearch and filebeat are at their defaults. Thank you for your help. ---
**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\ **Post date:** [April 6, 2016, 7:42pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558/2 "2016-04-06T19:42:03Z")
@timmorris83 question sounds more related to Elasticsearch. Moved discussion to Elasticsearch section. ---
**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\ **Post date:** [April 6, 2016, 7:46pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558/3 "2016-04-06T19:46:21Z")
@timmorris have you considered filtering out documents being indexed by filebeat? See `exclude_lines/include_lines options` in [docs](https://www.elastic.co/guide/en/beats/filebeat/current/configuration-filebeat-options.html#exclude-lines). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 6, 2016, 11:41pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558/4 "2016-04-06T23:41:24Z")
Check out Elasticsearch Curator [Curator Reference [8.0] | Elastic](https://www.elastic.co/guide/en/elasticsearch/client/curator/current/index.html) > [@timmorris83](#): > > I also noticed there are 5 primaries with about the same amount of data per. Are these copies of each other? No, that is the entire set of data split into 5. ---
**Author:** ![timmorris83](https://avatars.discourse-cdn.com/v4/letter/t/3bc359/32.png) [@timmorris83](https://discuss.elastic.co/u/timmorris83)\ **Post date:** [April 8, 2016, 1:27pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558/5 "2016-04-08T13:27:47Z")
Thanks for this tip. Definitely has helped. Just need to tweak it some more. Initially I was going to try to use the IIS logs to understand response times my customers are seeing, but this doesn't seem like the right choice. Do you know of a beat that is made for web traffic analysis, such as response times? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 5, 2017, 11:01pm UTC](https://discuss.elastic.co/t/filebeat-how-to-archive-data-or-reduce-primary/46558/6 "2017-07-05T23:01:10Z")