# Problem with big log files

**URL:** <https://discuss.elastic.co/t/problem-with-big-log-files/229325>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [April 22, 2020, 5:33pm UTC](https://discuss.elastic.co/t/problem-with-big-log-files/229325 "2020-04-22T17:33:27Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Adryeh](https://avatars.discourse-cdn.com/v4/letter/a/71e660/32.png) [@Adryeh](https://discuss.elastic.co/u/Adryeh)\
**Post date:** [April 22, 2020, 5:33pm UTC](https://discuss.elastic.co/t/problem-with-big-log-files/229325/1 "2020-04-22T17:33:27Z")

</div>

Hi to all!  
I am using filebeat version 6.8.8 and i have a problem. I need to bring deploy logs to kibana. Each file have 1-2k lines and for parsing in Logstash i need whole file content and there is my problem.  
If i use config like this my logs come not completely. For example i have file 2k lines, first doc comes in size of 500 lines, that is, the same file comes in parts and that fact give me a lot of problem with message parsing in logstash, because message is not full

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/f/1/f14477df1ee0dc26e94173b653bfb96700692c96.png)  
If i don't use :

```auto
  clean_inactive: 24h
  ignore_older: 23h
  close_inactive: 22h
  close_eof: true

```

then my registry file just overflows and i recieve ERROR every second:

```auto
ERROR	registrar/registrar.go:363	Writing of registry returned error: rename /var/lib/filebeat/registry.new /var/lib/filebeat/registry: no such file or directory. Continuing...

```

I really hope u understood my problem, I would be grateful if you help)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 20, 2020, 5:33pm UTC](https://discuss.elastic.co/t/problem-with-big-log-files/229325/2 "2020-05-20T17:33:31Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.