# Process Logs line after the line

**URL:** https://discuss.elastic.co/t/process-logs-line-after-the-line/181992
**Category:** Beats
**Tags:** filebeat
**Created:** [May 21, 2019, 12:11pm UTC](https://discuss.elastic.co/t/process-logs-line-after-the-line/181992 "2019-05-21T12:11:42Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![sjabiulla](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sjabiulla/32/48429_2.png) [@sjabiulla](https://discuss.elastic.co/u/sjabiulla)
#### Post date: [May 21, 2019, 12:11pm UTC](https://discuss.elastic.co/t/process-logs-line-after-the-line/181992/1 "2019-05-21T12:11:42Z")

</div>

I have a log file in below format and I'm using filebeats to push to Logstash

```
Currenttime="5/21/19 1:42 AM" Job="MyJob" Status="WAITING" START_TIME="" END_TIME="" AVG_TIME=146
Currenttime="5/21/19 3:00 AM" Job="MyJob" Status="Running" START_TIME="2019/05/21 02:55" END_TIME="" AVG_TIME=146
Currenttime="5/21/19 4:00 AM" Job="MyJob" Status="Running" START_TIME="2019/05/21 02:55" END_TIME="" AVG_TIME=146
Currenttime="5/21/19 4:48 AM" Job="MyJob" Status="Completed" START_TIME="2019/05/21 02:55" END_TIME="2019/05/21 04:48" AVG_TIME=146

```

When I add multiple lines and save into this file, it's not picking line by line. It's processing all lines at the same time parallely. Which means, the last line is processing at the beginning sometimes and finally when I index this to ElasticSearch, I'm not having the latest job details always.

Is there any way to prevent this ?

---

<div class="post-metadata">

### Author: ![sjabiulla](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sjabiulla/32/48429_2.png) [@sjabiulla](https://discuss.elastic.co/u/sjabiulla)
#### Post date: [May 22, 2019, 9:49am UTC](https://discuss.elastic.co/t/process-logs-line-after-the-line/181992/2 "2019-05-22T09:49:13Z")

</div>

@jsoriano,

Could you please assist me with this

---

<div class="post-metadata">

### Author: ![sjabiulla](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sjabiulla/32/48429_2.png) [@sjabiulla](https://discuss.elastic.co/u/sjabiulla)
#### Post date: [May 22, 2019, 9:57am UTC](https://discuss.elastic.co/t/process-logs-line-after-the-line/181992/3 "2019-05-22T09:57:01Z")

</div>

Issue was with my Logstash. I have restricted the pipeline worker to 1 by adding `-w 1` while starting Logstash and it solved the issue.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 19, 2019, 9:57am UTC](https://discuss.elastic.co/t/process-logs-line-after-the-line/181992/4 "2019-06-19T09:57:02Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
