# Filebeat merging two logs **URL:** \ **Category:** Beats\ **Tags:** filebeat\ **Created:** [November 14, 2019, 9:12am UTC](https://discuss.elastic.co/t/filebeat-merging-two-logs/207843 "2019-11-14T09:12:56Z")\ **Posts on this page:** 2\ **Page:** 1
**Author:** ![sur1029](https://avatars.discourse-cdn.com/v4/letter/s/e274bd/32.png) [@sur1029](https://discuss.elastic.co/u/sur1029)\ **Post date:** [November 14, 2019, 9:12am UTC](https://discuss.elastic.co/t/filebeat-merging-two-logs/207843/1 "2019-11-14T09:12:57Z")
Hi, I am using filebeat to push logs to elastic search. The logs is mainly a json which is being pushed by different celery workers all in one single file. However I am noticing that these logs are getting merged for few cases. Errors in filebeat error log ERR Rotate error: rename /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry.new /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry: no such file or directory 2019/11/14 09:26:51.198936 registrar.go:217: ERR Writing of registry returned error: rename /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry.new /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry: no such file or directory. Continuing... 2019/11/14 09:27:01.312579 helper\_other.go:14: ERR Rotate error: rename /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry.new /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry: no such file or directory 2019/11/14 09:27:01.312611 registrar.go:217: ERR Writing of registry returned error: rename /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry.new /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry: no such file or directory. Continuing... 2019/11/14 09:27:05.328919 helper\_other.go:14: ERR Rotate error: rename /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry.new /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry: no such file or directory 2019/11/14 09:27:05.328949 registrar.go:217: ERR Writing of registry returned error: rename /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry.new /etc/filebeat\_6/filebeat-6.0.0-linux-x86\_64/data/registry: no such file or directory. Continuing... Adding a sample log message { "primary\_id": "3f72d0fd-7f05-4f2a-9e5c-a5a090407cbf\_\_0", "ch": "android", "ad": ["APA91bGRgCheCfghPyC\_4BZuI-cXx3W3-xOd5HeX-93ZM1VfzYxslQPvoxR1FPGJ4zZF6wl7c01NL7l4BKKL2tCX5Gq5LlZ6QD7Rq3V2IM5OQekLjmDSrcFlU6egcvADhZxpqUBLfMBk", "APA91bHbKPa6Ae0ff0-YttkeFUi33tRjK0MyUlWdWeZQR5C8oWE4Ie1N6QIvHlmfmxv5hjYRXhYrCD49E-sc1blpwjH5s2-PlMaMsD0nXNM1OMFEMRCS6l6ROO7RZnYMAMzpORQ0Ah1d", "APA91bE8vcxuzQ8\_ItHaw5qaZYyiDo62PoImh0kygmeuNWjgYwb6KQ3Zrin54ZK7sloOB3QgIyd1Y5Cbi-tWdBaphenAyM4TwQ89VD14CSYHDZlAFV1z3IdCgGw4tBMGTJC-xtNX-bgw", "APA91bHJXjBkEzV9A5hfv6h-yv-hUm9ixOEhr-lZp7mgWothmJAIzeiNXyX7lF0Xsk8H46MF77oWroE9GErFwtg2927DSaCHvdgVcFkLqy3sc1drbnnraVnx7QA44q5qCCci7mZ6KNzk", "APA91bE7UESyiIAF\_58lgpd9mEETxu9q7XPlXGFpWopbwojlGCzQBbvWLAvH2VV\_dIA36dIj9aoT\_SfvLvpulmXpmivGRD\_Eeq6kCJIe69NShfBt-0YQ9jyxUOzv18B3Zzcy8\_nfqauu", "APA91bETfPnCygDyxMKDAFJhvytRDb9xltvT1ASnycRP3guAAYy6f3\_-6SJ0snGkJrwvBLXesAmkYl6gL4tk26ue5urZppGErpLXUw6pqaus-ikhoAvs\_uq4GuztoqXcljl1rcMy52M3", "APA91bFAoETYeU\_0hoS75UV5KvEorTXMP1UnrREDsibXqxsRnp8Ahixx30A1FznKMReFpNgKPGyblHYh8UwtkLLB6ocNVbUGfv4GaP55gJqCieDc8DYBPJLS\_MUfdP0QfSiHI\_lkXCWu", "APA91bHHwYsRm\_CjrFohHltvHvoZABgiGAWiqIUPQqE8QLNizaOXFP4CPV5KyvTINJfd6VORDqD4xQIJgU9c8BWiyNgjkrwUiDEkpc1w1h5vxn3OYPSLdh67CIee7OzPF1a9ekNVZAPy"], "md": "2019-11-13 14:14:24", "cb": "", "app": "mmt", "message\_identifiers": {}, "nid": "3f72d0fd-7f05-4f2a-9e5c-a5a090407cbf", "cd": "2019-11-13 14:14:24", "tn": "mmt\_template", "tag": [{ "value": "[aakash.rockstar2009@gmail.com](mailto:aakash.rockstar2009@gmail.com)", "key": "link" }, { "value": "917895406243", "key": "link" }, { "value": "APA91bGRgCheCfghPyC\_4BZuI-cXx3W3-xOd5HeX-93ZM1VfzYxslQPvoxR1FPGJ4zZF6wl7c01NL7l4BKKL2tCX5Gq5LlZ6QD7Rq3V2IM5OQekLjmDSrcFlU6egcvADhZxpqUBLfMBk", "key": "pntoken" }, { "value": "APA91bHbKPa6Ae0ff0-YttkeFUi33tRjK0MyUlWdWeZQR5C8oWE4Ie1N6QIvHlmfmxv5hjYRXhYrCD49E-sc1blpwjH5s2-PlMaMsD0nXNM1OMFEMRCS6l6ROO7RZnYMAMzpORQ0Ah1d", "key": "pntoken" }, { "value": "APA91bE8vcxuzQ8\_ItHaw5qaZYyiDo62PoImh0kygmeuNWjgYwb6KQ3Zrin54ZK7sloOB3QgIyd1Y5Cbi-tWdBaphenAyM4TwQ89VD14CSYHDZlAFV1z3IdCgGw4tBMGTJC-xtNX-bgw", "key": "pntoken" }, { "value": "APA91bHJXjBkEzV9A5hfv6h-yv-hUm9ixOEhr-lZp7mgWothmJAIzeiNXyX7lF0Xsk8H46MF77oWroE9GErFwtg2927DSaCHvdgVcFkLqy3sc1drbnnraVnx7QA44q5qCCci7mZ6KNzk", "key": "pntoken" }, { "value": "APA91bE7UESyiIAF\_58lgpd9mEETxu9q7XPlXGFpWopbwojlGCzQBbvWLAvH2VV\_dIA36dIj9aoT\_SfvLvpulmXpmivGRD\_Eeq6kCJIe69NShfBt-0YQ9jyxUOzv18B3Zzcy8\_nfqauu", "key": "pntoken" }, { "value": "APA91bETfPnCygDyxMKDAFJhvytRDb9xltvT1ASnycRP3guAAYy6f3\_-6SJ0snGkJrwvBLXesAmkYl6gL4tk26ue5urZppGErpLXUw6pqaus-ikhoAvs\_uq4GuztoqXcljl1rcMy52M3", "key": "pntoken" }, { "value": "APA91bFAoETYeU\_0hoS75UV5KvEorTXMP1UnrREDsibXqxsRnp8Ahixx30A1FznKMReFpNgKPGyblHYh8UwtkLLB6ocNVbUGfv4GaP55gJqCieDc8DYBPJLS\_MUfdP0QfSiHI\_lkXCWu", "key": "pntoken" }, { "value": "APA91bHHwYsRm\_CjrFohHltvHvoZABgiGAWiqIUPQqE8QLNizaOXFP4CPV5KyvTINJfd6VORDqD4xQIJgU9c8BWiyNgjkrwUiDEkpc1w1h5vxn3OYPSLdh67CIee7OzPF1a9ekNVZAPy", "key": "pntoken" }], "fd": null, "time": "2019-11-13T08:44:24.605837", "dt": { "primary\_id": "3f72d0fd-7f05-4f2a-9e5c-a5a090407cbf\_\_0", "token": ["APA91bGRgCheCfghPyC\_4BZuI-cXx3W3-xOd5HeX-93ZM1VfzYxslQPvoxR1FPGJ4zZF6wl7c01NL7l4BKKL2tCX5Gq5LlZ6QD7Rq3V2IM5OQekLjmDSrcFlU6egcvADhZxpqUBLfMBk", "APA91bHbKPa6Ae0ff0-YttkeFUi33tRjK0MyUlWdWeZQR5C8oWE4Ie1N6QIvHlmfmxv5hjYRXhYrCD49E-sc1blpwjH5s2-PlMaMsD0nXNM1OMFEMRCS6l6ROO7RZnYMAMzpORQ0Ah1d", "APA91bE8vcxuzQ8\_ItHaw5qaZYyiDo62PoImh0kygmeuNWjgYwb6KQ3Zrin54ZK7sloOB3QgIyd1Y5Cbi-tWdBaphenAyM4TwQ89VD14CSYHDZlAFV1z3IdCgGw4tBMGTJC-xtNX-bgw", "APA91bHJXjBkEzV9A5hfv6h-yv-hUm9ixOEhr-lZp7mgWothmJAIzeiNXyX7lF0Xsk8H46MF77oWroE9GErFwtg2927DSaCHvdgVcFkLqy3sc1drbnnraVnx7QA44q5qCCci7mZ6KNzk", "APA91bE7UESyiIAF\_58lgpd9mEETxu9q7XPlXGFpWopbwojlGCzQBbvWLAvH2VV\_dIA36dIj9aoT\_SfvLvpulmXpmivGRD\_Eeq6kCJIe69NShfBt-0YQ9jyxUOzv18B3Zzcy8\_nfqauu", "APA91bETfPnCygDyxMKDAFJhvytRDb9xltvT1ASnycRP3guAAYy6f3\_-6SJ0snGkJrwvBLXesAmkYl6gL4tk26ue5urZppGErpLXUw6pqaus-ikhoAvs\_uq4GuztoqXcljl1rcMy52M3", "APA91bFAoETYeU\_0hoS75UV5KvEorTXMP1UnrREDsibXqxsRnp8Ahixx30A1FznKMReFpNgKPGyblHYh8UwtkLLB6ocNVbUGfv4GaP55gJqCieDc8DYBPJLS\_MUfdP0QfSiHI\_lkXCWu", "APA91bHHwYsRm\_CjrFohHltvHvoZABgiGAWiqIUPQqE8QLNizaOXFP4C{" md ": " 2019 - 11 - 13 14: 14: 24 ", " ch ": " sms ", " nm ": " DownloadSms ", " sent\_ack\_received\_at ": " 2019 - 11 - 13 14: 14: 24 ", " app ": " pigeon ", " nid ": " b206b4cb - aab6 - 4858 - 8 dba - 13 b4bfebc5ee ", " st ": 9, " primary\_id ": " b206b4cb - aab6 - 4858 - 8 dba - 13 b4bfebc5ee\_\_0 ", " time ": " 2019 - 11 - 13 T08: 44: 24.605968 ", " message ": " SENT\_ACK\_RECIEVED\_STATUS "} This is leading to erroneous json and is getting rejected at filebeat level. Please help ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 12, 2019, 9:13am UTC](https://discuss.elastic.co/t/filebeat-merging-two-logs/207843/2 "2019-12-12T09:13:01Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.