# How do I transfer data across networks?

**URL:** <https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [July 22, 2019, 6:16am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577 "2019-07-22T06:16:13Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![wajika](https://avatars.discourse-cdn.com/v4/letter/w/977dab/32.png) [@wajika](https://discuss.elastic.co/u/wajika)\
**Post date:** [July 22, 2019, 6:16am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/1 "2019-07-22T06:16:14Z")

</div>

I want to transfer the data to different networks

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/d/b/dbb53ebf804b00bde93880e6da60aec335add154.png)

How should I set the url of logstash/filebeat?

# filebeat conf

output.redis:  
hosts: ["[redis.xxx.net:7887](http://redis.xxx.net:7887)"]  
key: data  
db: 0  
timeout: 30

Failed to connect to redis(tcp://redis.xxx.net:7887): dial tcp 1.1.1.1:7887: i/o timeout

# logstash conf

output {  
kafka {  
bootstrap\_servers =\> "[kafka.xxx.net:8998](http://kafka.xxx.net:8998)"  
topic\_id =\> "data"  
codec =\> json  
compression\_type =\> "gzip"  
}  
}

No data received on kafka

---

<div class="post-metadata">

**Author:** ![pierhugues](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pierhugues/32/48383_2.png) [@pierhugues](https://discuss.elastic.co/u/pierhugues)\
**Post date:** [July 25, 2019, 6:34pm UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/2 "2019-07-25T18:34:50Z")

</div>

Hello @wajika,

I am not sure I understand what you are trying to achieve here, I am looking at your diagram, I see Kafka -\> Filebeat or Logstash -\> nginx -\> Redis?

Can you clarify a bit more your problem or use case?

---

<div class="post-metadata">

**Author:** ![wajika](https://avatars.discourse-cdn.com/v4/letter/w/977dab/32.png) [@wajika](https://discuss.elastic.co/u/wajika)\
**Post date:** [July 29, 2019, 10:47am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/3 "2019-07-29T10:47:24Z")

</div>

Thanks for your reply. my English is not good.  
My problem has been solved. but I found a small problem.  
The logstash tcp input mode cannot process multiple rows of data.  
For example, the collection of nginx logs, which are not line-by-line transfers.

---

<div class="post-metadata">

**Author:** ![wajika](https://avatars.discourse-cdn.com/v4/letter/w/977dab/32.png) [@wajika](https://discuss.elastic.co/u/wajika)\
**Post date:** [July 29, 2019, 10:51am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/4 "2019-07-29T10:51:02Z")

</div>

> [@pierhugues](#):
>
> I see Kafka -\> Filebeat or Logstash -\> nginx -\> Redis?

Yeah, that's what I wanted (Kafka -\> Filebeat or Logstash -\> nginx -\> Redis?), but now I'm doing it in a different way

---

<div class="post-metadata">

**Author:** ![admlko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/admlko/32/21787_2.png) [@admlko](https://discuss.elastic.co/u/admlko)\
**Post date:** [July 29, 2019, 11:27am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/5 "2019-07-29T11:27:57Z")

</div>

If you are receiving multiline messages, you have to change the codec for the input. Default is 'line' ([https://www.elastic.co/guide/en/logstash/7.2/plugins-codecs-line.html](https://www.elastic.co/guide/en/logstash/7.2/plugins-codecs-line.html)), which uses '\n' as a delimiter.  
Check out other codecs: [https://www.elastic.co/guide/en/logstash/7.2/codec-plugins.html](https://www.elastic.co/guide/en/logstash/7.2/codec-plugins.html)

---

<div class="post-metadata">

**Author:** ![wajika](https://avatars.discourse-cdn.com/v4/letter/w/977dab/32.png) [@wajika](https://discuss.elastic.co/u/wajika)\
**Post date:** [July 31, 2019, 8:43am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/6 "2019-07-31T08:43:06Z")

</div>

No, the problem is this.  
filebeat tcp output \>\> logstash tcp input .not line-by-line transfers.

---

<div class="post-metadata">

**Author:** ![admlko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/admlko/32/21787_2.png) [@admlko](https://discuss.elastic.co/u/admlko)\
**Post date:** [July 31, 2019, 9:43am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/7 "2019-07-31T09:43:04Z")

</div>

What?  
You cannot just change the architecture and not describe the issue and expect to get good answers 🙂

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 28, 2019, 9:43am UTC](https://discuss.elastic.co/t/how-do-i-transfer-data-across-networks/191577/8 "2019-08-28T09:43:05Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.