# \[ASK\] Other log collector or log sender

**URL:** https://discuss.elastic.co/t/ask-other-log-collector-or-log-sender/155499
**Category:** Beats
**Tags:** filebeat
**Created:** [November 6, 2018, 8:03am UTC](https://discuss.elastic.co/t/ask-other-log-collector-or-log-sender/155499 "2018-11-06T08:03:16Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![merceskoba](https://avatars.discourse-cdn.com/v4/letter/m/57b2e6/32.png) [@merceskoba](https://discuss.elastic.co/u/merceskoba)
#### Post date: [November 6, 2018, 8:03am UTC](https://discuss.elastic.co/t/ask-other-log-collector-or-log-sender/155499/1 "2018-11-06T08:03:16Z")

</div>

Hello Guys  
Do you know other log collector such as Filebeat ?  
Filebeat doesn't has `sampling_rate`([https://www.scalyr.com/help/scalyr-agent#filter](https://www.scalyr.com/help/scalyr-agent#filter))

My company doesn't want using Scalyr anymore. That's so expensive 🙂  
That's why i am trying to make POC using Filebeat as log collector or log sender.  
Do you know guys, other log collector or log sender app ?  
Please help me out of this POC 😃

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [November 6, 2018, 8:34am UTC](https://discuss.elastic.co/t/ask-other-log-collector-or-log-sender/155499/2 "2018-11-06T08:34:42Z")

</div>

Filebeat allows you to drop logs based on patterns - might that work for you? That way you are sure you are not sampling out any vital logs.

---

<div class="post-metadata">

### Author: ![merceskoba](https://avatars.discourse-cdn.com/v4/letter/m/57b2e6/32.png) [@merceskoba](https://discuss.elastic.co/u/merceskoba)
#### Post date: [November 6, 2018, 9:11am UTC](https://discuss.elastic.co/t/ask-other-log-collector-or-log-sender/155499/3 "2018-11-06T09:11:11Z")

</div>

Filebeat can drop logs based on patterns using `exclude` or `include` right ?  
But, the case is when you need only 100 logs of 1000 logs. They are same logs.  
For example, in my company case we are using Golang and sometimes if there is a error, it will write like this  
`account_gen.go ERR dpkg/blablablabla/ [TIMESTAMP]`  
`account_gen.go ERR dpkg/abcbacbacb/ [TIMESTAMP]`  
`account_gen.go ERR dpkg/pqpqpqpqp/ [TIMESTAMP]`  
untill the thousands line.  
With sampling\_rate 0.1 (scalyr), i can send only 0.1\*TOTAL\_AMOUNT logs.  
`{ match_expression: "go", sampling_rate: 0.1 }` means, i will allow "go" word and the sampling\_rate is 0.1 or 10% of total logs.  
if i use `include_lines` it means i allow all. If i use `exclude_lines`, it means i disallow all.  
sampling\_rate: 0 means `exclude_lines`  
sampling\_rate: 1 means `include_lines`  
sampling\_rate: 0.1 or 0.2 or 0.3 means `include_lines` but only 0.1 (10%) of total logs

That's why we really need sampling\_rate, so developers know there are some errors in some logs without sending all logs.  
I trust Filebeat because yeah, you are always updating it dude...  
but still i need sampling\_rate... if you have suggestions, let me try for my POC 😃

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 4, 2018, 11:11am UTC](https://discuss.elastic.co/t/ask-other-log-collector-or-log-sender/155499/4 "2018-12-04T11:11:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
