# Functionbeat Kinesis Record Deaggregation (contribution)

**URL:** <https://discuss.elastic.co/t/functionbeat-kinesis-record-deaggregation-contribution/268420>\
**Category:** Beats\
**Tags:** functionbeat\
**Created:** [March 25, 2021, 11:47pm UTC](https://discuss.elastic.co/t/functionbeat-kinesis-record-deaggregation-contribution/268420 "2021-03-25T23:47:26Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![jpaskhay](https://avatars.discourse-cdn.com/v4/letter/j/34f0e0/32.png) [@jpaskhay](https://discuss.elastic.co/u/jpaskhay)\
**Post date:** [March 25, 2021, 11:47pm UTC](https://discuss.elastic.co/t/functionbeat-kinesis-record-deaggregation-contribution/268420/1 "2021-03-25T23:47:26Z")

</div>

Hey there,

Our team would like to make use of Kinesis record aggregation to save on AWS costs (high throughput of \<1KiB size logs), but it appears FunctionBeat does not currently handle the Kinesis aggregate record format. I think this will be a desirable feature for others as using the aggregate format seems to be a common way to improve throughput and costs with Kinesis adoption.

I have implemented the needed changes and unit tests in a local fork. I haven't yet done full integration testing in an AWS account (may need to ping our company's cloud team for assistance there due to some guardrails).

The only potential implementation issue is the only available [Golang Kinesis deaggregation implementation](https://github.com/awslabs/kinesis-aggregation/tree/master/go) is using AWS SDK v1, so it would be pulled in as a new Go mod dependency. If that is an issue, it may require working with the AWS maintainers to refactor their Go module to have an AWS SDK v2 flavor.

Let me know how to proceed. If my current solution is acceptable, I'm happy to open an issue and PR on GitHub.

Thanks!  
Joey

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 23, 2021, 1:48am UTC](https://discuss.elastic.co/t/functionbeat-kinesis-record-deaggregation-contribution/268420/2 "2021-04-23T01:48:13Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.