# Writing And Reading Compressed Data to/from Kinesis Stream

**URL:** <https://discuss.elastic.co/t/writing-and-reading-compressed-data-to-from-kinesis-stream/57560>\
**Category:** Logstash\
**Created:** [August 9, 2016, 7:44am UTC](https://discuss.elastic.co/t/writing-and-reading-compressed-data-to-from-kinesis-stream/57560 "2016-08-09T07:44:42Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Saman](https://avatars.discourse-cdn.com/v4/letter/s/3da27b/32.png) [@Saman](https://discuss.elastic.co/u/Saman)\
**Post date:** [August 9, 2016, 7:44am UTC](https://discuss.elastic.co/t/writing-and-reading-compressed-data-to-from-kinesis-stream/57560/1 "2016-08-09T07:44:42Z")

</div>

I am using EC2 Instance(Linux) and Logstash v2.3.4 . Logstash does not support directly writing compressed data to kinesis stream.One of the updates to input configuration that I have made is to read input data from S3 and store compressed data to local folder (EC2 Instance). Another input configuration is related to reading compressed data from local folder (EC2 Instance) and write data to kinesis stream.I am facing issue in which I am unable to read compressed data from kinesis stream. Kinesis dashboard display traffic information but when I am trying to read data from kinesis it returns null. I am using following python script for reading data from kinesis stream:

> > > from boto import kinesis  
> > > import time
> > > 
> > > kinesis = kinesis.connect\_to\_region("region in which my kinesis stream exist")  
> > > shard\_id = 'shardId-000000000000' #My stream have only one shard!  
> > > shard\_it = kinesis.get\_shard\_iterator("myKinesisStreamName", shard\_id, "LATEST")["ShardIterator"]  
> > > while 1==1:  
> > > ... out = kinesis.get\_records(shard\_it, limit=2)  
> > > ... shard\_it = out["NextShardIterator"]  
> > > ... print out;  
> > > ... time.sleep(0.2)  
> > > ...

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:44am UTC](https://discuss.elastic.co/t/writing-and-reading-compressed-data-to-from-kinesis-stream/57560/2 "2017-07-06T04:44:14Z")

</div>