# How to stream log data from the Kinesis stream to Elasticsearch?

**URL:** https://discuss.elastic.co/t/how-to-stream-log-data-from-the-kinesis-stream-to-elasticsearch/166134
**Category:** Logstash
**Created:** [January 29, 2019, 10:04am UTC](https://discuss.elastic.co/t/how-to-stream-log-data-from-the-kinesis-stream-to-elasticsearch/166134 "2019-01-29T10:04:33Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![dmakeroam](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmakeroam/32/40326_2.png) [@dmakeroam](https://discuss.elastic.co/u/dmakeroam)
#### Post date: [January 29, 2019, 10:04am UTC](https://discuss.elastic.co/t/how-to-stream-log-data-from-the-kinesis-stream-to-elasticsearch/166134/1 "2019-01-29T10:04:33Z")

</div>

How to stream log data from the Kinesis stream to Elasticsearch?

I have used [logstash kinesis input plugin](https://github.com/logstash-plugins/logstash-input-kinesis), but it doesn't seems to works.

This is my logstash configuration for the Kinesis stream.

```auto
input {
 kinesis {
    application_name => "test-kinesis"
    kinesis_stream_name => "test-kinesis"
    region => "ap-southeast-1"
    profile => "test-kinesis"
    initial_position_in_stream => "TRIM_HORIZON"
    codec => cloudwatch_logs
    id => "kinesis-rq-log-in"
 }
}

output {
 elasticsearch {
  hosts => ['test-kinesis-ip:9200', 'test-kinesis2-ip:9200']
  user => "root"
  password => "p@ssword"
  timeout => 60
  ssl => true
  cacert => '/etc/elasticsearch/x-pack/trusted-cert/ca.cert.pem'
  manage_template => false
  index => "kinesis-rq-%{[@metadata][localtime]}"
  document_type => "http"
  id => "kinesis-rq-log-out"
 }
}

```

I tried to follow the plugin document, but I still could not get the log data on Kibana with the index pattern "kinesis-rq\*".

Also, have tried to solve that following with "[https://github.com/logstash-plugins/logstash-input-kinesis/issues/20](https://github.com/logstash-plugins/logstash-input-kinesis/issues/20)", but not found the useful solution.

Does anyone have any idea?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 26, 2019, 10:04am UTC](https://discuss.elastic.co/t/how-to-stream-log-data-from-the-kinesis-stream-to-elasticsearch/166134/2 "2019-02-26T10:04:35Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
