# (Problem) ELK + Amazon S3 + Apache Access Logs

**URL:** <https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085>\
**Category:** Logstash\
**Created:** [May 26, 2016, 5:52pm UTC](https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085 "2016-05-26T17:52:11Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![jnunez](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jnunez/32/9970_2.png) [@jnunez](https://discuss.elastic.co/u/jnunez)\
**Post date:** [May 26, 2016, 5:52pm UTC](https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085/1 "2016-05-26T17:52:11Z")

</div>

Hi friends, I'm implementing an ELK with apache access logs stores on Amazon S3, but I have a problem when I try to view the graph on Kibana, the dates in the graph doesn't coincide with the dates in logs files. Here a screenshot:

 ![](https://us1.discourse-cdn.com/elastic/original/2X/7/7603a652e0ac70ca2323fae7ea71d21e2ff3a9b1.png)

I used these documentation:  
[How To Install Elasticsearch, Logstash, and Kibana (ELK Stack) on Ubuntu 14.04 - Digital Ocean](https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elk-stack-on-ubuntu-14-04)

[Logstash Configuration examples](https://www.elastic.co/guide/en/logstash/current/config-examples.html)

And this discussion:  
[Error with S3 input](http://serverfault.com/questions/711104/getting-cloudfront-logs-into-logstash-error-is-not-a-legal-argument-to-this-wr)

This is my logstash configuration file:

```
input {
  s3 {
    bucket => "my-bucket-name"
    delete => false
    interval => 60 # seconds
    prefix => "access/"
    region => "us-east-1"
    type => "apache_access"
    codec => plain {
                    charset => "ISO-8859-1"
            }
    secret_access_key => "my-secret-access-key"
    access_key_id => "my-secret-access-id"
    sincedb_path => "/mnt/apache/log_sincedb"
    backup_to_dir => "/mnt/apache/backup"
    use_ssl => true
    temporary_directory=>"/mnt/tmp/logstash"
  }
}

filter {
  if [path] =~ "access" {
    mutate { replace => { "type" => "apache_access" } }
    grok {
      match => { "message" => "%{COMBINEDAPACHELOG}" }
    }
  }
  date {
    match => ["timestamp" , "dd/MMM/yyyy:HH:mm:ss Z"]
  }
}

output {
  elasticsearch {
    hosts => ["localhost:9200"]
  }
  stdout { codec => rubydebug }
}

```

I don't know if I have an error with the index pattern on Kibana or if I have an error in mi Logstash configuration file. I would be very grateful if you help me.

(Sorry for my bad english).

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 27, 2016, 12:06am UTC](https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085/2 "2016-05-27T00:06:50Z")

</div>

You aren't grokking the events and extracting that timestamp to run via the date filter, so start there.

---

<div class="post-metadata">

**Author:** ![jnunez](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jnunez/32/9970_2.png) [@jnunez](https://discuss.elastic.co/u/jnunez)\
**Post date:** [May 27, 2016, 2:50pm UTC](https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085/3 "2016-05-27T14:50:25Z")

</div>

Thank's warkom, How I do it?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 28, 2016, 12:53am UTC](https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085/4 "2016-05-28T00:53:10Z")

</div>

You may want to look at [https://www.elastic.co/guide/en/logstash/current/getting-started-with-logstash.html](https://www.elastic.co/guide/en/logstash/current/getting-started-with-logstash.html)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:55am UTC](https://discuss.elastic.co/t/problem-elk-amazon-s3-apache-access-logs/51085/5 "2017-07-06T04:55:48Z")

</div>