# Logstash send logs to monitoring cluster

**URL:** https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798
**Category:** Logstash
**Tags:** elastic-stack-monitoring
**Created:** [February 21, 2022, 5:43pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798 "2022-02-21T17:43:38Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![caseydm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/caseydm/32/26771_2.png) [@caseydm](https://discuss.elastic.co/u/caseydm)
#### Post date: [February 21, 2022, 5:43pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798/1 "2022-02-21T17:43:38Z")

</div>

Hi all. I'm using logstash to send data from redshift to Elasticsearch. I monitor my pipelines with metricbeats, and am able to see general statistics about logstash within my monitoring cluster. What I can't see is logs. Is there a simple way to send logs from logstash into Elasticsearch?

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [February 21, 2022, 7:34pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798/2 "2022-02-21T19:34:23Z")

</div>

You should use a Filebeat to read the logstash logs and send it to your monitoring cluster.

---

<div class="post-metadata">

### Author: ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)
#### Post date: [February 21, 2022, 10:21pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798/3 "2022-02-21T22:21:04Z")

</div>

Also see filebeat module enable logstash

---

<div class="post-metadata">

### Author: ![caseydm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/caseydm/32/26771_2.png) [@caseydm](https://discuss.elastic.co/u/caseydm)
#### Post date: [February 22, 2022, 2:09pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798/4 "2022-02-22T14:09:44Z")

</div>

Thank you! I tried it out but I'm not seeing any log data in Kibana. I'm using elastic cloud. I wonder what I am doing wrong? My metricbeats works properly, and I can see that filebeat has started successfully.

Here is my configuration:

## docker compose

```auto
version: "3"
services:
  logstash:
    image: docker.elastic.co/logstash/logstash:7.15.1
    environment:
      - NODE_NAME=concepts
      - XPACK_MONITORING_ENABLED=false
      - "LS_JAVA_OPTS=-Xmx3g -Xms3g"
    env_file:
      - .env
    volumes:
      - ./jars/:/usr/share/jars/
      - ./pipeline/:/usr/share/logstash/pipeline/
      - ./sql_last_value.yml:/usr/share/sql_last_value.yml
    command: logstash
  metricbeat:
    image: docker.elastic.co/beats/metricbeat:7.15.1
    depends_on:
      - logstash
    env_file:
      - .env
    volumes:
      - ./metricbeat.yml:/usr/share/metricbeat/metricbeat.yml

  filebeat:
    image: docker.elastic.co/beats/filebeat:7.15.1
    depends_on:
      - logstash
    env_file:
      - .env
    volumes:
      - ./filebeat.yml:/usr/share/filebeat/filebeat.yml

```

## filebeat.yml

```auto
filebeat.modules:
- module: logstash
  log:
    enabled: true

output:
  elasticsearch:
    hosts: ["${ES_HOST_MONITORING_PROD}"]
    username: "${ES_USER_MONITORING_PROD}"
    password: "${ES_PASSWORD_MONITORING_PROD}"

```

## metricbeat.yml

```auto
metricbeat.modules:
- module: logstash
  metricsets:
    - node
    - node_stats
  period: 10s
  hosts: ["logstash:9600"]
  xpack.enabled: true
  strict.perms: false

output:
  elasticsearch:
    hosts: ["${ES_HOST_MONITORING_PROD}"]
    username: "${ES_USER_MONITORING_PROD}"
    password: "${ES_PASSWORD_MONITORING_PROD}"

```

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [February 22, 2022, 2:19pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798/5 "2022-02-22T14:19:34Z")

</div>

Filebeat needs to have access to the Logstash logs, you are running filebeat on a different container, this won't work.

I do not use docker, so I can't help further, but you need to look on how to configure filebeat to read docker logs.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 22, 2022, 2:20pm UTC](https://discuss.elastic.co/t/logstash-send-logs-to-monitoring-cluster/297798/6 "2022-03-22T14:20:12Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
