# Ingest Real time logs to elasticsearch using Logstash

**URL:** <https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788>\
**Category:** Logstash\
**Tags:** elastic-stack-monitoring, elastic-stack-alerting\
**Created:** [August 1, 2023, 11:11am UTC](https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788 "2023-08-01T11:11:19Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![harshal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/harshal/32/124174_2.png) [@harshal](https://discuss.elastic.co/u/harshal)\
**Post date:** [August 1, 2023, 11:11am UTC](https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788/1 "2023-08-01T11:11:19Z")

</div>

I want to Ingest Realtime logs of Apps into Elasticsearch using Logstash and Create Report on Kibana, So Guide me

---

<div class="post-metadata">

**Author:** ![Rios](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rios/32/95745_2.png) [@Rios](https://discuss.elastic.co/u/Rios)\
**Post date:** [August 1, 2023, 1:43pm UTC](https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788/2 "2023-08-01T13:43:53Z")

</div>

Welcome to the community!

1. Which log types
2. Provide few log samples

---

<div class="post-metadata">

**Author:** ![harshal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/harshal/32/124174_2.png) [@harshal](https://discuss.elastic.co/u/harshal)\
**Post date:** [August 2, 2023, 1:17pm UTC](https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788/4 "2023-08-02T13:17:08Z")

</div>

I'm using this python code to generate logs =\>  
`import logging  
import sys  
import logstash

class Logging(object):  
def **init** (self, logger\_name='python-logger',  
log\_stash\_host='localhost',  
log\_stash\_upd\_port=5959

```
             ):
    self.logger_name = logger_name
    self.log_stash_host = log_stash_host
    self.log_stash_upd_port = log_stash_upd_port

def get(self):
    logging.basicConfig(
        filename="logfile",
        filemode="a",
        format="%(asctime)s,%(msecs)d %(name)s %(levelname)s %(message)s",
        datefmt="%H:%M:%S",
        level=logging.INFO,
    )

    self.stderrLogger = logging.StreamHandler()
    logging.getLogger().addHandler(self.stderrLogger)
    self.logger = logging.getLogger(self.logger_name)
    self.logger.addHandler(logstash.LogstashHandler(self.log_stash_host,
                                                    self.log_stash_upd_port,
                                                    version=1))
    return self.logger

```

instance = Logging(log\_stash\_upd\_port=5959, log\_stash\_host='localhost', logger\_name='Loki')  
logger = instance.get()

count = 0  
from time import sleep  
while True:

```
count = count + 1

if count % 2 == 0:
    logger.error('Error Message Code Faield :{} '.format(count))
else:
    logger.info('python-logstash: test logstash info message:{} '.format(count))
sleep(2)`

```

---

<div class="post-metadata">

**Author:** ![harshal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/harshal/32/124174_2.png) [@harshal](https://discuss.elastic.co/u/harshal)\
**Post date:** [August 2, 2023, 1:17pm UTC](https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788/5 "2023-08-02T13:17:55Z")

</div>

import logging  
import sys  
import logstash

class Logging(object):  
def **init** (self, logger\_name='python-logger',  
log\_stash\_host='localhost',  
log\_stash\_upd\_port=5959

```
             ):
    self.logger_name = logger_name
    self.log_stash_host = log_stash_host
    self.log_stash_upd_port = log_stash_upd_port

def get(self):
    logging.basicConfig(
        filename="logfile",
        filemode="a",
        format="%(asctime)s,%(msecs)d %(name)s %(levelname)s %(message)s",
        datefmt="%H:%M:%S",
        level=logging.INFO,
    )

    self.stderrLogger = logging.StreamHandler()
    logging.getLogger().addHandler(self.stderrLogger)
    self.logger = logging.getLogger(self.logger_name)
    self.logger.addHandler(logstash.LogstashHandler(self.log_stash_host,
                                                    self.log_stash_upd_port,
                                                    version=1))
    return self.logger

```

instance = Logging(log\_stash\_upd\_port=5959, log\_stash\_host='localhost', logger\_name='Loki')  
logger = instance.get()

count = 0  
from time import sleep  
while True:

```
count = count + 1

if count % 2 == 0:
    logger.error('Error Message Code Faield :{} '.format(count))
else:
    logger.info('python-logstash: test logstash info message:{} '.format(count))
sleep(2)

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 30, 2023, 1:18pm UTC](https://discuss.elastic.co/t/ingest-real-time-logs-to-elasticsearch-using-logstash/339788/6 "2023-08-30T13:18:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
