# Fluentd doesnt send log to elasticsearch

**URL:** <https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619>\
**Category:** Kibana\
**Created:** [July 5, 2023, 6:49am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619 "2023-07-05T06:49:22Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![gurban.suleyman](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@gurban.suleyman](https://discuss.elastic.co/u/gurban.suleyman)\
**Post date:** [July 5, 2023, 6:49am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/1 "2023-07-05T06:49:22Z")

</div>

Hi  
I have a problem it is about to send logs to elasticsearch. I had configure the conf file ind the server but in elastic i couldnt see any log even in the Discover menu

---

<div class="post-metadata">

**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\
**Post date:** [July 5, 2023, 8:43am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/2 "2023-07-05T08:43:33Z")

</div>

Hi @gurban.suleyman,

Welcome to the community! Are you using the [fluentd elasticsearch plugin](https://docs.fluentd.org/output/elasticsearch)? Can you share any errors you are seeing in the logs?

If you are using the fluentd elasticsearch plugin I would recommend seeing if [any of the tips in the troubleshooting guide](https://github.com/uken/fluent-plugin-elasticsearch/blob/master/README.Troubleshooting.md) help you identify the issue as well.

---

<div class="post-metadata">

**Author:** ![gurban.suleyman](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@gurban.suleyman](https://discuss.elastic.co/u/gurban.suleyman)\
**Post date:** [July 19, 2023, 7:53am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/3 "2023-07-19T07:53:09Z")

</div>

Hi @carly.richmond  
I fixed issue but i have a question i searching about a month but i dont reach any solution.  
Here is,  
our client sending logs to elasticsearch with type:kafka2 but now they also want to send logs with type:elasticsearch i configured elasticsearch it was working but in td-agent.conf when i add kafka configuration it doesnt work or vice versa.  
can you have any solution to how i configure multiple source or match type in td-agent? i want work both of them kafka and elasticsearch in td-agent.

---

<div class="post-metadata">

**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\
**Post date:** [July 19, 2023, 12:27pm UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/4 "2023-07-19T12:27:31Z")

</div>

Hi @gurban.suleyman,

It would be great to know what the solution to your issue was in case others encounter the same problem.

In terms of your new issue (I'm assuming you haven't posted a new topic for it) can you confirm what the inputs and outputs are? If I understand correctly you want to send logs from both Kafka and an Elasticsearch cluster to Elasticsearch? Or is it the other way around?

---

<div class="post-metadata">

**Author:** ![gurban.suleyman](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@gurban.suleyman](https://discuss.elastic.co/u/gurban.suleyman)\
**Post date:** [July 19, 2023, 12:45pm UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/5 "2023-07-19T12:45:36Z")

</div>

Kafka sends logs to kafdrop, and additionally logs must be sent to elasticsearch. So, is it possible to show 2 different sources and matches in the same td-agent.conf file?

---

<div class="post-metadata">

**Author:** ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)\
**Post date:** [July 19, 2023, 1:30pm UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/6 "2023-07-19T13:30:57Z")

</div>

Have you tried using the [`copy output`](https://docs.fluentd.org/output/copy)? There is an example in the docs for file and elasticsearch output that you could try to adapt?

---

<div class="post-metadata">

**Author:** ![gurban.suleyman](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@gurban.suleyman](https://discuss.elastic.co/u/gurban.suleyman)\
**Post date:** [July 20, 2023, 5:30am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/7 "2023-07-20T05:30:48Z")

</div>

Hi  
Here is example for we want to send both of logs which is i wrote in the td-agent.conf

@type tail path /path/path/example\* pos\_file /etc/td-agent/test.log.pos format none tag test

\<match \*\>  
@type kafka2  
brokers  
use\_event\_time true

@type file path /etc/td-agent/buffer flush\_interval 3s @type json
# topic settings

topic\_key example-log  
default\_topic example-log  
required\_acks -1  
compression\_codec gzip  
get\_kafka\_client\_log true  
@log\_level trace

@type tail path /another\_path/log/\* pos\_file /etc/td-agent/test.log.pos format none tag test

\<match \*\>  
@type elasticsearch  
user elastic  
password ""  
scheme http  
ssl\_verify false  
host "ip address"  
port "port"  
index\_name test  
logstash\_format true  
logstash\_prefix test  
include\_timestamp true

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 17, 2023, 5:30am UTC](https://discuss.elastic.co/t/fluentd-doesnt-send-log-to-elasticsearch/337619/8 "2023-08-17T05:30:50Z")

</div>

Closed on August 17, 2023, 5:30am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
