# Unable to insert log data using filebeat

**URL:** <https://discuss.elastic.co/t/unable-to-insert-log-data-using-filebeat/215458>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [January 17, 2020, 12:40pm UTC](https://discuss.elastic.co/t/unable-to-insert-log-data-using-filebeat/215458 "2020-01-17T12:40:43Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![NileshG](https://avatars.discourse-cdn.com/v4/letter/n/6f9a4e/32.png) [@NileshG](https://discuss.elastic.co/u/NileshG)\
**Post date:** [January 17, 2020, 12:40pm UTC](https://discuss.elastic.co/t/unable-to-insert-log-data-using-filebeat/215458/1 "2020-01-17T12:40:43Z")

</div>

Hi,  
I am trying to insert log data using filebeat in an ElascticSearch.  
The index is created but the data differ than the actual one.

**My Log is**

| 2020-01-17T17:13:43.218+0530 | INFO | crawler/crawler.go:106 | Loading and starting Inputs completed. Enabled inputs: 1 |
| --- | --- | --- | --- |
| 2020-01-17T17:13:43.218+0530 | INFO | cfgfile/reload.go:171 | Config reloader started |
| 2020-01-17T17:13:43.218+0530 | INFO | cfgfile/reload.go:226 | Loading of config files completed. |
| 2020-01-17T17:13:43.229+0530 | INFO | log/harvester.go:251 | Harvester started for file: C:\Users\Nilesh.Gunjkar\Desktop\ElasticSearch\LogsData\Book3.xlsx |
| 2020-01-17T17:13:46.182+0530 | INFO | add\_cloud\_metadata/add\_cloud\_metadata.go:89 | add\_cloud\_metadata: hosting provider type not detected. |

**My Config File is**  
###################### Filebeat Configuration Example #########################

# This file is an example configuration file highlighting only the most common

# options. The filebeat.reference.yml file from the same directory contains all the

# supported options with more comments. You can use it as a reference.

# 

# You can find the full configuration reference here:

# [https://www.elastic.co/guide/en/beats/filebeat/index.html](https://www.elastic.co/guide/en/beats/filebeat/index.html)

# For more available modules and options, please see the filebeat.reference.yml sample

# configuration file.

#=========================== Filebeat inputs =============================

filebeat.inputs:

# Each - is an input. Most options can be set at the input level, so

# you can use different inputs for various configurations.

# Below are the input specific configurations.

- type: log

#================================ Outputs =====================================

# Configure what output to use when sending the data collected by the beat.

#-------------------------- Elasticsearch output ------------------------------  
output.elasticsearch:

# Array of hosts to connect to.

hosts: ["[elk.dev.echdev1.com](http://elk.dev.echdev1.com)"]

# Optional protocol and basic auth credentials.

#protocol: "http"  
#username: ""  
#password: ""

---

<div class="post-metadata">

**Author:** ![shaunak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shaunak/32/6643_2.png) [@shaunak](https://discuss.elastic.co/u/shaunak)\
**Post date:** [January 17, 2020, 7:28pm UTC](https://discuss.elastic.co/t/unable-to-insert-log-data-using-filebeat/215458/2 "2020-01-17T19:28:47Z")

</div>

Hi @NileshG, welcome to the Elastic community forums!

> [@NileshG](#):
>
> The index is created but the data differ than the actual one.

Would you mind telling us what data you're seeing in the index and what you expect to see? Perhaps you could post a sample document in the index and the corresponding expected data?

Also, what version of Filebeat and Elasticsearch are you running?

Thanks,

Shaunak

---

<div class="post-metadata">

**Author:** ![NileshG](https://avatars.discourse-cdn.com/v4/letter/n/6f9a4e/32.png) [@NileshG](https://discuss.elastic.co/u/NileshG)\
**Post date:** [January 20, 2020, 10:16am UTC](https://discuss.elastic.co/t/unable-to-insert-log-data-using-filebeat/215458/3 "2020-01-20T10:16:00Z")

</div>

Hi @Shaunak,

Thank you for your assistance.

I am using Filebeat version 7.5.1 and Elasticsearch version 6.8.3.

The below screenshot contains the data which I am trying to insert.

Please check the following screenshot to see the actual data:

 ![screen2](https://us1.discourse-cdn.com/elastic/original/3X/6/9/69ae9d529e7713a3cb864b57dcd75cb953f95eee.jpeg)

Following screenshot shows the data which we got in Elasticsearch:

 ![screen1](https://us1.discourse-cdn.com/elastic/original/3X/d/2/d258e0ee302c995ea4e4bef16c38a7fdcf9effef.jpeg)

Some additional parameters are automatically inserted with the data (highlighted in a yellow color box)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 17, 2020, 10:16am UTC](https://discuss.elastic.co/t/unable-to-insert-log-data-using-filebeat/215458/4 "2020-02-17T10:16:03Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
