# Webhdfs output writes not all fields

**URL:** https://discuss.elastic.co/t/webhdfs-output-writes-not-all-fields/281919
**Category:** Logstash
**Created:** [August 19, 2021, 7:49am UTC](https://discuss.elastic.co/t/webhdfs-output-writes-not-all-fields/281919 "2021-08-19T07:49:38Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![ThreatInter](https://avatars.discourse-cdn.com/v4/letter/t/49beb7/32.png) [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)
#### Post date: [August 19, 2021, 7:49am UTC](https://discuss.elastic.co/t/webhdfs-output-writes-not-all-fields/281919/1 "2021-08-19T07:49:38Z")

</div>

Hi, community, I'm using webhdfs to write my logstash events to hdfs. But in hdfs I see only part of initial messages.  
In logstash:

```auto
{"@timestamp":"2021-08-19T07:45:33.373Z","eventtype":"166","program":"Hostd","@version":"1","logsource":"esxi","message":"<166>2021-08-19T07:45:33.373Z esxi Hostd: info hostd[4028326] [Originator@6876 sub=Default] IPMI SEL sync took 0 seconds 0 sel records, last 255\n","timestamp":"2021-08-19T07:45:33.373Z","esxi_message":"info hostd[4028326] [Originator@6876 sub=Default] IPMI SEL sync took 0 seconds 0 sel records, last 255\n"}

```

In hdfs I see only this:

```auto
2021-08-19T07:45:33.373Z %{host} <166>2021-08-19T07:45:33.373Z esxi Hostd: info hostd[4028326] [Originator@6876 sub=Default] IPMI SEL sync took 0 seconds 0 sel records, last 255

```

How to make logstash write all my json message to hdfs?

---

<div class="post-metadata">

### Author: ![ThreatInter](https://avatars.discourse-cdn.com/v4/letter/t/49beb7/32.png) [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)
#### Post date: [August 19, 2021, 7:54am UTC](https://discuss.elastic.co/t/webhdfs-output-writes-not-all-fields/281919/2 "2021-08-19T07:54:50Z")

</div>

using codec=\>"json" in output

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 16, 2021, 7:55am UTC](https://discuss.elastic.co/t/webhdfs-output-writes-not-all-fields/281919/3 "2021-09-16T07:55:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
