# Different JSON structure in each line of data

**URL:** <https://discuss.elastic.co/t/different-json-structure-in-each-line-of-data/61951>\
**Category:** Elastic Community and Ecosystem\
**Created:** [September 30, 2016, 5:37pm UTC](https://discuss.elastic.co/t/different-json-structure-in-each-line-of-data/61951 "2016-09-30T17:37:06Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ilhans](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@ilhans](https://discuss.elastic.co/u/ilhans)\
**Post date:** [September 30, 2016, 5:37pm UTC](https://discuss.elastic.co/t/different-json-structure-in-each-line-of-data/61951/1 "2016-09-30T17:37:06Z")

</div>

I am very new to Elastic and thinking about using it in a project.  
Think about text files that contain millions of JSON lines each have different structure, nearly one thousand:  
Sample Text file:  
Line1 JSON\_structure1  
Lİne2 JSON\_structure2  
Line3 JSON\_structure3  
..  
Line99999..9 JSON\_structure999

I am thinking about pushing all of these lines to Kafka from source system and then use Logstash-Elastic Hadoop and store parsed data in HDFS. What is the best way of doing this ? Does logstash support these kind of parsing operation ?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:43pm UTC](https://discuss.elastic.co/t/different-json-structure-in-each-line-of-data/61951/2 "2017-07-06T13:43:32Z")

</div>


