# Transfer and indexing data on JSON

**URL:** <https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832>\
**Category:** Beats\
**Tags:** beats-development\
**Created:** [July 5, 2021, 12:34pm UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832 "2021-07-05T12:34:23Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Wonder\_Garance](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wonder_garance/32/91180_2.png) [@Wonder\_Garance](https://discuss.elastic.co/u/Wonder_Garance)\
**Post date:** [July 5, 2021, 12:34pm UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832/1 "2021-07-05T12:34:23Z")

</div>

Hello, we have a data server which contains XML and / or JSON data, we want to transform these data on JSON, transfer and indexing them on Elasticsearch. After a quick search, it's possible to use Filebeat.

I think Filebeat is for transfer logs into Elastic or Logstash, does it work for data to indexing? Are there some modules for managing indexing process? To havest and transform data on JSON, transfer from source servers to Elastic servers, do indexing and reindexing, etc. Is ILM (index lifecycle management) a good choice?

---

<div class="post-metadata">

**Author:** ![legoguy1000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/legoguy1000/32/54301_2.png) [@legoguy1000](https://discuss.elastic.co/u/legoguy1000)\
**Post date:** [July 6, 2021, 3:37am UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832/2 "2021-07-06T03:37:08Z")

</div>

Yes, filebeat can read any text file and you can add whatever processors to filebeat or elasticsearch ingest processors to transform it however u want.

---

<div class="post-metadata">

**Author:** ![Wonder\_Garance](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wonder_garance/32/91180_2.png) [@Wonder\_Garance](https://discuss.elastic.co/u/Wonder_Garance)\
**Post date:** [July 6, 2021, 4:34pm UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832/3 "2021-07-06T16:34:22Z")

</div>

Thank you, I will test it.

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [July 6, 2021, 5:51pm UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832/4 "2021-07-06T17:51:11Z")

</div>

Hi @Wonder_Garance just to add a but more

There is a new XML processor in filebeat you can read about it [here](https://www.elastic.co/guide/en/beats/filebeat/current/decode-xml.html)

This is a brand new feature so keep that in mind...

There is also a very mature / powerful XML filter / parser in Logstash [here](https://www.elastic.co/guide/en/logstash/current/plugins-filters-xml.html) but that requires using Logstash with an architecture like this :

Soiurce -\> Filebeat -\> Logstash -\> Elasticsearch

There is no Elasticsearch ingest processor to parse XML today

---

<div class="post-metadata">

**Author:** ![Wonder\_Garance](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wonder_garance/32/91180_2.png) [@Wonder\_Garance](https://discuss.elastic.co/u/Wonder_Garance)\
**Post date:** [July 19, 2021, 5:53pm UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832/5 "2021-07-19T17:53:02Z")

</div>

@stephenb Thanks a lot, it's the thing I'm looking for.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 16, 2021, 7:53pm UTC](https://discuss.elastic.co/t/transfer-and-indexing-data-on-json/277832/6 "2021-08-16T19:53:05Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.