# Logstash plugin for reference data

**URL:** <https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808>\
**Category:** Logstash\
**Created:** [April 12, 2018, 12:02pm UTC](https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808 "2018-04-12T12:02:09Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![arunvijayam](https://avatars.discourse-cdn.com/v4/letter/a/ba9def/32.png) [@arunvijayam](https://discuss.elastic.co/u/arunvijayam)\
**Post date:** [April 12, 2018, 12:02pm UTC](https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808/1 "2018-04-12T12:02:09Z")

</div>

Hi All,

I am reading 4 CSV files in csv input plugins with different type attribute with different headers. Is there any option/provision to merge multiple CSV files columns into single row of records in logstash.

Or

Is there any option/provision to refer another CSV content while doing ETL of main CSV file. For example, I am doing ETL for financial transactions to mongodb throw logstash from CSV input plugin. Then can I refer the reference data like USD value against Indian rupee on logstash filter plugin for money conversion. Can anybody help on this issue.

Thanks in Advance!

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [April 12, 2018, 12:20pm UTC](https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808/2 "2018-04-12T12:20:04Z")

</div>

Have a look at the translate plugin.

---

<div class="post-metadata">

**Author:** ![arunvijayam](https://avatars.discourse-cdn.com/v4/letter/a/ba9def/32.png) [@arunvijayam](https://discuss.elastic.co/u/arunvijayam)\
**Post date:** [April 13, 2018, 3:30am UTC](https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808/3 "2018-04-13T03:30:30Z")

</div>

Hi Magnusbaeuk,

Thanks for your idea,

Here is my problem my input code is as below

```
input {
file {
               type => "input1"
		path => ["C:\Official\Marsh\demo_csv_header.csv"]
		start_position => "beginning"
	}
file {
               type => "input2"
		path => ["C:\Official\Marsh\demo_csv_header.csv"]
		start_position => "beginning"
	}
}

```

Now my question is

1. how to refer input1 events in input2 events in filter
2. how to merge input1 events and input2 events in filter plugin and output plugin also.

Thanks in Advance!

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [April 13, 2018, 6:12am UTC](https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808/4 "2018-04-13T06:12:43Z")

</div>

Logstash doesn't support merging of events from different inputs (out of the box anyway, but a specialized plugin could help). As I said, have a look at the translate plugin.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 11, 2018, 6:12am UTC](https://discuss.elastic.co/t/logstash-plugin-for-reference-data/127808/5 "2018-05-11T06:12:46Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.