# Convert all the fields to integer in csv filter

**URL:** <https://discuss.elastic.co/t/convert-all-the-fields-to-integer-in-csv-filter/244949>\
**Category:** Logstash\
**Created:** [August 13, 2020, 9:16pm UTC](https://discuss.elastic.co/t/convert-all-the-fields-to-integer-in-csv-filter/244949 "2020-08-13T21:16:08Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![saipadu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/saipadu/32/73855_2.png) [@saipadu](https://discuss.elastic.co/u/saipadu)\
**Post date:** [August 13, 2020, 9:16pm UTC](https://discuss.elastic.co/t/convert-all-the-fields-to-integer-in-csv-filter/244949/1 "2020-08-13T21:16:09Z")

</div>

Hi,  
I'm parsing the csv output of a command to logstash which has a dynamic number of columns. All the column values are interger except one which is a time field. By default logstash takes them all as strings. How can I convert all the dynamic columns to integer?  
Below is my filter

```auto
filter {
  split {}

  csv {
    autodetect_column_names => true
  }

  date {
    match => ["TIME", "yyyy-MM-dd HH:mm:ss"]
  }

  mutate {
    remove_field => ["host"]
  }
}

```

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [August 13, 2020, 9:57pm UTC](https://discuss.elastic.co/t/convert-all-the-fields-to-integer-in-csv-filter/244949/2 "2020-08-13T21:57:20Z")

</div>

Change your csv filter to

```auto
  csv {
    autodetect_column_names => true
    target => "[@metadata][csvData]"
  }

```

Then use a ruby filter. Something like

```
ruby {
    code => '
        event.get("[@metadata][csvData]").each { |k, v|
            unless ["TIME"].include? k
                event.set(k, v.to_i)
            else
                event.set(k, v)
            end
        }
    '
}

```

I use an array inclusion test in case you discover there are other fields you do not want to convert.

---

<div class="post-metadata">

**Author:** ![saipadu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/saipadu/32/73855_2.png) [@saipadu](https://discuss.elastic.co/u/saipadu)\
**Post date:** [August 14, 2020, 7:02am UTC](https://discuss.elastic.co/t/convert-all-the-fields-to-integer-in-csv-filter/244949/3 "2020-08-14T07:02:01Z")

</div>

Thanks, it worked 👍

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 11, 2020, 7:02am UTC](https://discuss.elastic.co/t/convert-all-the-fields-to-integer-in-csv-filter/244949/4 "2020-09-11T07:02:06Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.