Doing a double split on json files


(Alex) #1

So I have a nested list of object represented in a json format, where each json object contains a list I also want to split. When I had my codec as "json" in my file input, it would automatically split the json object and in my filter I would just split it by the second field. The only problem is that there are NaN/Infinity values that I want to gsub and replace with quoted NaNs and Infinity because JSON doesn't support parsing those. So I can't have json codec in my file input so I just apply the json codec inside the filter. The only problem is that once I do that I have to do a double split in my filter, but I noticed that this is REALLY slow compared to what I had before. Any ideas to help me?


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.