Is it possible to configure different tracking_column for different jdbc queries in single logstash conf file

I think the problem is that both jdbc inputs are saving their state into the same file. Make sure you set the last_run_metadata_path option to unique values for each input.