As part of my work has to compare two logstash pipelines. One pipeline in UAT and other one at PROD cluster. There is no sync of logstash pipelines between clusters. In the same there were near 15 to 20 logstash which need to compare and highlight differences.
So now I am copying pipeline code to notepad++ from UAT and PROD and using compare option.
Do we have any other way or automation here ? To work fast...
This is called tech debt, there is often no easy way out. Even if you feed lots of data thru the pipelines and get identical results, you still need to look for exception conditions that may be missed in your data. Make sure the pipelines are loaded in both environments, no use checking dead code.
I used git to manage source and ansible to ensure the configuration states.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.