Installation and operating conditions are key criteria to define technical choice, select product technology and focus on a limited number of alternatives, but it is also important to consider that : 1.Benchmarking product performances is only possible in leveled playing field conditions, and 2. Third party performance certification enables fair comparison since testing conditions are the same.
Because site conditions vary and are impossible to duplicate they cannot deliver reliable and comparable results. The value of standard testing conditions is that they are being strictly defined to deliver comparable test conditions, and draw robust conclusions.
Installation conditions, unique to each project, must be used to decide on the technology, whilst only certified performance data can be considered when it comes to comparison. This is a 2-step process - each one adding a different value.
Does failing during tests really prevent from being certified?
When a test is not compliant the manufacturer is asked to modify the data, but not only: 1. He is also asked to recatalog the products of the same family, or even from the entire range, 2. a penalty test can be required, and, finally, 3. a suspension can be decided in case of repeated non-compliances.