Another way to put this is, they're doing a test without all the variables
How so?
Their tests still have variables, just different variables. is tank size a variable? how about glass cleanness? how about the type of glass used in the test tank? how about water clarity? flow? all those are variables in an in-tank test is it not?
In tank testing will have its own variables, just like open-air testing will... still have variables, just different variables.
BRS methods are fine, but just be aware that they too have their own variables. All the testers have different methods so their results can't always be compared, or shouldn't be compared. All the various methods of testing are great for us reefers... they all help us make better decisions in the end. I wouldn't say one way is the right way or the wrong way, but they are all different and all valuable.
I don't dislike BRS's testing, but it is what it is... testing designed around selling stuff. They make everything seem better than it is. They sell a lot of stuff, so it seems to work for them. haha.
For instance, they used to just measure PAR and wattage based on running a light at 100% all channels.
Well how many people run their lights with all channels at 100%? not many. Other testers like Telegraham and others have since started testing PAR output and wattage with the light set to run the proper coral growing SPECTRUM.... which is how most of us run our lights... Now they give PAR and wattage data while the light is putting out the proper SPECTRUM, which is a good way to compare lights used to grow corals and will give results closer to real world than just giving data of a light set to 100% which few people run.... PAR and wattage, AT SPECTRUM will paint a different picture than one done at all channels 100%. Both ways are fine as long as you know the difference.
BRS light tests are great, but so are Dana's and Jim's. They are all valuable, but different, and its important to know how they are different because they can all help make the picture a little more clear. If only BRS was testing lights, we wouldn't have the complete picture, the same goes for Dana or Jim or anybody else testing reefing equipment for us. The more people we have testing stuff using different methods, is better for us in the end. More data is better than less data.