I would reverse that statement - and that´s I think is a problem for some people to take into their minds - it would indicate problems with our Hanna Checkers.
I could also return the first statement - as long as not Hanna testified that each Hanna Checker delivered (after tests with each of them) that the actual example is in the and has been calibrated before delivery we can´t rely on any result they give. We can also demand that every batch of the reagents should be tested and certified that it is up to the 95 % confidence interval. We should also demand a full list of ions that can interfere with the result. Further one - we need a certificate on each tester (every aquarist taken a sample) that just this person have done test with shows that his/her result is in 95 % range.
Another thing - Has Hanna released their 95 % confidence interval at all?
Sincerely Lasse
Hi Lasse! This debate is making me thirsty

it would be much more fun over a beer with loud music in the background.
First, there is a quality check for Hanna reagents. A certificate of analysis comes with each box. Second, the instruments reported 95% confidence interval is printed on the instructions. Third, for serious users like
@Rick Mathew and
@taricha , these numbers have been verified for their instrument. What is nice, anyone can determine how well their Checkers work. We know the instrument’s capabilities. This is not the case for ICP results.
First, their is no reported 95% confidence interval reported with ICP measurements. Second, there is no report in the ICP analysis about how the sample was prepared for analysis. Third, the ICP vendors do not report which emission lines they are using for each element or supply the spectrum.
I think the following statement of yours is highly suggestive of the variability in ICP measurements
“
I have in more than 100 cases seen both lower and higher reported P compared with the PO4-P you can calculate out from Hanna checker reading.”
Since the ICP measurement represents the total P content of the sample and the Hanna Checker represents a fraction of the total, the ICP result can never be less than fraction of the total. Without the ICP 95% confidence interval we will debate this until we are drunk but never resolve.
The low ICP readings seem to be real.
@Rick Mathew has taken steps to understand low P ICP results and he has turned the effect on and off. For his work to be scientific proof, he would need to spend a large amount of money, but his results so far are compelling enough to suggest that ICP results may not be as accurate as everyone thinks.
Over to you Lasse.
Unfortunately, in my time zone, it is bad form to have a beer right now, so, I am off to coffee and breakfast.
Dan