A few decades of posts and research from Dr Holmes-Farley and Dr. Ron. You might have to go to RC to read most of them, but the supposition always was that fish/macro fauna gets to it first, then micro and then bacteria and single cell stuff. In the end, there is nothing left to scavenge, or else it would have been scavenged and that what accumulates is benign. Dr. Holmes-Farley used to post that he had more than an inch of detritus built up in his sump and had no inclination to get it out. Somebody tested some and there was no carbon or nitrogen left in it. Phosphorous is nearly all excreted in urine either through a bladder, skin, gills, eyes, etc. Why would bacteria leave anything behind for the next guy?
I do not agree with Dr. Ron to just leave it alone. I want to get it out. I do think that after a while that even a benign substance in the sand and sump can gum up the works and keep the microfauna, bacteria and single cell organisms from being able to do their jobs. This is why I vacuum out my sump a few times a year and I also vacuum my sand about every 4 years (slowly in small chunks with months inbetween). This vacuum does mix up the oxic and anoxic regions and does cause some die off and a need for these areas to reestablish, so that is why I do it slow.