Phosphate binding to any media is always an on/off equilibrium.
At any fixed phosphate concentration in the water, some will bind to exposed calcium carbonate, aluminum oxide, GFO, and other surfaces.
If you try to double the amount in the water, you will find that more binds to the surfaces, and the concentration will not quite double.
If you try to halve the amount in the water (say, 50% water change), you will find that some comes off of surfaces, and the concentration will be more than half water it was before.
So if you load up GFO at, say, 1 ppm phosphate, then try to lower the concentration to 0.03 ppm, much will come off the GFO.