What are you using to test you phosphate? Those numbers are all within the margin of error for some checkers. Do you have a Hannah Ultra Low? If not, I recommend getting one since they are more precise. If you have an Ultra-Low checker, then cool. If not, I would not do anything until you do. Chasing can do more damage than leaving it alone. Eventually, the rock/sand will aborb what it is going to and then act as a buffer and it will keep you pretty stable.
.1 is still 10-20x more than seawater and is not growth-limiting to any algae or dinos (zoox). It is not really high for an aquarium, but as you are saying, you can have algae. What you likely need is consumers for the algae. How much algae do you have in your 70 gallon tank? Photo might help. I usually recommend Pincushion Urhins from the Florida Keys... they are hardy for me, reef safe and devour any type of algae from bubble to hair to film to coralline. People hate them because they eat coralline, but they will eat the soft stuff first and if you are good at this, you will soon have more coralline than you can stand (you have likely seen how much people hate the stuff after a while). If you give some more details, I can recommend a number to get - usually quite a few and then you give some of them away when you are done with them and make good friends in the local market.
I recommend that you read/study on aragonite binding of phosphate. It is a really important piece of chemistry that most do not understand. When you added phosphate, all that you likely did was just have your aragonite absorb it.
If you do decide that you want to lower the level, then I recommend chaeto since it cannot get your tank too low like GFO can. It takes some time and patience, but works wonderfully if you let it.