you should not stop focusing on it, your conscience is warning you in ways that can save your tank from fragmenting loss.
*make your tank algae in control, then you can stop focusing on it. The number one thing all algae invasion/help threads have in common is 0% of them show up with an algae free tank, that they've been manually keeping 100% algae free, and are tired of servicing.
no, they present a full on forest. Agreed you might have patches that stay in control on their own, but since you aren't sure, you shouldnt abandon your conscience. get algae free, then if some grows back you can let it ride by having algae-free practices in your back pocket.
You stop focusing on algae only when you are so adept at controlling it, that it has no chance. when you can control its spread 100% or make it gone at will, then allowing some and ignoring it will be easy as pie