IMO you might be working too hard... (or having too much fun) In the beginning they might be prominent, but over time they have always gone away for me. I think it has something to do with the amount of food in the water column. Limit this and you'll limit that.
I just have a few... I have had them for years and years. I do have really clean water which is probably why they stay small and do not take over. They are not a huge deal. They are quite hard to get to underneath the acro colonies anymore when I do want to cut one off.