So you have a couple of options here. Eventually, somehow some way you will reintroduce bristleworms back into your DT. Either by a coral or rock, or nem. They attach eggs to everything and are nearly impossible to see. I have a bicolor hogfish that loves to eat them and has put a significant dent in the population in my tank. Another very good option is an arrow crab, these are worm destroyers. Once they are inside and they will quickly colonize your rock work, the only option is to submerge the rock in hypo, or hyper salinity water. This would obviously kill any coral or nem you have on the rock if it is not removed.
Removing an attached anemone is not an easy feat. I understand your fear and dislike of the worms, but you are highly likely to damage the foot of the nem which is almost always a death sentence for it.