Bristleworms will not attack or eat healthy coral or animals. The pic of the bristleworm near the favia shows that it's near the favia, nothing more. It's scavenging for food. Turn your flow off and drop food in and watch all of the bristleworms come out after the food, you'll be surprised with how many you actually have in your tank. Also, your leather may be budding (creating a fresh frag for you)? They will drop off a piece, usually from the edges of the coral, which may seem like a tear (called fission). Traditional budding looks like a mini leather growing from the parent, then it will drop off.
Back to the worms, bristleworms are safe and their numbers coincide with the amount of food available to them. I have a ton of bristleworms in my tank and at night I see them crawling near and next to my sleeping fish. In fact, I see big bristleworms appear from the same burrow my sharknose goby sleeps in and yet, my goby appears every day, ready to go and clean his tank-mates.
Don't fear bristleworms, they are an essential part of a healthy living reef.