These are a pain. Yes they’re sponges but they’re not like the “ok” sponges that grow in dark corners/sumps. These will grown around your zoa mat/soft corals and strangle them/kill off the mat. I always remove because they thrive in higher light.
That being said, they won’t hurt a hard coral that much unless they start growing over the skeleton and into the fleshy bits.