Is this sponge should I be worried

[cooltowncorals]

Hey I have this sponge appearing stuff growing in my sump...no biggie. But now I am seeing it in my zoas in my display and then also close to some blue suposium. Is this sponge should I be worried?

 

[reef lover]

I would carefully pluck it from the zoos and up my flow a little.