Depends on a lot of variables such nutrients, flow, light intensity (sponges grow best under lower lighting), I've heard even silica content is necessary for prolonged sponge growth. That said if you are worried about it you can just grab it and throw it away. Your call, they can be somewhat useful as filter feeders lowering dissolved organic material from the water column but they can also become nuisances over growing sessile invertebrates (corals).