Sponges are filter feeders, so in that regard they help keep your water clean. As long as it's not an eyesore to you, I'd leave it be.
I have a number of similar black sponges in my tank, although none as large as yours. They all grow in the shaded undersides of rocks, so you have to try to see them.