Some do, on the pic I can see a valve similar to a sea squirt, maybe not. to me it just looks like one that is on the way out.
I admit the shape looks rather sea squirt like. But I didn't see evidence for a valve on the top - just that one on the side - which made me think it was more likely to be just a tunicate-shaped sponge.
