I found the issue with the toadstool this week. I saw a small vermetid snail on the frag. Not only did I glue it's head, I also superglued a layer around the whole frag so any babies that I cant see will die off. Hopefully there was no other vermetids anywhere in the tank. I'm pretty sure the vermetid came with this frag (was my first frag and I didnt know what to look for)
Every since then, the toadstool has been extra happy!