Both usually aren't easy to get at (either buried in the sand or buried in the rocks). I've got a few serpent ones right now and everything generally leaves them alone (no puffer at present, but the one I had left them alone).
I imagine the puffer would want something "crunchier" though, no?