Probably not. Those palys can be rather stubborn once they find a foothold.
For information regarding the toxicity of Zoas/palys, do a quick Google search for Zoanthid poisoning.
As long as you are carefull, you'll be fine, but wanted to give a warning as there have been some rather tragic accidents with Zoas and palys