Palys, zoas, and other things (surprisingly, it can be a bit complicated what does and doesn't fit this category) may all contain palytoxin, but as long as your not ingesting it/something that contains it, getting it in cuts (or your eyes), or (most commonly) aerosolizing it, it shouldn't hurt you at all.
If you want some in depth reading (that I think covers most of the topic) on palytoxin, see my posts in the threads below (some of threads have multiple posts from me):
My family is worried about me getting zoas because there toxic, can the toxins actually kill you?
www.reef2reef.com
So a little background info to start…we set up a 55 gallon tank with the intent of having a fish only tank. At the end of November we purchased 2 small ($10.00) coral frags. Unfortunately we did not do research and blindly purchased what turned out to be a Zoa and a Paly I believe. Fast...
www.reef2reef.com
To some ot up had a patch of gha on a huge zoa rock in tank was using forceps to pull it off while in the tank. Think i may have disturbed them a bit but not much and yes these are the big uglys ones that everyone says have it. Well wasnt wearing gloves and did it at probably 1 am monday...
www.reef2reef.com