Unless you ingest a polyp, rub their juice into a cut, boil a LR so the palytoxin goes airborne.... you will be perfectly safe.
You reeeeeeeally have to work hard to get palytoxin poisoning by not respecting the juice on them, in them.
If you breath palytoxin or it enters your bloodstream, then yeah.... pause for high concern.
You brush up against one, get juice on your skin while fragging.... but wash up immediately and don't touch your eyes or mouth.... there is NO cause for concern to you or your family.
I work with palys/zoas all the time. I will hold a paly/zoa inbtwn my fingers while fragging.... BUT will immediately wash my hands. I dont touch my eyes or mouth and make sure my hands are cut-free