As others have pointed out, not all zoas grow super fast and most of them don't contain significant levels of palytoxin. The ones you really need to worry about are specific species of palythoa (hence the name palytoxin). Typically the really bad ones are the ugly ones nobody wants anyways (i.e. texas trash palys). Even then, the danger is somewhat overblown as you'd have to do something quite careless to actually expose yourself to the toxin, such as boiling a rock with palys on it, ripping palys out of your tank barehanded, etc. Now that's not to say you shouldn't be cautious with them. I always use PPE when handling any kind of zoanthid, even ones I suspect may not have much, if any, palytoxin.
I actually just removed a huge chunk of a texas trash paly colony from my tank last night. These guys most certainly have significant concentrations of palytoxin in them. So I wore arm-length rubber gloves, goggles and a face mask to handle them. I pulled the entire rock out of my tank to work with it in a separate 5 gallon bucket of saltwater. I then scraped/broke them off of the rock with bone cutters. Once they were removed from the rock, I replaced the rock in the tank and did a water change just to be on the safe side. All of my livestock including fish and other corals were unaffected and I was happy to have most of these ugly buggers out of the tank. I have another small patch to remove and will likely take care of them this weekend.
Long story short, while palytoxin should absolutely be respected, it shouldn't be of concern as long as you take the proper precautions. I certainly wouldn't deprive myself of the beauty and general ease of keeping zoanthids due to palytoxin concerns.
