I don't know much about anemones, but I think it would depend, at least in part, on what kind you got. I don't think I'd worry about the pistol shrimp, how often does it even venture out of it's hiding spot. I hear mine from time to time, but I'm not sure I've ever seen it.
The cleaner, on the other hand, is the one I'd worry about. My cleaner is probably the most social thing in my tank. It's the one I'd worry about running up to the anemone saying 'Hi!!! let's be friends. Can I be your friend? What's your favorite color? Do you like me? Let's hang out. Please! Please! Please....okay, you think about it, I'll be back" "I'm back, let's be friends".
Honestly, I'm always surprised none of the fish (I'm looking at you, Royal Gramma) have yet to snap at it.