I think they are keyhole limpets. They were out spawning through the middle hole. Rock is KP live rock from Florida so my guess is that's where they came from.
I believe you may be correct. If you don't have any SPS they may be fine. Otherwise it indicates they could be a problem depending on the species. Cool shells though.
