No, having a lot should not harm your tank. They will help keep your tank clean; however, if you really don't want them you can always give them away. I look for them when buying rock. LOL.
If you buy an ornamental shrimp such as a peppermint shrimp, it should take care of the over population.