I stock MUCH heavier than most other people and have little problem. As long as the fish aren't fighting and and nitrates/phosphates remain controlled and stable, I see no issue with doing so. Currently I have 24 fish in a 47 gallon mixed reef, and 51 fish in a 75 gallon mixed reef (which is heavier than even I normally stock, however those fish are being moved to a 180 gallon in the next month or so once I get my tax return and redo the flooring).
Proper quarantine to eliminate the risk of parasite transmission and to fatten up the fish and acclimate them to aquarium life is also key to doing this. Every fish in these tanks is profilactically medicated against ich, velvet, flukes, brooklynella, and intestinal worms, and all are fat and eating well before moving to the displays.
And I have lots of wrasses, damsels, and clowns, and dwarf angels, no problem together. Starting with young female fish (especially for wrasses and angels) really helps keep aggression down, and sticking with less aggressive damsels also helps (Pomacentrus, Chrysiptera, Neopomacentrus).