Never too late. Actually more fish more waste and bio load leading to more nutrients for macro.
Afterthought, you may want to add pods into the fuge too. They are basically the bottom of the food chain that eats detritus, waste, rotting organics. Furthermore, they grow and populate and your fish and corals eat them. Place them in fuge or your fishes will decimate their population bore they can reproduce.