I have built a couple overflow boxes out of glass. They have no teeth and are "Herbie" style overflows.
No teeth = quiet and the best surface skimming.
I know glass is reef safe, I have heard plexi and lexan leech phosphates but I am not possitive on that.
My boxes are side drilled due to tempered bottoms, but if you can get the caps off the holes you got yourself an easily tunable "Herbie".
Once you get the caps off fit the bulkheads. If it was a store bought tank they will be different sizes.
If you want to follow the footprint of the original box, just measure the were the silicone is on the bottom of the tank.
For the hight, I just go about 1/8'' under the bottom of the tanks top trim piece. This hides the water level from view.
I would build the box first, let it dry completely and then install it in the tank.
**All the old overflow box silicone should be removed before installing new overflow box.
**If you use glass I would recommend tinted glass and use black silicone for a cleaner look.
Links to my builds so you can get an idea of how i built my overflows and how they look...
75 gallons
45 gallons