Yeah, I can understand that it's not pretty. I'd probably give it 3 weeks at minimum before removing the rock. If you can aesthetically pleasing way incorporate it into the rockwork permanently, even better. feeding and waste from 5 fish is enough to cause an ammonia spike in a tank with uncured rock.
Alternatively, you can take the live rock out, smash it into little pieces ("rubble") with a hammer, and then put all of those little pieces back in. It'll have the same effect without being a giant chunk of rock.