Yes, it will rise on its own as the tank blows off the excess CO2, and anyway, there is nothing you should dose to help it rise as they all add alkalinity.
The pH might drop below 7 temporarily, which is why I asked what is in the tank. If you haven't started already, maybe start with 1/4 as much as I suggested and make sure there is no undesirable effects for 24 h.
FWIW, lots of people have done this in salt mixes, but not that I know of in existing aquaria.