Yes, it will help offset the low pH inherent to a CaCO3/CO2 reactor.
They way i would do it is determine the daily delivery of alk by the reactor by measuring the tank alk, the reactor effluent alk, and the daily flow rate out of the reactor. Let's say that ends up being 2 dKH per day.
Then pick some fraction of that (say, half? A quarter, 3/4, etc.) and deliver it by the high pH two part, and raise the pH or reduce CO2 delivery in the reactor so that it is delivering less each day. It will require some tinkering to get things balanced again, just as if switching entirely between methods.