What are you using to test the CO2? Is it calibrated? Make sure you are getting accurate readings before doing anything.
Are you using a skimmer? Aeration is a good way to balance the CO2 in your system. If not I would suggest to put one on your wish list. Otherwise, you could resort to the soda water(check the label, it should say water and carbon dioxide are the only ingredients) about 5mL per gallon of tank water, and test, or plain white vinegar, about 1mL per gallon and test.
Make sure you're testing the pH at the same time of day, since it will have slight changes throughout the day.