You are right at the EPA limit for nitrates in drinking water. I wouldn't drink that water (untreated), and for sure don't let any babies drink it untreated. The USEPA says:
"Infants below the age of six months who drink water containing nitrate in excess of the MCL could become seriously ill and, if untreated, may die. Symptoms include shortness of breath and blue-baby syndrome."
Nitrate removal by the membranes we are most familiar with, Filmtec Brand, is typically 85% to 98%. That range will easily get you down to safe levels of nitrates. Running the RO water through DI resin will reduce it even further.
Russ