Indeed it unfortunately is.
If the rock is removable, take it out and scrape off so much of the nem as you can, then take super glue or epoxy and smother that spot so it cannot grow back if any fragments are left, and then start searching. Usually where there is one, there is more