That is the coral's skeleton. Which is also a rock. Limestone.
It should be pretty easy to take a razor blade, or other such tool, and scrape that aiptasia off the skeleton. The skeleton is not alive, so doing this won't hurt the coral. Deep inside, and closer to the top of the skeleton, there is living tissue, so don't dig a real deep hole in it.
Peace
EC