"Only tang syndrome" as I will dub it, is a bit unique. When tangs are used to being the only similarly-shaped herbivore in a tank, they tend to be less inviting of "guests". In their heads, they've successfully kept their territory free of herbivores.
In this case of course, a tusk is hardly an herbivore, far more carnivorous although mine eats anything. But this can also apply (sometimes even more so) when there are fewer other fish in a tank. They get used to being "alone". The goby occupies a completely different area of the water column, thus he's not seen as a threat. The tang is also used to its' presence.
In short, adding multiple fish at a time can prevent/reduce this type of aggression. Thankfully, zebrasoma tangs (as yellow tangs are) GENERALLY do not hold long grudges against newcomers unlike some of their acanthurus cousins (such as powder blue, achilles, clown, and sohal, and powder brown to name 5 bad offenders). Sometimes they can eventually even accept conspecifics. I find that they're the least likely tangs to continue to be territorial (after say 2-3 days). Of course, individuals vary and he's been able to get used to ruling the tank without much influence.
A mirror is probably a great distraction. I am a bit surprised the moving of the rocks didn't work, but I think it's addressing perhaps the wrong problem - in that the issue is he doesn't want to share his space. I think it will blow over fine.
When I add new fish, especially tangs - I notice the dominant tangs torment newcomers. Typically this doesn't last long. If the fish is healthy, eating, and can get away from the attacks, it should work out. They will slowly become more acclimated. Harlequin tusk are sometimes fragile at first, but if quarantined and acclimated to aquarium life I find them to be QUITE hardy and eventually ornery. If the yellow tang doesn't stop pushing its' luck, the tusk will probably make his/her point clear that the bullying ends. Hopefully the YT survives that encounter if it happens.
My bet is that in 2-3 days if the tusk can handle the stress/bullying, all will calm down significantly and peace ensues shortly thereafter.