I've been accused of having a quick hook sometimes but this kind of stuff happens. Let him stare, just like I let a batter stare after a called strike he doesn't like. I have an unofficial clock running in my head as to how long is too long. If they have gone past the point of upset about the call to showing me up, I tell them it's time to return to the dugout. That allows the player/coach to make their own decision whether or not they want to remain in the game.
I don't expect any player or coach to be devoid of emotion. However, once the emotional reaction is complete, they have the conscious opportunity to decide whether or not they want to continue to participate in the game. I don't throw them out, I simply inform them that they have decided to take the rest of the game off.