I have absolutely no problem giving a Red Card I don't find it hard at all. It's the players action that produce the Red Card, not mine. I merely react to it in the prescribed manner. The phrase I often use, and have heard Premiership Referees use, is "the law is very clear on this, I have no option".
May I ask if you are in the fortunate position to have ARs for most matches?