You have to just move on, otherwise it will get into your head and you'll start second guessing your calls.
I had this a few seasons ago, I had two games with the same team that were difficult games that they lost narrowly. Of course it was my fault and they let their displeasure be known on both occasions.
Three weeks later I was appointed to them again for an away game for them, driving to the game I was letting it play around in my head and I knew it was getting to me.
I got to the ground and got my shit together, its just another game and I'm going to treat them as if Id never seen them before but keep a tight rein on the game.
20mins into the game I call a dubious (to team Dublin's mind) knock on. As they pack down the Dublin prop moans about the decision and says aahh sure you hate Dublin anyway. i looked him straight in the eye and said excuse me I don't hate Dublin, I just hate you ! He looks at me a starts roaring laughing.
Bottom line, don't over analyze previous games, next time your there resolve to ref your normal game to the best of your ability, that s all anyone can ask of you.