At least I appreciate he's a much respected international referee and don't call him incompetent like someone else.
I'm still learning and it is all about differing interpretations of the law. Saying how he's a better standard of referee than me so shut up (which is effectively what you have said) isn't going to help me learn and doesn't encourage discussion on the website.
And besides - all referees are human and make mistakes.
This is a common misapprehension. All referees are godly, and never make mistakes. I quote:
[LAWS]6.A.4 (a) The referee is the sole judge of fact and of Law during a match. The referee must apply fairly all the Laws of the Game in every match.[/LAWS]
Notwithstanding the above, when you or I are the referee during a match, we are neither omniscient nor omnipotent gods. And after the match we - and NO too - are subject to (self-)criticism.
Lawes is an "enforcer" at a level where replays are possible from multiple angles. NO is a referee at that level. But there would likely have been the same sort of pushing and shoving in any game you or I might referee, and it might escalate if we decided to follow the ball rather than whistling immediately.
To be more constructive: amateur players will not mind if you penalise the "enforcer", in my experience. If there is some minor pushing and shoving (as there was here), then you can mention reversing the penalty "next time" if that happens again.
That said, it wasn't foul play. Technically late, sure, but "it looked worse than it was".