I don't find the OP's observation at all unusual Simon. I would expect an assessment of an L5 referee to read a lot different from that of an L12 referee. I would liken it to the difference between a Primary School student's end of term report and one from a secondary school student. While I don't know the Levels in England well, I would expect an assessor at L5 to be looking for some extra and different things, i.e. if an L5 was getting the same "work ons" that he was at L12. surely that would be a real cause for concern.
Just to clarify - different Report Forms are used for Panel/L5, development/exchange, normal Society (different assessment or coaching reports) and ELRA Stage 3 to reflect exactly what you say Ian. The focus ranges down from factual evidence based assessment of control & communication, plus non-compliance on technical areas, through a balance of management and technical, to more development and coaching advice at Society / ELRA3 levels. So of course the content will have a different emphasis and complexity of technical views, but overall the basics remain the same. Of course a L5 would not have the same work-ons as even at L7/8.
What will vary is the experience and report writing capability of the assessors at different levels - and my point is that at Panel, Group & Federation levels we have passed RFU Assessor courses and attend training meetings where report writing is covered. So by L6 you should see good consistency. At Society level, there may be quite a lot of difference between Societies depending on how active the SADO, how often he holds training / convergence meetings and critiques submitted reports with feedback to assessors.
Now this really surprised me.
We were not always assessed, and when we were, we never knew who our assessor was. They would not make themselves known to us, and usually, the only way we knew we were being assessed was if we happened to spot someone we knew from our Referee Association meetings, wandering about somewhere near the sideline holding clipboard. Most times, the first inkling we had was when he approached us after the match!!
How times have changed!!
It will vary Society to Society of course, but RFU strategy is to have an inclusive development relationship between referee and referee coach / assessor, and not an us and them situation. It is no longer the 'secret' assessor arriving 10 minutes before kick off in all weather gear with a clipboard. At all levels the assessor should introduce themselves pre-match - it may not always happen but it should.
At the lower levels it may be last minute anyway (as matches get cancelled, referees re-appointed, etc) but at Panel / L5 assessors are appointed well in advance on the same paperwork as the referees (see
here). A similar pattern is follwoed in our Federation. Also we try to make sure all Society development referees and all exchange referees assessors are appointed a month in advance, and we have just started to publishing those on the online WhosThe Ref apointment system.