I ageee with your actions Charlie.
What I have found works is when the ref counted the yards he says loudly, so all can hear, to the AR, you in this case, please watch and keep an eye on the wall. The wall now know you are watching and tend not to move.
Alternatively you give the wall the same...