I had something not dissimilar a couple of months before the end of the season. I'd sent a home player for two cautions - a foul followed by shouted dissent, so I was used to the sound of his voice!
The away team were attacking in the penalty area when I heard someone screaming at me from the side-line. I thought it sounded familiar so glanced across to check, saw the player shouting and went back to the game - luckily I was in a position where I could glance across quickly without too much risk, and could let the play develop until the ball finally went out for a corner. I then held the game and went across to deal with him. He'd moved away when sent before coming back, and I hadn't caught him.
I then told him to go away, to get the usual "you can't do anything! It's a public place!" before carrying on his tirade. He eventually went when told that he had thirty seconds to start moving before the game was abandoned - I don't give people on the side-lines too long or it encourages them to keep going.
I felt that stopping the game would penalise the team who were not offending, and there was a real chance of them scoring. I didn't think about where a resulting IFK would have been at the time.
He got one game for the S7 plus three for the OFFINABUS, but he probably still hasn't learned!