You are correct in what you have done....
From a learning point of view, I would not have expected you to have asked him to leave. Once he has left the field of play, his conduct becomes that of the club. So from a preferred approach, when you stopped the game, you should have gone to his club...