I had allow the goal but I think I know where I got confused. There's a situation in LOTG where you'll allow a goal on a penalty rebound if the ball is traveling into the goal and it's stopped by an outside actor who doesn't have any affect on the defender's or GK's ability to stop the ball.
"If, after the penalty kick has been taken, the ball is touched by an outside agent as it moves forward, the kick is retaken unless the ball is going into the goal and the interference does not prevent the goalkeeper or a defending player playing the ball, in which case the goal is awarded if the ball enters the goal (even if contact was made with the ball) unless the interference was by the attacking team."
But during an actual penalty, it makes sense that it's a retake.
So I was just confusing during the penalty kick and after the penalty kick, right?