Referees will always have a large impact on the outcome of a game. It's easy to remember when a call is egregiously bad and directly changes who wins or loses. It's harder to remember all the minimal ways a referee leaves an imprint, from the simple way a game is reffed to individual calls themselves. On some level, which way the whistle blows will always be a determining factor.