Spider co-founded the Pogues, along with Shane MacGowan, Jem Finer, and James Fearnely and he has appeared on all of their recordings. The band's original intent was for MacGowan and him to share vocal duties, but She decided to leave them to Shane after the first performance, opting to learn the tin whistle. He still frequently contributed backing vocals and occasional lead vocals throughout his long tenure with the band. After Shane MacGowan was fired from the Pogues in 1991, Joe Strummer filled in for him for a short period, after which Stacy assumed the role of lead vocalist. The Pogues recorded two albums with him on lead vocals: Waiting for Herb and Pogue Mahone. He resumed his original role in the band when they held reunion shows in 2001 and from 2024 and will do the same for their upcoming tour.