Watch Paul McCartney, Elvis Costello, Jon Batiste & more join Colbert on The Late Show’s last episode

The Late Show with Stephen Colbert has been counting down to its final episode with guests like David Byrne and Bruce Springsteen. They were both announced (slightly) in advance, but the lineup for the final night on Thursday (5/21) was a total surprise. It was, of course, stacked: a two-song medley ended with night, with Paul McCartney, Elvis Costello, former Late Show bandleader and musical director Jon Batiste, and current bandleader Louis Cato teaming up with Colbert for renditions of Costello’s “Jump Up” and The Beatles’ “Hello, Goodbye.” For the latter, they were also joined by house band The Great Big Joy Machine, and eventually the show’s whole staff for a big singalong. Colbert and McCartney then turned off the lights, and you can watch what happens next in the video below.

Colbert also interviewed McCartney for the episode, and he talked about performing at Ed Sullivan Theater for the first time with The Beatles over six decades earlier. Watch that below as well.

As Variety points out, Bryan Cranston, Paul Rudd, Ryan Reynolds, Tim Meadows, Tig Notaro, Elijah Wood, Jimmy Kimmel, Jimmy Fallon, Seth Meyers, and John Oliver also made appearances on the episode.

McCartney played the Season 51 finale of SNL almost a week ago, and his new album The Boys of Dungeon Lane is out next week.