Mick Jagger announced on his Twitter page prior to the show that he'll be performing with the 23-year-old singer, but questioned which song they will perform.
Looking forward to singing with @taylorswift13 tonight! Wonder which song we will do?— Mick Jagger (@MickJagger) June 3, 2013
The song of choice was "As Tears Go By" which, according to Jagger, the band hasn't played in a long time.
"It's almost the first song that Keith [Richards] and I wrote," Jagger announced to the crowd. "We didn't do it at the time, we gave it to someone else, a young lady, to sing."
The audience cheered as Swift took the stage, and the duet was a smashing success.
Lady Gaga, Katy Perry and Florence Welch are all among those who have previously performed along side the Stones on their 50 & Counting Tour.
Who will be next on the list? Rumor has it, it's Adele.