If you haven't heard Alicia Keys live in concert, listen up. To celebrate the 10th anniversary of her Grammy-winning debut album, 'Songs in A Minor,' Keys brought down the house in an exclusive acoustic solo concert for AOL Music, called 'Piano & I.'

See her belt out 'How Come You Don't Call Me?' in the clip below.

On a candlelit stage at the Beacon Theatre in New York City, the Givenchy-clad singer said, "The city really wrote a lot of that first album." As Keys recounted endless hours spent riding the NYC subway, her show became a heartfelt tribute to her hometown. By concert's end, the new mom received a standing ovation.

Performing alone, she sang her own music, but gave plenty of love to other legends. A medley of covers included "big inspiration" Mary J. Blige's 'Real Love' and Marvin Gaye's 1972 hit 'Trouble Man.' She also treated fans to the Beatles' 'Blackbird' and segued from Billy Joel's 'New York State of Mind' to her 2009 Jay-Z duet, 'Empire State of Mind.'

Keys had audience members in the palm of her talented hands, as they sang along to 'How Come You Don't Call Me,' her powerhouse Prince cover from 'Songs in A Minor.'