NEW YORK (CBSNewYork) – Kanye West brought his “Sunday Service” to Queens this weekend.

The rapper was backed up by the choir at The Greater Allen A.M.E. Cathedral of New York in Jamaica.

His appearance came ahead of the release of his new album, “Jesus Is King.”

West is reportedly finished with secular music, saying he will only record gospel music going forward.