Ali Alaheri, 29, was charged with criminal mischief as a hate crime.READ MORE: Primary Election Day Guide For Voters In New York
Police said Alaheri knocked down and destroyed a large crucifix statue outside St. Athanasius Church in Bensonhurst.
Alaheri is also accused of burning an American flag outside the rectory.
A pastor discovered the damage on May 14.
“It was a terrible morning. It was probably the saddest day in my life, to see this desecration of a cross of Jesus and the desecration of the flag,” Monsignor David Cassato told CBS2 the day it happened.
Parishioners gathered in prayer that night and used a crucifix from one of their classrooms as a temporary replacement outside the church.READ MORE: NYC Mayoral Candidates Make Last-Minute Push For Votes Ahead Of Tuesday's Primary
The crucifix that was destroyed stood for 11 years.
The Department of Justice says on Wednesday, Alaheri deliberately set fire to a yeshiva and synagogue on 36th Street in Brooklyn.
Surveillance video allegedly shows Alaheri piling garbage bags against the side of the building and lighting them on fire.
Firefighters responded to a fire alarm and extinguished the flames.
Later that same day, Alaheri also allegedly attacked a man wearing traditional Hasidic garb.MORE NEWS: More Violence On Subways: Police Say Tourist Hit With Bottle, Man Slashed In Separate Attacks
He was arrested in Dobbs Ferry on Friday.