The Rottie named Puppet was swept downriver after slipping down a rocky shoreline on the bank near the northern tip of the New York Botanical Garden.
Someone noticed the dog falling into the water and called 911.
As the pooch struggled to swim, officers in an NYPD helicopter told cops on the ground where they could catch Puppet as he floated downstream.
They formed a human chain and using a catch pole, pulled Puppet from the water.
Police say the pup was wet, but otherwise fine and was returned to his owner.