The Yankees outrighted Downs to Triple-A Scranton/Wilkes-Barre on Wednesday.
He's no longer on the 40-man roster but will remain in the organization. Downs had been claimed off waivers earlier this offseason and is a career .182/.260/.273 hitter in 50 career plate appearances at the major-league level.