Rays starter Jake Odorizzi (2-1) held the Yankees scoreless through five innings on Saturday but was touched for three runs in the sixth and ended up suffering the loss.
He struck out nine in his six innings of work in his first loss of the year.
Odorizzi came into Saturday's game as the third AL pitcher in the last 100 years to start the season by winning consecutive starts of six-plus innings, two hits or fewer and one run or less.
Odorizzi will look to get back in the win column on Thursday against the Red Sox.