Price allowed three runs and seven hits in a career-best 7 2-3 innings - taking up where he left off last season, when he won his last three decisions, including an impressive performance against the eventual World Series champions.
Jason Bartlett's two-run double capped a five-run fourth inning against Javier Vazquez (0-1), making his first appearance for the Yankees since New York's crushing loss to Boston in Game 7 of the 2004 AL championship series. Carl Crawford, Dioner Navarro and Ben Zobrist also drove in runs for the Rays.
Alex Rodriguez had a RBI triple for the Yankees, who were limited to four hits until Derek Jeter and Nick Johnson doubled to open the eighth, producing New York's third run.
It appeared Price might get through the inning when he retired Rodriguez and Mark Teixeira. But the 24-year-old lefty gave up an infield single to Robinson Cano and walked Jorge Posada to load the bases.
Lance Cormier replaced Price and struck out Nick Swisher to get out of the jam.
Price, the top pick in the 2007 amateur draft, walked three and struck out seven to improve to 2-0 against the Yankees five appearances, including four starts. New York batted .113 in 18 2-3 innings against him last season.
Since losing four of his first seven decisions in 2009, Price arguably has been Tampa Bay's most consistent pitcher.
He led the Rays with seven victories after the All-Star break. He was 3-0 over his final 4 starts, including wins over Roy Halladay and CC Sabathia
- the latter denying the Yankees ace his 20th victory.
Entering Friday night, the Yankees were batting just .123 overall vs. the young lefty, who made his major league debut in relief at Yankee Stadium in September 2008.
Vazquez was beginning his second stint with the Yankees after being acquired from Atlanta in a trade that sent Melky Cabrera to the Braves. Vazquez escaped a jam after Evan Longoria singled and Pena walked to start the second inning. The right-hander wasn't as fortunate after walking Ben Zobrist on four pitches starting the fourth.