NEW YORK -- Jaime Garcia would have liked to finally get a win for his new team after a nomadic summer that has seen him go from the Atlanta Braves to a brief layover with the Minnesota Twins and finally to the New York Yankees.

Garcia came tantalizing close on Wednesday and was disappointed he was not able to finish the fifth inning until he was reminded of the effectiveness of the bullpen arms following him.

Garcia allowed one run but came one out shy of qualifying for the win as New York's bullpen recorded the final 13 outs and the Yankees held on for a 3-2 victory over the Tampa Bay Rays in a game relocated to Citi Field because of Hurricane Irma's impact on Florida.

Garcia, who is 0-2 in six starts since the July 30 trade, saw his day end after allowing a broken-bat single by Lucas Duda. Manager Joe Girardi promptly came out and got him for the same reason he took out CC Sabathia Monday -- to avoid facing Tampa Bay slugger Evan Longoria for a third time.

"That was difficult because he was throwing the ball so well and he'd done a pretty good job on Longoria all day but it was a decision that I felt like I had to make," Girardi said.

The left-hander seemed upset walking off the mound but then nodded attentively in the dugout as Girardi briefly explained the move.

"I appreciated that from him," Garcia said. "He came up and said it was a tough position for him to do that and that I was throwing the ball well, but at the end of the day my job is to execute pitches until I'm out of the game. I thought for the most part I was able to do that today. The biggest thing is we won a big game."

Then Garcia sat back and watched four relievers bend but not break.

"That's the price we pay as starting pitchers," Garcia said. "Our bullpen has been unbelievable. It's one of the best bullpens in the league and they come in every time and whomever comes in after me, I know it's going to be really good. That's a good thing to have. That's a good problem to have and it worked out today."

Chad Green (5-0), who was awarded the win, was the only one of the relievers to not allow a baserunner.

Green ended the fifth by retiring Longoria and struck out the side in the sixth. Tommy Kahnle allowed two hits in a scoreless seventh, and Dellin Betances was lifted after striking out Logan Morrison with Longoria on first.

Aroldis Chapman was brought in for a four-out save but was shaky at the outset, issuing a walk to Steven Souza Jr and allowing an RBI single to Adeiny Hechavarria before striking out pinch hitter Wilson Ramos.

In the ninth Chapman allowed a leadoff walk to Curt Casali but struck out the next three hitters. Appropriately enough, he notched his 18th save with a strikeout of former New York Mets first baseman Duda, who was given his old locker in the home clubhouse.

Batting last and using the home clubhouse were among the features enjoyed by the Rays as the "home" team. The regular Tropicana Field highlight montage played on the scoreboard before Chris Archer (9-10) threw his first pitch, and the hitter's normal walkup music was played.

The difference was that the pro-Yankee crowd of 13,159 fans in the lower level was rooting for the Yankees to get the last out and not for the Rays to win it.

"I don't know, maybe the first day there was uncertainty but most guys figured out that stuff was OK for the most part back home," Morrison said. "As far as not being at home, they only had a couple more thousand Yankee fans here than there would be at the Trop -- so it wasn't that big of a deal."

Before the Rays nearly won it in the ninth, Archer gave up all three runs in a 28-pitch second while getting beaten by his breaking ball.

Todd Frazier hit an RBI single for a 1-0 lead and Brett Gardner added a two-run bases-loaded single to left field.

Kevin Kiermaier hit his career-high 13th home run in the third before the Rays mounted numerous comeback attempts.

Archer labored through four-plus innings, allowing three runs and six hits. He lost his second straight start but said he was not feeling any pain in his right forearm two starts after getting an MRI on it.

"Back-to-back starts where there were some key situations and I didn't minimize the damage and I pride myself on doing a lot better than what I've done," Archer said.

NOTES: Yankees 1B Greg Bird (back spasms) was not in the lineup for a third straight game but an MRI on Tuesday came back clean. Manager Joe Girardi said he hopes to place Bird back in the lineup Friday, when the Yankees next face a right-handed starter. ... Tampa Bay manager Kevin Cash said RHPs Matt Andriese and Alex Cobb will start the first two games of this weekend's home series with the Boston Red Sox. Cash also said that RHP Jake Faria (left abdominal strain) would likely make a multi-inning appearance at some point this weekend after being activated from the disabled list. ... Yankees OF Aaron Hicks (strained left oblique) did some light running in the outfield about three hours before the first pitch.