An equaliser just nine minutes from time rescued a welcome home point for struggling Stockport at Edgeley Park.
Northern Ireland international Warren Feeney did the trick for Sammy McIlroy's side as he pounced late on for his third goal of the season.
McIlroy made four changes following Saturday's third reverse on the spin at Brentford, and despite their recent poor form, Stockport opened brightly.
After just four minutes, Luke Beckett hung up a peach of a cross for the onrushing Rickie Lambert, but his goalbound header was kept out by a smart goal-line save from Rovers goalkeeper John Achterberg.
Brian Little's side then responded with Calvin Zola twice going close within the space of two minutes. Firstly he was thwarted by a brave stop from recalled home keeper James Spencer, then by a timely block from Derek Geary.
An end-to-end clash continued its high tempo right up until the half-time whistle, with both sides going mighty close to breaking the deadlock.
The best for Stockport came from Lambert, who curled a sweet free-kick inches wide of the post, while the dangerous Zola blasted wide for Rovers after racing clear.
The deadlock was finally broken on 54 minutes, and what a simple strike it was for Tranmere. Gareth Roberts swung in a corner from the left and Rovers skipper Mike Jackson rose unchallenged in the six-yard box and planted his header firmly home.
Within seconds Feeney almost levelled things up but his far post header was well saved by Achterberg.
That man Zola should have doubled Rovers' advantage on 67 minutes, but despite going one-on-one with Spencer, the Stockport keeper did enough with a brave stop.
It looked as though Stockport were heading for their sixth defeat out of seven this term, until Feeney struck with just nine minutes to spare after being superbly teed up by Beckett.