But the Bulls will probably think that they should have taken all three points after missing a number of excellent opportunities.
Hereford had much the better of the first period, but as in many previous matches, their finishing failed to match their approach play.
Andy Williams raced on to a long pass from Kris Taylor but saw his shot blocked away for a corner.
Then Lionel Ainsworth found himself one-on-one with goalkeeper Danny Coyne who blocked the winger's shot at point-blank range.
Hereford's wastefulness was punished seven minutes before the break when Bas Savage flicked on a speculative through ball to Edrissa Sonko, whose decisive finish beat Craig Samson.
Dean Beckwith had to be alert minutes later to dispossess former Bulls loanee Steve Jennings as Rovers sought to add to their advantage.
Hereford, however, were back on level terms in first-half injury-time. Ainsworth returned the ball to Toumani Diagouraga, who rifled a shot past Coyne to notch his first goal of the season.
A mistake by Ben Smith on the edge of the Hereford area gifted Tranmere with a second goal on 61 minutes.
The midfielder lost the ball to Sonko, who drilled a shot into the corner of Samson's net.
But Smith made up for his error shortly afterwards, picking out Steve Guinan with a neat pass which allowed the Bulls top scorer to turn and shoot into the net off a post.
Hereford should really have sealed the points from any one of a series of chances as time ran out.
The best of these came from a good move down the left which saw Guinan release Matt Done, who delivered a cross which Andy Williams completely missed from just a few yards out.