The Ducks took on Halesowen Town, and produced a rousing display to come from a goal behind and claim all three points against the side placed 6th in the league table.
Aylesbury's win was thoroughly deserved, for a hard working and positive performance against an uninspiring Yeltz team who rarely looked like the league's form side.
The first chances went to the home side, Leon Gutzmore seeing a shot blocked inside the area and Rob Gould unable to turn Richard Pringle's low ball goalwards from 5-yards.
Reece Kirk was then almost caught napping by veteran midfielder Martin Myers, who attempted to lob the Aylesbury stopper, but Kirk was able to claw the ball away to safety.
At the other end Dean Coleman was also called into action, Matt Butler unleashing a sweet half-volley which was heading for the top corner but for Coleman's fabulous save.
Aylesbury suffered a blow when left-back Tony Joyce was forced off the pitch injured...or perhaps it was a blessing in disguise. Joyce was deputising in the absence of manager Neil Trebble, and he was an inspiration on the touchline after taking up his new found role.
Even so, the visitors took the lead just before the half-hour mark. Poor marking allowed Myers to easily head a free-kick home on the near post to give Halesowen the advantage which they held until half-time. 1-0 Halesowen
Half-time: Aylesbury 0-1 Halesowen
The odds were firmly stacked against United at this point - it's been over a year since Aylesbury came from behind to win (away vs Bracknell Town last season), yet the Ducks came out in buoyant mood for the second half.
Halesowen nearly scored inadvertently soon after the restart though, when Kirk's clearance hit James Francis but dropped onto the roof of the net.
Aylesbury then began to take control of the game, and were able to create a number of good openings. The first fell to Richard Pringle, who couldn't generate any power in a header after Damon Ming had crossed well from the right flank.
Good battling in midfield typified excellent games for the new partnership of Butler and Kilmartin, and the duo won the ball back to set up the next chance, spreading wide for Ming who again crossed. Coleman spilled the ball under pressure from Gutzmore, but Pringle could only shoot against the Halesowen stopper.
The equaliser finally came with twenty minutes remaining. A long throw in found its way across the area to Nick Jackson, who hit a screaming shot into the back of the net, for his 2nd goal against the Yeltz this season. 1-1
Halesowen created a good chance, but Banbury's top scorer last season Howard Forinton was greedy and blazed an effort well over the bar instead of passing the ball.
The Ducks went agonisingly close again at the other end, when Rob Gould glanced Justin Gordon's testing corner kick narrowly wide.
Pringle it was who had the best chance of the match though. The rangy striker did the hard part well by touching the ball on with his head to beat his man and leave himself clean though, but when faced with Coleman he could only slot wide of the post.
The big striker had another chance minutes later, but shot well over from the edge of the area.
For once this season Aylesbury weren't left to rue their missed chances, as they scored a dramatic late winner. A ball played into the area caused bedlam in Halesowen's backline, and with Pringle applying pressure the ball fell kindly for Gutzmore who calmly slotted home. 2-1 Aylesbury
With the game entering injury time there was little Halesowen could do, but they did come close to grabbing an equaliser when Forinton headed a free-kick onto the roof of the net, but the Ducks held on for 3 points to keep their faint survival hopes alive.
