After their 3-1 horror show loss at Stafford in midweek, United bounced back to finally record their first ever Conference win and lift themselves off the bottom of the table.
Chorley took the lead in their first attack on 15 minutes when Jimmy Brady crossed and The Ducks back four stood and watched as Mark Russell converted from the edge of the box.
United levelled on 24 when Chorley keeper Colin Ridler fumbled Dave Botterill's corner and Cliff Hercules headed in from close range. The hosts then took the lead on 30 when Gary Harthill ran down the right and crossed low for Adrian O'Dowd to hit a superb shot past Ridler from the edge of the box.
That seemed to knock the stuffing out of Chorley and it was 3-1 on 39 when Botterill blasted home from the penalty spot after he was brought down in the area.
It got even better for United on 53 when Albert Altenor nipped in to make it 4-1 after Russell, in no apparent danger, tried a back pass to Ridler.
However, Chorley refused to lie down and they pulled one back on 73 when Brian Ross burst through the middle of the defence and although Tim Garner parried the shot, the ball rebounded off Ross's outstretched leg onto defender Bob Coy and into the net.
Then on 80 minutes, O'Dowd innocuously fouled Steve Phillips for a free kick 20 yards insde the United half and after Phillips was sent off by Wolverhampton referee Gurnham Sing for headbutting O'Dowd, Shaun Allen blasted the free kick past Garner to make it 4-3 but United held out for a famous win.