Hello
Could you tell us how much power are your PSU ?
By my experience , If the Hardware are under powered , the Overcloking will fail (shutdown , restart loop) .
Me , i am under powered . My PSU are 400watt and i am running a p45 with x2 2giga ddr2 , a Core 2 duo E7200 and a HD3870x2 .
Now , just for the HD 3870x2 it need a 500watt PSU at least , Yet , my Rig work fine and super stable . I even can Softly overclock CPU,GPU to gain a extra punch for some game.
But wen it come to overclock medium or HARD my PC does exactly what your PC do.
If it is not the POWER of your PSU it could be that your PSU (maybe a capacitor with in) cant take the charge and shut -restart your PC .
Try with a other brand PSU and for the most ...stupid , check if your RAM are properlly plug into the RAM slot .
Bad RAM do shut-restart the PC too .
i hope it help