Try plugging your phone into iTunes, then hit RESTORE AS NEW. That should bring it back to the factory settings. Then hit RESTORE FROM BACK-UP, but make sure that you use a back-up file from before the 5.1 beta 2 update.
Just download 5.0.1 Ipsw and with your phone off hold the home button and plug your phone in. Then it will ask to restore your phone. Hold the shift button on your computer and click restore. Browse your computer for the ipsw and install. Then click back up from your old back up you had before you updated. Of that doesn't work then you will have to hacktivate the phone