Well, to change your Homepage, do this:

Open Internet Explorer > Click "Tools" > Click "Internet Options" > Change Homepage.

Then, try deleting the shortcuts again and restarting your computer... If that doesn't work, you could always hide the shortcuts in a folder and hide the folder in another folder on your desktop or something- I'm not sure exaclty.