Go to Start>all programs>internet explorer. Right click it and one of the options is delete.
I have not done this, as I still have IE on one computer, but I delete tons of things that way.

Also you can try Start>control panel>add or remove programs. On the left one option is add or remove windows components. Click that and one of the options is IE.
Again I have not done this either. On the computer that I am running Mozilla, I still have not deleted IE, I just set Mozilla as the default internet browser.
Thanks Mike