Just do the following.
1. First of all you must be on the screen that has icon for the application that need to be removed.
2. Then Tap and hold the icon until the icons wiggle. An x will appear to some apps.
3. Tap x in the corner of each app
4. To save your change press home key.