Yup, just press down and hold for a few seconds on the icon you want to remove. You'll see a trash can appear on the screen, just slide it over.
To delete shortcut menus i've been dragging them to the home screen and repeating the method above.
Not sure if it's the most efficient method but it works.