MMB Drag it to the trash bin (its at the far right of the shelf, and a bit up). Or go to the arrow at the left of the screen, go to shelf editor, click on the farthest right tab, select the name of your shelf, go to the tab to the right of it, select the name of the icon, and click delete.

Hope this helps.