When you add the address bar to the taskbar, or even the one in Internet Explorer, you can turn off the "Address" button by right clicking on the bar and deselecting "Show Title". However, to get rid of the Go button, you have to do the following:
1. Start Internet Explorer
2. Click Tools/Internet Options
3. Click the Advanced tab
4. Scroll down the list of options until you find the Show Go Button in Address Bar checkbox
5. Deselect it
6. Press OK and all is done!
This saves valuable taskbar space, as the Address bar is a very useful feature to have at the bottom of the screen! (can browse to any local or Internet folder!)