You can set up voicemail on your Android phone directly from the phone's keypad or its Voicemail app if it features one.
I've switched to Samsung Galaxy Skyrocket from iPhone 3GS about a month ago. Only today did I decide to setup the visual voicemail which required me to call AT&T. After checking for a while the nice ...