If you have one or more new Voice Mail messages, when you pick up your phone you hear a stutter dial tone (several quick beeps) before the usual dial tone.
Your My Services account and your phone retrieve Voice Mail from the same location. If you remove Voice Mail using one tool, it is removed from both. If you want to keep messages but need to free up space in your Inbox, you can save Voice Mail messages to your computer's hard drive.