Prevent remote callers from listening to voicemail

Currently, if a caller is directed to voicemail, they can press * and listen to messages left there. For password protected boxes they will need to figure out the password, but I would rather just disable that feature altogether. I did not see an option for changing this. Am I missing something? Is there some way of doing this?