The new Outlook is out there and will replace Hotmail.
But what if you created an alias by accident (I actually didn't know that I cannot change the display name)?
AFAIK, the option is not directly available from the account options, but from this URI:
https://account.live.com/ManageAssocIds
