As of October 2011, Microsoft has discontinued the service and began migrating customers to a new service called Windows Live SkyDrive.
To remove My Phone from the device:
- From the Home screen, tap Start.
- Tap Microsoft My Phone.
- Tap Menu.
- Tap Account.
- Tap Stop Using Service.
- Tap Yes.
For applications: http://marketplace.windowsphone.com/