Notes:
-The folder/file icon will have a chain icon on it indicating that it is a shortcut.
To remove a shortcut you need to first navigate to OneDrive on the web: