With my copy of iTunes, running on an iMac, all I have to do is right-click the song (or album) that I don't want and select
Delete from the pop-up menu.
This doesn't work if the item is in a smart playlist, nor if the item is in a shared library on another machine- you have to be at the machine on which the item actually exists.
Is that any help?