For example, see the screenshot below. The menu items have keyboard shortcuts associated with them, but where can I find a list of what keys the icons are referring to?
List of menu shortcut icons
keyboard
Related Solutions
The shortcuts for each application can be easily changed in the very preference menu you mentioned.
Which shortcuts can be changed is determined by what options are in that application's menu. So for Finder, you can customize "New Finder Window" and etc. etc. whatever is in the menu.
To change the shortcut for "Open" (which happens to be Finder -> File -> Open in the menu) you go to the System Preferences Keyboard Shortcuts, go to Application shortcuts, find "Finder", press the "+" button, and add a new option with name "Open" (exactly spelled as the menu option) and enter a keyboard shortcut.
Note that you can't use the enter key or anything: you can only use the modifier keys (shift, command, control, fn) and numbers or letters.
For general shortcuts you can scroll up into "All Applications" and add a shortcut for "Copy" or "Paste" or which will toggle for whichever application has that menu option in its menu.
EDIT: Response to comments:
1) If you can't find the exact name of a menu command or if there isn't a menu command... well, you just can't set a shortcut unless you use some kind of a third party application that intercepts keystrokes (kinda like AutoHotKey but on Mac). Thus for Quick Look, it doesn't work since the menu command (there is a menu option for it in Finder File->Quick Look) adds the name of the file to be "Quick Looked", e.g. "Quick Look 133.png." I believe in Leopard it may have worked if one just set "Quick Look" to whatever shortcut under Finder, but it doesn't work in SL for me.
2) Screen Capture Cmd+Shift+3 is universal: it's a full screen screenshot. Cmd+shift+4 is similar except it lets you select a box to screen shot. I'm not sure what you mean which shortcuts are for which apps... Either it's listed under the app (in the preferences) or it's universal and applies to either every application with the menu option or the system itself.
EDIT 2: I'll add even more when I have time
a) To my knowledge CUSTOM keyboard shortcuts are stored in com.apple.universalaccess.plist and com.company.application.plist (e.g. com.apple.finder.plist) located in the ~/Library/Preferences folder.
com.apple.universalaccess.plist lists the apps with custom shortcuts:
com.apple.finder.plist lists the actual custom shortcuts for finder under NSUserKeyEquivalents:
EDIT 3:
b) I believe that the default shortcuts for Cocoa apps are stored in the nib files, for example ../Finder/Contents/Resources/English.lprog/MenuBar.nib or seomthing like that. I've successfully edited these nib files MANUALLY using interface builder to change the keyboard shortcuts for the menu bar items. (Whether there are shortcuts that are not menu bar items and not defined by the system I don't know) Thus I don't know of any command line way either...
The nib:
I don't know whether this serves your purpose well. As a side note, for completeness, to edit a compiled nib file like those of finder... is an entirely different answer on its own. This article sums it up well. Basically you work with an uncompiled nib to edit a compiled nib: If you undertake this journey and have trouble finding an uncompiled nib I've uploaded one here.
If I ever find a command line method or learn more about where applications store keyboard shortcuts I will update this answer accordingly.
EDIT: Final Note These nibs are in xml format or something and can be opened by text editors... that might allow for... I don't know. :D
Not sure if this is a complete list, but this is a pretty good start from Apple:
https://support.apple.com/en-us/HT201236
Here is another link to an image of the shortcuts:
Best Answer
The quickest way to get the entire list is to use Finder's help and search for "Symbols used in shortcuts" and refer the to the canonical list of symbols. It's also in the user manual for your mac online and I believe is still shipped with all Macs in the box.
Finder contains six icons in its menu bar and safari has a couple more which visually represent a key on the standard keyboard from Apple (most of which do not share the same icon when made as a physical key cap).
So the list of common symbols is pretty complete as follows:
We also have some references on the "meta" side of the site where we talk about how to differentiate between what is printed on the keys and what software draws in the Menu bar (and other places).