First, I know how to do it in Ubuntu. I could use Activity Log Manager to clear recent history.
However, it does not work on Xubuntu 12.04. The "recently used" history is always there after I tried using Activity Log Manager to clear all history.
In addition, BleachBit and Activity Journal both do not work.
Best Answer
Delete the file
$HOME/.local/share/recently-used.xbel