Ubuntu – Mouse click events are delayed when moving the cursor in xubuntu 12.04

I am trying out live xubuntu on my samsung n150 (netbook, similar to eeepc). So far everything seems perfect, except for this one thing.

When I am clicking the mouse while moving the cursour, the click event is delayed. This is extremely annoying when i try to to move windows, because i end up clicking the window behind the window i am trying to move and thereby changing focus. This goes for all applications. I.e selecting text is difficult.

There is no lag in the cursor movement, just the click event. The click event is registered with the new mouse position, not the one when the mouse was clicked.

I tried searching for the problem, but all the other cases where either kind of different, or had no solution.

EDIT: After testing some more, here are some more information.
The click doesn't occur until i stop moving the cursor. If I move the cursor smoothly around, the click never gets through. I have ubuntu netbook remix 10.04 installed, and have no problems with the mouse there.

EDIT2: Once I connected a usb-mouse, the problem dissappeared. Dragging now works perfectly with both the track pad and the usb mouse. I will update once I have installed xubuntu and figured out if this is a persistant problem.

EDIT3: I have installed, and the problem is still there. It dissappears when I have a second mouse connected however, and after I resume from suspend. My solution for now, is just to keep the dongle connected all the time.

EDIT4: It's been a while since I had this problem, and I've stopped using the machine. I think it was an annoying problem, however, and I will do what I can to help solve it.

Since somebody asked: the machine has 2 GiB of memory.