Apple Mail is not retrieving mail automatically from Exchange

I have an Exchange account set up in Apple Mail. When I click the "Get new messages" button it successfully retrieves mail from the Exchange server.

I have the "Check for new messages" setting in Mail to "Automatically" but it is not retrieving them automatically, I have to manually click the "Get new messages" button again to get the messages.

I have also tried setting "Check for new messages" to "Every minute" but this does not work either.

Initially restarting Mail seems to fix this, but the problem seems to re-occur every time I wake up my computer from sleep/hibernation. I don't want to have to restart Mail every time I do this.

Is there a known fix for this behaviour?