The version of Mail.app that comes with Mavericks has this cool message control bezel (below, in the orange box) under the email header in every message allowing you to delete, reply, reply-all, or forward the message when you hover on the line:
It's great, but I archive all my mail. Can I change the trash can button (pink arrow) to the archive box, like in my toolbar?
Best Answer
As stated by CMW, Delete2Archive can solve this issue: http://akgungor.com/2013/11/11/delete2archive-archive-gmail-messages-using-delete-key-os-x-mavericks-mail/
I use it an can confirm that it works, also for your problem: