Ubuntu – How to remove workspace switcher icon from launcher without disabling workspaces

I use multiple workspaces, but only through the keyboard commands, so the workspace switcher icon is just taking up space on the launcher for me. Ways of removing it (moving to the trash, checkbox in the appearances menu) also disable workspaces, which I don't want to happen. Can I keep workspaces enabled, but remove the icon?