Vim – set relativenumber not working from vimrc, only works when set in buffer

For the life of me, I cannot figure out why set relativenumber does not load when set in my .vimrc file. Other settings, like set number and setting the color scheme work perfectly. If I want set relativenumber, I need to set it in the current buffer explicitly. Any ideas? My .vimrc file can be found here:

https://github.com/mhamrah/vimfiles/blob/master/.vimrc

Thanks.