MacOS – I removed Boot Camp the hard way, but then I got a Windows error anyway. Should I be concerned

The short version:

I was running Boot Camp on my Retina MacBook Pro, but I decided just recently to ditch it because I never use it and I'd like to reclaim the space. The official method of removing it with Boot Camp Assistant failed so I went the harder route involving booting into Internet Recovery mode and deleting the partitions manually, which worked and gave me the space back – except when I rebooted I got a Windows screen telling me booting failed, and when I hold down OPTION on a boot I still see "Windows" as an option.

If I pick OS X when I hold down OPTION it boots like I want it to but on a restart it still gave me the Windows error screen. Booting into Internet Recovery again and setting "Macintosh HD" as the Startup Disk seems to have fixed it and now on subsequent reboots I'm in OS X like I want again, but I can still see "Windows" as an option as I hold down OPTION on reboot.

Is there any way to get rid of this "ghost" of Windows/Boot Camp on my system and if there's not, is this something I should be concerned with?

The long version

So here's the sequence of events:

• Got my rMBP in 10/2014
• A few months later I added Boot Camp, initially with Windows 8.1 and later upgraded to Windows 10
• The other day I decided to ditch Boot Camp as it's taking up space and I never use it.
• Did a few different backups
• Uninstalling Boot Camp via the Boot Camp Assistant didn't work, which is apparently really common
• Read online that the next best thing is deleting the Boot Camp partitions directly and/or modifying them to appease Boot Camp Assistant
• Tried removing the Boot Camp partition in Disk Utility. It wouldn't let me. (By the way, Disk Utility is really crappy and unusable in El Capitan – they've removed the old standard partitioning method and replaced them with a PIE CHART that doesn't work half the time)
• Did lots of reading, a fair amount of panicking, and booted into Internet Recovery mode
• Using the Disk Utility in Internet Recovery Mode (which is the old one from Mavericks/Yosemite, yay) I was able to do a series of maneuvers that, long story short, allowed me to delete the Boot Camp partition – along with a couple of others that, I'm guessing, are artifacts of Windows/Boot Camp – and got back to one big huge partition. I happily restarted…
• …and was presented with a clearly-from-Microsoft screen (fonts, colors, etc.) saying Windows couldn't load. At this point I've got the "No! We killed you!" scene from Robocop going through my head
• Reboot, hold down OPTION, and I see Macintosh HD and Windows. I pick Macintosh HD
• OS X boots up, I have all my space back, life is wonderful
• Reboot the Mac to see what happens and I'm back in Windows error land
• Back in OS X (after rebooting and holding down OPTION again) I go to Startup Disk in System Preferences and try to set Macintosh HD as the start disk but it won't let me do anything because there's only one hard drive now and as far as it can tell it's already the startup disk
• I booted the Mac into Internet Recovery mode and set the Startup Disk to Macintosh HD (since, I'm guessing, when you're in Internet Recovery mode you're booting off of the temporary-from-the-Internet disk) and restarted.
• Mac restarts in OS X like I want it to
• Reboot again, Mac still restarts in OS X like I want it to. Did this a few times to be sure.
• Reboot again, hold down OPTION, I can still see Windows as an option but I don't know where it's coming from

So basically things are where I want them to – except there's this "ghost" of my Boot Camp install lingering. Is there any way to get rid of it? And failing that, can I just ignore it safely?