The problem was that I erased the disk and created an AFPS partition. Apparently, this only creates a container, in which the actual partition must be added. I deleted the containers using the diskutil afps commands and then erased the disk by creating a new HFS+ partition.
In summary, if you want to install High Sierra from scratch, boot from the installation USB drive, start Disk Utility and erase/format your target drive with GUID/HFS+ (the previous default). The installer will then automatically convert it to APFS during the installation process.
You can't merge an update into an older macOS installer app easily. So you have to re-download the full installer to get the most current version. Check that you don't get the restricted (20 MB) installer only app.
After downloading the first full installer (without installing it), move it to a folder and create a dmg choosing the folder (or alternatively zip the app).
Then install the upgrade or trash the macOS installer.app.
After Apple announces and publishes a new installer (not necessarily as a point release update), download it again. Repeat the steps above. If you don't need the old installer.dmg anymore, trash it. I usually keep them.
Under certain circumstances (often after moving the macOS installer.app to an arbitrary folder) downloading the new release will replace the old macOS installer in-place.
To check the build version grep the the file /Contents/Info.plist for DTSDKBuild:
grep DTSDKBuild -A1 .../Install\ macOS\ High\ Sierra.app/Contents/Info.plist
The golden master's build version was 17A362a.
The first installer's build version available to the public was 17A364.
The latest build version as of today is 17A400 (small installer) or 17A403 (large installer).
Best Answer
Yes, while APFS is optimized for SSDs you can still use it for HDDs as well.
Installing macOS High Sierra on a HDD installation of macOS Sierra won't prompt you to convert it to APFS, though.
See this quote from Apple.com: