The simplest setup is to just connect any disk to the Mac and if you don't have Time Machine set up, you will be automatically prompted to use that drive and if it needs reformatting, that is explained. Then once the backups are set, if you are backing up an encrypted Mac to an unencrypted destination, Time Machine automatically prompts to encrypt the drive.
If you like doing things manually, here's more details and explanation that you want an HFS based drive to hold the backup whether you start from APFS or HFS.
For a time machine backup, you cannot use an external disk with APFS. You have to use Journaled HFS+. First, format your external disk as JHFS+ (Encrypted). After that, go to Settings > Time Machine and select your disk. If you have the option, select "Encrypt Backup". This way, your backup will be encrypted. So the answer to your question is neither of them. It is Journaled HFS+ (Encrypted). If you try to use APFS with Time Machine, you'll get the following warning:
Source: Apple - Backup disks you can use with Time Machine (APFS isn't mentioned at all)
Update: 24.12.2020
macOS Big Sur 11.0
APFS or APFS Encrypted disks are the preferred format for a Time Machine backup disk. If you select a new backup disk that’s not already formatted as an APFS disk, you get the option to erase and reformat it. If the disk is a Mac OS Extended format disk that contains an existing Time Machine backup, you aren’t asked to erase and reformat the disk.
Source: macOS User Guide: Types of disks you can use with Time Machine on Mac
You can enable FileVault 2 from System Preferences > Security & Privacy > FileVault. Just press "Turn on FileVault..." and full disk encryption will be setup.
Full Disk Encryption in this sense means that all your own data on the Macintosh HD file system will be encrypted. There is a preboot partition that isn't encrypted, as this is where the software necessary to decrypt the drive is stored. Without it, you wouldn't be able to boot the Mac.
When you plugin the USB drive, macOS will ask you if you want to use it for backups. If you confirm that, it will ask you whether or not you want the backups encrypted. Set the checkmark and encryption of the backup will automatically be setup for you.
If you have already started backing up to the external disk without encryption, you can enable encryption afterwards like this:
Open System Preferences > Time Machine. Click "Select Disk..." and remove the external disk.
Do it again and select the disk again, and it will ask again for encryption. Set the checkmark and you'll be asked to set a password. The disk will then be encrypted. The backups already stored on the drive will be preserved.
Best Answer
Note this answer now depends on the version of OSX/macOS you have.
This answer is for macOS Catalina and earlier versions - Big Sur now can use APFS - see Apple's Types of disks you can use with Time Machine on Mac You can also use HFS+ as before.
You can't use APFS as a Time Machine target:
https://support.apple.com/en-us/HT202784#format
Time Machine drives must be HFS+. That will likely change in the future but currently it is HFS+ only.