Analogy:

A common analogy for bandwidth is the highway. The more lanes there are, and the faster the cars go, the more cars can travel down the highway at a time.

Using trucks instead of cars, imagine that you need to transport a bunch of merchandise or mail from one city to another. If you have a single-lane highway, then only one line of trucks can travel down it, thus reducing how much merch can be transfered, thus taking longer to get it all across. Conversely, if you have a 10-lane road, but each truck travels at a very slow speed, it still takes a lot of time to get everything delivered.

Now imagine that instead of delivering to the next town, you need to deliver father. To get the goods from this city to another country, it has to travel through several cities, and between each city, there are different highways; some narrow, some wide, some uphill, some downhill, etc. If the road from the city 1 to city 2 is ideal, as is the road from city 3 to city 4 (the destination), but the road between cities 2 and 3 is terrible, then it becomes a bottleneck. This causes the road between 3 and 4 to be underutilized and slows the total delivery time.

Application:

Back in computerland, getting data from one place to another is the same situation. You have devices like a CPU, a GPU, and RAM (the cities), and cables and busses (the roads, not to be confused with buses, though that still kind of works). A device like the CPU can process data in and out at a certain rate which could be called a bandwidth, though nobody really calls it that. Rather, bandwidth usually refers to the pathways that data takes. When you have one device spitting out data that needs to go somewhere else. The bandwidth is the amount (# of lanes) and speed (speed of trucks) through which the data can be passed.

Question-specific Explanation:

In the case you are referring to, what they mean by GPUs have dedicated memory which has 5–10X the bandwidth of CPU memory is not the bandwidth of the CPU or GPU themselves, but rather the bandwidth through which data passes back and forth between those devices and their associated memories. Specifically, the bus through which data passes between the CPU and the main system RAM has a lower bandwidth than the bus through which data passes between the GPU and the RAM on the video card. This is due to two factors: the width and the speed.

GPU side:

The width of the bus between the GPU and the video-RAM is often 128-bit these days because the video-RAM is integrated into the same adapter as the GPU. That both components are assembled by the same company means that they can tightly integrate the GPU and the video-RAM in a way that provides extremely high transfer between them. Also, the video-RAM tends to be specialized GDDR3 memory these days, which means that it can access (read/write) data extremely fast. Finally, the GPU is a specialized CPU that due to the nature of graphics programming can do all kinds of crazy arithmetical operations at blazingly fast speeds.

CPU side:

On the other side, the bus between the CPU and the system RAM is usually only 64-bit. There are numerous reasons for that, but compatibility tends to be the primary limiting factor. Also, remember that systems are usually built with components from various sources. One manufacturer makes the CPU and another one (or two or three) makes the RAM, and yet another makes the motherboard on which the bus lies. There is no way to know in advance what components will be present in the system (which CPU? what kind(s) of RAM? which of countless models of mobo?) so they have to comply to standards, which frequently reduce to the lowest common denominator. If one of the RAM modules is slower than the others, they all have to reduce their speed to accommodate the slow one. If the motherboard can only handle 400MHz RAM, then the 800MHz memory has to run at half speed, and so on. All these factors limit the total bandwidth between the CPU and the system RAM. The RAM itself, even if DDR3 will still likely be slower than the specialized video-RAM. Finally, the CPU is a general-purpose processors as compared to a GPU, and so it will tend to be slower overall.

Summary:

In summary, the slide is alluding to the fact that the video card’s processor and memory as a unit far out-performs the system’s processor and memory as a unit.