Yes.

(It's a "world iPad" for both the AT&T and Verizon model.)

Whether a device functions worldwide for a specific wireless standard depends on the frequency bands that it supports.

E.g. The new iPad supports LTE, but only the frequency bands 700 MHz and 2100 MHz which are not used outside the US.

The iPhone 4S has been called a world phone, because it supports all the frequency band used for GSM worldwide:

• 850, 900, 1800, 1900 MHz

The new iPad supports the same GSM frequency bands for both the AT&T and Verizon model. Therefore it's a "world iPad".

Of course you need a SIM-tray, to make use of this. Like the iPhone, the iPad has a Micro-SIM card tray.

Yes, the two models are physically different. The radio is different.

As per Apple's website, the radio frequencies aren't the same. The verizon iPad supports Verizon LTE, and as per this post, AT&T 3G. However, the Verizon iPad does not support all LTE frequencies that the AT&T iPad does.

From Apple.com:

Wi-Fi + 4G for AT&T model: 4G LTE (700, 2100 MHz); UMTS/HSPA/HSPA+/DC-HSDPA (850, 900, 1900, 2100 MHz); GSM/EDGE (850, 900, 1800, 1900 MHz)

Wi-Fi + 4G for Verizon model: 4G LTE (700 MHz); CDMA EV-DO Rev. A (800, 1900 MHz); UMTS/HSPA/HSPA+/DC-HSDPA (850, 900, 1900, 2100 MHz); GSM/EDGE (850, 900, 1800, 1900 MHz)

Notice that there are some differences between the listed frequencies. They're nearly the same, but not quite.

Edit:

To confirm, the difference is a hardware difference, not a software imposed limitation on AT&T LTE. From the Macrumors article:

The Verizon iPad hardware supports only the 700 MHz band for LTE to match the carrier's technology, while the GSM version sold for use on AT&T's network supports both the 700 MHz and 2100 MHz bands as used by that carrier.

If you're looking to travel internationally, go with the AT&T iPad. (I got the Verizon iPad because I wanted the free hotspot feature, which AT&T does not offer for free at this time.)