It's running Lubuntu which is a lightweight version of Ubuntu. There's nothing to stop anyone installing that or another lightweight distro onto a USB stick on their own, all these guys have done is pre-install it for you so you don't have to worry about it.
It's no different conceptually than a bootable Linux CD.