Here's the worlds first AMD GPU driven over USB3. From a Mac! Linux and Windows should work too, it's just libusb.
Available today in tinygrad master, use an ADT-UT3G to connect the GPU to your USB port. You have no idea of the level of engineering that went into this.