If you have lots of monitors - it will take a bit of time, but
you can disable the usb controller via the device manager
Haven't done it myself, but here are the steps:
Log on to a monitor (remote desktop or vnc)
right click Computer, then Properties
go to Hardware tab, then click device manager
Fiddle around with the usb controller subtree and post results