How Much Work to convert from USB to Raspberry Pi camera port?

@zcsteele just curious how much work and if you thought this would be a worthwhile effort. The one take away I had from Dan's code is that the camera port and GPU could handle 30+ frames per second.