Double check that the joysticks are correct, and/or use the correct joystick regardless of port number.