Problem about multi - GPU training

[Junjie31]

Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass
RuntimeError: Function 'L1LossBackward0' returned nan values in its 0th output.

[yingchen001]

we didn't encounter such issue, maybe can apply an eps on the l1 loss to prevent nan