individual logging node or GPU performance metrics

[tomiock]

Have individual logging of the wandb perf metrics. TPS can be reported as Top-k out of N nodes/GPUs

[tomiock]

When using a pretty high gradient accumulation, the max loss is over the gradient accumulated, check if this is correct.