test offloading optimizer state to CPU on GH200 nodes

[tomiock]

Using the very fast CPU-GPU ram in the JUPITER nodes we can try to offload the optimizer states to do it. There should be a latency penalty but not so severe as with regular x86 nodes.

Perhaps can only be done via FSDP.