TP SP and FSDP examples device generalization ( Cuda, XPU, etc.) #1354

soumith merged 13 commits into

pytorch:mainpytorch/examples:mainfrom

githubsgi:tp_sp_improvement_01githubsgi/examples:tp_sp_improvement_01Copy head branch name to clipboard