Fix ZeRO-3 Muon all-gather for mixed parameter shapes - #8628

Fix ZeRO-3 Muon all-gather for mixed parameter shapes#8628

jinyouzhi wants to merge 5 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

jinyouzhi:fix_gloo_muonjinyouzhi/DeepSpeed:fix_gloo_muonCopy head branch name to clipboard