Documentation
README
HyperPod NCCL Debugger
Operating policy. Run read-only diagnostics yourself. Never run a command that changes cluster, node, or workload state โ present each one as a Suggested command (run this yourself) block and wait for the customer. Destructive order: investigate โ reboot โ replace (replace destroys root + secondary volumes; not supported on Slurm controller nodes). Never discard training state on speculation.
Diagnose NCCL failures on SageMaker HyperPod (EKS and Slurm). scripts/nccl-diagnose.sh reads state via AWS APIs, kubectl, and SSM, then prints each issue as [FAIL] ... โ references/<file>.md ยง <section>. Read-only.
This is the opening of the README. Read the full README on GitHub.