update builds 12.6 and rocm 6.3

[johnnynunez]

• Pytorch supports cuda 12.6 and rocm 6.2.4, 6.3
  Better performance rocm6.3 https://community.amd.com/t5/ai/unlocking-new-horizons-in-ai-and-hpc-with-the-release-of-amd/ba-p/726434

pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu126
pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.2

Blackwell and RDNA4 support

pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu128
pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.3

[johnnynunez]

cc @tenpercent @bottler @danthe3rd

Updated from #1192

[tenpercent]

suggested a couple changes, otherwise looks good to try running CI

[johnnynunez]

It's ready for new pytorch 2.6.0 that it comes this week:
Phase 2 (after 1/13/25): perform extended integration/stability/performance testing based on Release Candidate builds

[johnnynunez]

@tenpercent M6: Release Day (1/29/25), we run the runners and merge ok?

[lw]

Thanks! I took a look and left some comments, but I think we need to discuss this to see if it will have any extra CI costs first.

[johnnynunez]

I also update to my PR's from https://github.com/Jimver/cuda-toolkit/releases/tag/v0.2.21
also if you want it, you can build for arm gh200 with ubuntu arm runners
nvidia is merging sbsa and arm64 cuda and drivers

[johnnynunez]

Pytorch 2.6 is out…. Merge?

https://pytorch.org/blog/pytorch2-6/

[johnnynunez]

cc @tenpercent @lw