Housekeeping and PyTorch Upgrade

[prabhuomkar]

Description of the change

• Upgrade PyTorch version to 2.6.0
• Add CUDA 12.4 and 12.6 Support which comes with PT 2.6.0
• Update GA Workflows for testing with latest versions
• README Updates
• Bump up CMake to 3.28.6

Type Of Change

• Bug Fix (non-breaking change that fixes an issue)
• New Feature
• New PyTorch tutorial
• Breaking Change (cmake changes, fix or feature that would cause existing functionality to not work as expected)

Related Issues

N/A

Development & Code Review

• cpplint rules passes locally (run cmake -P cpplint.cmake)
• CI is passing
• Changes have been reviewed by at least one of the maintainers

[prabhuomkar]

@mfl28 can I get a quick review on this one? We have come a long way to PT 2.6.0 now :)

[mfl28]

Thanks @prabhuomkar looks good! Only CUDA 12.1 -> 12.4 should be changed according to the pytorch website.