Offload bootstrap #148671

ZuseZ4 · 2025-11-07T21:24:22Z

The recommended way to build the offload project changed.
While already at it, testing how much overhead we get from building (or shipping) the two runtimes.

r? @Kobzol

rustbot · 2025-11-07T21:24:25Z

This PR changes how LLVM is built. Consider updating src/bootstrap/download-ci-llvm-stamp.

ZuseZ4 · 2025-11-07T21:26:41Z

@bors2 try @rust-timer queue

(@Kobzol feel free to change if you want to see something else).

rust-timer · 2025-11-07T21:26:44Z

Awaiting bors try build completion.

@rustbot label: +S-waiting-on-perf

Offload bootstrap

rust-bors · 2025-11-07T22:26:45Z

💔 Test for 7069335 failed: CI. Failed jobs:

try - dist-x86_64-linux (web logs, extended logs)

ZuseZ4 · 2025-11-07T23:05:23Z

@bors2 try @rust-timer queue

rust-timer · 2025-11-07T23:05:26Z

Awaiting bors try build completion.

@rustbot label: +S-waiting-on-perf

Offload bootstrap

rust-bors · 2025-11-07T23:19:09Z

💔 Test for 31000c9 failed: CI. Failed jobs:

try - dist-x86_64-linux (web logs, extended logs)

ZuseZ4 · 2025-11-08T02:54:18Z

@bors2 try @rust-timer queue

rust-timer · 2025-11-08T02:54:21Z

Awaiting bors try build completion.

@rustbot label: +S-waiting-on-perf

Offload bootstrap

ZuseZ4 · 2025-11-24T20:03:06Z

Yes, we'd probably want them as a standalone build then.
It's a bit beyond what we can nicely configure in our bootstrap, so I'd probably create a copy of our ./build-clang.sh.
So the new build would be

use build-clang.sh to build a separate llvm/llvm-project with clang, lld, and all.
build rust/src/llvm-project as part of rust bootstrap.
now build the openmp and offload projects as standalone projects.
continue with the rust build

stopping the rust build sounds tricky. So thinking more about it, I probably need to handle it all within src/bootstrap/src/core/build_steps/llvm.rs, probably like Enzyme? As in, let the llvm build finish, build enzyme/the runtimes, continue with rustc_llvm and others.

jhuber6 · 2025-11-24T20:04:29Z

Any reason you can't just do this in the same stage you build clang? Presumably that's already a dependency and uses the same LLVM checkout

rust-bors · 2025-11-24T20:09:43Z

💔 Test for 7f95fab failed: CI. Failed jobs:

try - dist-x86_64-linux (web logs, extended logs)

ZuseZ4 · 2025-11-24T20:09:53Z

I don't fully understand the motivation, but it's not the same checkout. What we do is:

install gcc 9.5
clone llvm/llvm-project 21.1.0, configure it to enable clang/lld/compiler-rt/etc., build it.
clone rust-lang/rust which has a different llvm subproject in src/llvm-project. We then build this second llvm and rustc based on this 21.1.5, so I also want the offload/openmp runtimes to be build on the same llvm as rustc.

I guess we could try building both runtimes against LLVM 21.1.0 and use it with the second LLVM 21.1.5, but that sounds like a risk, especially if they diverge more in the future.

ZuseZ4 · 2025-11-24T20:12:18Z

2025-11-24T20:09:15.4372509Z -- Configuring done
2025-11-24T20:09:15.4512557Z CMake Error at /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2118 (add_dependencies):
2025-11-24T20:09:15.4513460Z   The dependency target "clang" of target "check-openmp" does not exist.
2025-11-24T20:09:15.4513964Z Call Stack (most recent call first):
2025-11-24T20:09:15.4514505Z   /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2185 (add_lit_target)
2025-11-24T20:09:15.4515270Z   /checkout/src/llvm-project/openmp/cmake/OpenMPTesting.cmake:225 (add_lit_testsuite)
2025-11-24T20:09:15.4516309Z   /checkout/src/llvm-project/openmp/cmake/OpenMPTesting.cmake:248 (add_openmp_testsuite)
2025-11-24T20:09:15.4517215Z   /checkout/src/llvm-project/openmp/CMakeLists.txt:156 (construct_check_openmp_target)
2025-11-24T20:09:15.4517665Z 
2025-11-24T20:09:15.4517674Z 
2025-11-24T20:09:15.4518075Z CMake Error at /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2118 (add_dependencies):
2025-11-24T20:09:15.4518837Z   The dependency target "clang" of target "check-libomp" does not exist.
2025-11-24T20:09:15.4519341Z Call Stack (most recent call first):
2025-11-24T20:09:15.4519892Z   /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2185 (add_lit_target)
2025-11-24T20:09:15.4520652Z   /checkout/src/llvm-project/openmp/cmake/OpenMPTesting.cmake:233 (add_lit_testsuite)
2025-11-24T20:09:15.4521464Z   /checkout/src/llvm-project/openmp/runtime/test/CMakeLists.txt:44 (add_openmp_testsuite)
2025-11-24T20:09:15.4522187Z 
2025-11-24T20:09:15.4522196Z 
2025-11-24T20:09:15.4522596Z CMake Error at /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2118 (add_dependencies):
2025-11-24T20:09:15.4523356Z   The dependency target "clang" of target "check-ompt" does not exist.
2025-11-24T20:09:15.4523845Z Call Stack (most recent call first):
2025-11-24T20:09:15.4524387Z   /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2185 (add_lit_target)
2025-11-24T20:09:15.4525148Z   /checkout/src/llvm-project/openmp/cmake/OpenMPTesting.cmake:225 (add_lit_testsuite)
2025-11-24T20:09:15.4525950Z   /checkout/src/llvm-project/openmp/runtime/test/CMakeLists.txt:46 (add_openmp_testsuite)
2025-11-24T20:09:15.4526415Z 
2025-11-24T20:09:15.4526437Z 
2025-11-24T20:09:15.4526821Z CMake Error at /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2118 (add_dependencies):
2025-11-24T20:09:15.4527591Z   The dependency target "clang" of target "check-libarcher" does not exist.
2025-11-24T20:09:15.4528101Z Call Stack (most recent call first):
2025-11-24T20:09:15.4528646Z   /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2185 (add_lit_target)
2025-11-24T20:09:15.4529408Z   /checkout/src/llvm-project/openmp/cmake/OpenMPTesting.cmake:233 (add_lit_testsuite)
2025-11-24T20:09:15.4530243Z   /checkout/src/llvm-project/openmp/tools/archer/tests/CMakeLists.txt:38 (add_openmp_testsuite)
2025-11-24T20:09:15.4530743Z 
2025-11-24T20:09:15.4530764Z 
2025-11-24T20:09:15.4531148Z CMake Error at /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2118 (add_dependencies):
2025-11-24T20:09:15.4531911Z   The dependency target "clang" of target "check-ompt-multiplex" does not
2025-11-24T20:09:15.4532389Z   exist.
2025-11-24T20:09:15.4532660Z Call Stack (most recent call first):
2025-11-24T20:09:15.4533202Z   /checkout/src/llvm-project/llvm/cmake/modules/AddLLVM.cmake:2185 (add_lit_target)
2025-11-24T20:09:15.4533963Z   /checkout/src/llvm-project/openmp/cmake/OpenMPTesting.cmake:233 (add_lit_testsuite)
2025-11-24T20:09:15.4534811Z   /checkout/src/llvm-project/openmp/tools/multiplex/tests/CMakeLists.txt:17 (add_openmp_testsuite)

So disabling the LLVM tests with "-DLLVM_BUILD_TESTS", "OFF" does not disable the openmp checks? Is that intended?

ZuseZ4 · 2025-11-24T20:37:29Z

@bors2 try @rust-timer queue

rust-timer · 2025-11-24T20:37:32Z

This pull request is already queued and waiting for a try build to finish.

Offload bootstrap

rust-bors · 2025-11-24T20:51:31Z

💔 Test for 1cf5ae5 failed: CI. Failed jobs:

try - dist-x86_64-linux (web logs, extended logs)

ZuseZ4 · 2025-11-24T21:32:40Z

@bors2 try @rust-timer queue

rust-timer · 2025-11-24T21:32:42Z

This pull request is already queued and waiting for a try build to finish.

Offload bootstrap

rust-bors · 2025-11-24T21:46:34Z

💔 Test for b623941 failed: CI. Failed jobs:

try - dist-x86_64-linux (web logs, extended logs)

ZuseZ4 · 2025-11-24T21:52:43Z

@bors2 try @rust-timer queue

rust-timer · 2025-11-24T21:52:45Z

This pull request is already queued and waiting for a try build to finish.

Offload bootstrap

rust-log-analyzer · 2025-11-24T22:07:20Z

The job dist-x86_64-linux failed! Check out the build log: (web) (plain enhanced) (plain)

Click to see the possible cause of the failure (guessed by this bot)

    Finished `dev` profile [unoptimized + debuginfo] target(s) in 31.76s
##[endgroup]
[2025-11-24T22:05:29.869Z INFO  opt_dist::timer] Section `Stage 1 (Rustc PGO)` starts
[2025-11-24T22:05:29.869Z INFO  opt_dist::timer] Section `Stage 1 (Rustc PGO) > Build PGO instrumented rustc and LLVM` starts
[2025-11-24T22:05:29.869Z INFO  opt_dist::exec] Executing `RUST_BACKTRACE=full python3 /checkout/x.py build --target x86_64-unknown-linux-gnu --host x86_64-unknown-linux-gnu --stage 2 library/std --set rust.llvm-bitcode-linker=false --set build.extended=false --set rust.codegen-backends=['llvm'] --set rust.deny-warnings=false --rust-profile-generate /tmp/tmp-multistage/opt-artifacts/rustc-pgo --set llvm.thin-lto=false --set llvm.link-shared=true [at /checkout/obj]`
##[group]Building bootstrap
    Finished `dev` profile [unoptimized] target(s) in 0.06s
##[endgroup]
[TIMING:start] compile::Assemble { target_compiler: Compiler { stage: 2, host: x86_64-unknown-linux-gnu, forced_compiler: false } }
[TIMING:start] builder::Libdir { compiler: Compiler { stage: 2, host: x86_64-unknown-linux-gnu, forced_compiler: false }, target: x86_64-unknown-linux-gnu }
---
-- Looking for os_signpost_interval_begin - not found
-- Found Python3: /usr/bin/python3.6 (found version "3.6.8") found components: Interpreter 
-- LLVM host triple: x86_64-unknown-linux-gnu
-- LLVM default target triple: x86_64-unknown-linux-gnu
-- Using LLVM include directories: /checkout/src/llvm-project/llvm/include;/checkout/obj/build/x86_64-unknown-linux-gnu/llvm/build/include
Failed to 'dlopen' libcuda.so.1
-- Performing Test OFFLOAD_HAVE_WERROR_CTOR
-- Performing Test OFFLOAD_HAVE_WERROR_CTOR - Success
-- Building the offload library with support for the "amdgpu;cuda;host" plugins
-- OMPT target disabled
-- OpenMP tools dir in libomptarget: 
-- Performing Test LLVM_LINKER_SUPPORTS_B_SYMBOLIC_FUNCTIONS
-- Performing Test LLVM_LINKER_SUPPORTS_B_SYMBOLIC_FUNCTIONS - Success
-- Building AMDGPU plugin for dlopened libhsa
-- Not generating AMDGPU tests, no supported devices detected. Use 'LIBOMPTARGET_FORCE_AMDGPU_TESTS' to override.
-- Building CUDA plugin for dlopened libcuda
-- Not generating NVIDIA tests, no supported devices detected. Use 'LIBOMPTARGET_FORCE_NVIDIA_TESTS' to override.
-- Building x86_64 plugin for dlopened libffi
-- Not generating x86_64 tests. LibFFI not found.
-- Building the llvm-offload-device-info tool
-- Building the llvm-omp-kernel-replay tool
-- Building offloading runtime library libomptarget.
CMake Warning at /checkout/src/llvm-project/offload/liboffload/API/CMakeLists.txt:39 (message):
  clang-format not found, the generated Offload API headers will not be
  formatted


-- Configuring done
-- Generating done
-- Build files have been written to: /checkout/obj/build/x86_64-unknown-linux-gnu/llvm/build/runtimes/runtimes-bins
[100%] Built target runtimes-configure
[100%] Performing build step for 'runtimes'
[  0%] Building LLVM bitcode Allocator.cpp-nvptx.o
[  2%] Building LLVM bitcode Allocator.cpp-amdgpu.o
[  2%] Building LLVM bitcode Workshare.cpp-nvptx.o
[  2%] Building LLVM bitcode Workshare.cpp-amdgpu.o
[  5%] Building LLVM bitcode Debug.cpp-nvptx.o
[  5%] Building LLVM bitcode Mapping.cpp-amdgpu.o
[  6%] Building LLVM bitcode DeviceUtils.cpp-amdgpu.o
[  6%] Building LLVM bitcode Misc.cpp-amdgpu.o
[  8%] Building LLVM bitcode Debug.cpp-amdgpu.o
[  8%] Building LLVM bitcode Configuration.cpp-amdgpu.o
[  9%] Building LLVM bitcode Kernel.cpp-nvptx.o
[ 12%] Building LLVM bitcode DeviceUtils.cpp-nvptx.o
[ 12%] Building LLVM bitcode LibC.cpp-amdgpu.o
[ 13%] Building LLVM bitcode Configuration.cpp-nvptx.o
[ 14%] Building LLVM bitcode Kernel.cpp-amdgpu.o
[ 16%] Building LLVM bitcode LibC.cpp-nvptx.o
[ 17%] Building LLVM bitcode Parallelism.cpp-amdgpu.o
[ 18%] Building LLVM bitcode Misc.cpp-nvptx.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 20%] Building LLVM bitcode Reduction.cpp-amdgpu.o
[ 21%] Building LLVM bitcode Tasking.cpp-amdgpu.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 22%] Building LLVM bitcode Profiling.cpp-amdgpu.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 22%] Building LLVM bitcode Mapping.cpp-nvptx.o
[ 22%] Building LLVM bitcode Synchronization.cpp-amdgpu.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
gmake[5]: *** [offload/DeviceRTL/Allocator.cpp-nvptx.o] Error 127
gmake[5]: *** Waiting for unfinished jobs....
gmake[5]: *** [offload/DeviceRTL/Workshare.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Debug.cpp-nvptx.o] Error 127
[ 24%] Building LLVM bitcode Parallelism.cpp-nvptx.o
[ 25%] Building LLVM bitcode Profiling.cpp-nvptx.o
[ 25%] Building LLVM bitcode Reduction.cpp-nvptx.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 26%] Building LLVM bitcode State.cpp-amdgpu.o
[ 28%] Generating /checkout/obj/build/x86_64-unknown-linux-gnu/llvm/build/compile_commands.json
[ 29%] Building LLVM bitcode State.cpp-nvptx.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 30%] Building CXX object offload/tools/offload-tblgen/CMakeFiles/offload-tblgen.dir/APIGen.cpp.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 30%] Building CXX object offload/tools/offload-tblgen/CMakeFiles/offload-tblgen.dir/DocGen.cpp.o
[ 30%] Built target intrinsics_gen
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
[ 32%] Building CXX object offload/tools/offload-tblgen/CMakeFiles/offload-tblgen.dir/MiscGen.cpp.o
[ 33%] Building CXX object offload/tools/offload-tblgen/CMakeFiles/offload-tblgen.dir/PrintGen.cpp.o
[ 34%] Building CXX object offload/tools/offload-tblgen/CMakeFiles/offload-tblgen.dir/EntryPointGen.cpp.o
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
gmake[5]: *** [offload/DeviceRTL/Allocator.cpp-amdgpu.o] Error 127
gmake[5]: *** Waiting for unfinished jobs....
gmake[5]: *** [offload/DeviceRTL/Workshare.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/DeviceUtils.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Configuration.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Debug.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/LibC.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Mapping.cpp-amdgpu.o] Error 127
[ 36%] Building CXX object offload/tools/offload-tblgen/CMakeFiles/offload-tblgen.dir/offload-tblgen.cpp.o
gmake[5]: *** [offload/DeviceRTL/Kernel.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Misc.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Parallelism.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/State.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Synchronization.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Configuration.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/DeviceUtils.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Kernel.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Profiling.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/LibC.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Mapping.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Misc.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Profiling.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Reduction.cpp-amdgpu.o] Error 127
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
/bin/sh: CLANG_TOOL-NOTFOUND: command not found
gmake[5]: *** [offload/DeviceRTL/Reduction.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/State.cpp-nvptx.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Tasking.cpp-amdgpu.o] Error 127
gmake[5]: *** [offload/DeviceRTL/Parallelism.cpp-nvptx.o] Error 127
gmake[4]: *** [offload/DeviceRTL/CMakeFiles/libomptarget-amdgpu.dir/all] Error 2
gmake[4]: *** Waiting for unfinished jobs....
gmake[4]: *** [offload/DeviceRTL/CMakeFiles/libomptarget-nvptx.dir/all] Error 2
[ 37%] Built target merge_runtime_commands
[ 37%] Linking CXX executable /checkout/obj/build/x86_64-unknown-linux-gnu/llvm/build/bin/offload-tblgen
[ 37%] Built target offload-tblgen
gmake[3]: *** [all] Error 2
gmake[2]: *** [runtimes/runtimes-stamps/runtimes-build] Error 2
---
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:834:13
  12:     0x55d6fa8d924a - std::panicking::panic_handler::{{closure}}::hddd6216c3fddee3b
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:707:13
  13:     0x55d6fa8d32a9 - std::sys::backtrace::__rust_end_short_backtrace::h5e7a56f283378525
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:174:18
  14:     0x55d6fa8b77fd - __rustc[256c90bb7e548b45]::rust_begin_unwind
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:698:5
  15:     0x55d6f9aed290 - core::panicking::panic_fmt::hf19c198748ef6a95
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/panicking.rs:80:14
  16:     0x55d6fa3d8a0b - cmake::fail::h5ffd31797e7666dd
  17:     0x55d6fa3d8692 - cmake::run::h9db521ef9ab4f16f
---
  32:     0x55d6f9aee7c6 - std::sys::backtrace::__rust_begin_short_backtrace::h27046ffc55333d92
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:158:18
  33:     0x55d6f9aee7a9 - std::rt::lang_start::{{closure}}::h987ce18149d64279
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/rt.rs:206:18
  34:     0x55d6fa8c6830 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::hdf957eac011d0136
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:287:21
  35:     0x55d6fa8c6830 - std::panicking::catch_unwind::do_call::h9ff550f7799115e1
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
  36:     0x55d6fa8c6830 - std::panicking::catch_unwind::ha7ce46787bb12905
                               at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19
---
[2025-11-24T22:07:05.447Z INFO  opt_dist::utils] Free disk space: 1.26 TiB out of total 2.18 TiB (42.05% used)
Error: Optimized build pipeline has failed

Caused by:
    Command RUST_BACKTRACE=full python3 /checkout/x.py build --target x86_64-unknown-linux-gnu --host x86_64-unknown-linux-gnu --stage 2 library/std --set rust.llvm-bitcode-linker=false --set build.extended=false --set rust.codegen-backends=['llvm'] --set rust.deny-warnings=false --rust-profile-generate /tmp/tmp-multistage/opt-artifacts/rustc-pgo --set llvm.thin-lto=false --set llvm.link-shared=true [at /checkout/obj] has failed with exit code Some(1)

Stack backtrace:
   0: <anyhow::Error>::msg::<alloc::string::String>
             at /rust/deps/anyhow-1.0.100/src/backtrace.rs:27:14
   1: <opt_dist::exec::CmdBuilder>::run
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/exec.rs:80:17
   2: <opt_dist::exec::Bootstrap>::run
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/exec.rs:199:18
   3: opt_dist::execute_pipeline::{closure#1}::{closure#0}
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/main.rs:256:21
   4: <opt_dist::timer::TimerSection>::section::<opt_dist::execute_pipeline::{closure#1}::{closure#0}, ()>
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/timer.rs:111:22
   5: opt_dist::execute_pipeline::{closure#1}
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/main.rs:245:15
   6: <opt_dist::timer::TimerSection>::section::<opt_dist::execute_pipeline::{closure#1}, opt_dist::training::RustcPGOProfile>
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/timer.rs:111:22
   7: opt_dist::execute_pipeline
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/main.rs:242:35
   8: opt_dist::main
             at /rustc/d35c1d3a34f00fd4370c06074d3d58de9c5df5ea/src/tools/opt-dist/src/main.rs:467:18
   9: <fn() -> core::result::Result<(), anyhow::Error> as core::ops::function::FnOnce<()>>::call_once
             at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:250:5
  10: std::sys::backtrace::__rust_begin_short_backtrace::<fn() -> core::result::Result<(), anyhow::Error>, core::result::Result<(), anyhow::Error>>
             at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/sys/backtrace.rs:158:18
  11: std::rt::lang_start::<core::result::Result<(), anyhow::Error>>::{closure#0}
             at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/rt.rs:206:18
  12: core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once
             at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/core/src/ops/function.rs:287:21
  13: std::panicking::catch_unwind::do_call
             at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:590:40
  14: std::panicking::catch_unwind
             at /rustc/3b4dd9bf1410f8da6329baa36ce5e37673cbbd1f/library/std/src/panicking.rs:553:19

rust-bors · 2025-11-24T22:07:30Z

💔 Test for d35c1d3 failed: CI. Failed jobs:

try - dist-x86_64-linux (web logs, extended logs)

ZuseZ4 added 2 commits November 7, 2025 16:12

update offload build steps

e668803

I surely picked the wrong runner again, right?

861cb3b

rustbot assigned Kobzol Nov 7, 2025