WinMLRunner.exe. Evaluating ..[FAILED]

[yahuuu]

I convert the pt model to the onnx model and verify that the onnx model has good output accuracy. But my onnx model cannot evaluateing with GPU.
I only saved the weights in the model.

error like:
Binding (device = CPU, iteration = 9, inputBinding = CPU, inputDataType = Tensor, deviceCreationLocation = WinML)...[SUCCESS]
Evaluating (device = CPU, iteration = 9, inputBinding = CPU, inputDataType = Tensor, deviceCreationLocation = WinML)...[SUCCESS]
...
etc
...
Binding (device = GPU, iteration = 1, inputBinding = CPU, inputDataType = Tensor, deviceCreationLocation = WinML)...[SUCCESS]
[FAILED]
Evaluating (device = GPU, iteration = 1, inputBinding = CPU, inputDataType = Tensor, deviceCreationLocation = WinML)...[FAILED]

command:
WinMLRunner.exe -model D:\projects\PYTHON\u2net_matting_verify\u2net_matting_verify\utils\test.onnx -iterations 9 -perf -GPU

environment:
WinMLRunner.exe v1.0.1.0 x64 executable
win10 20H2 19042.685, Intel(R) Core(TM) i7-8700 CPU, RAM 32.0 GB x64
GPU: Intel UHD Graphics 630 GPU Driver Version: 25.20.100.6473

[ryanlai2]

Hi @yahuuu, thanks for reaching out. May I ask if you can share your model with us for reproduction purposes?

[ryanlai2]

Can you also share your ONNX operator set version of the model? Are you using inbox or NuGet version of WinML? If using NuGet, which version are you using?

[yahuuu]

Hi @ryanlai2, This is the pytorch model I'm using.
This is a pre-trained model released by the MODNet community.
I referenced the official ONNX conversion code, pytorch -> onnx in Ubuntu16.04, run WinMLRunner.exe in Win10.

ubuntu version : )
pytorch==1.3.0 (gpu version)
torchvision==0.4.1
WinMLRunner.exe v1.0.1.0 && v1.2.2 x64
CUDA Version: 10.1
NVIDIA-SMI 418.39
Tesla K40m

my code : )
“”“
torch.onnx.export(modnet,
example,
export_onnx_file,
opset_version = 10,
export_params=True,
do_constant_folding = True,
input_names = ["input"],
output_names = ["output"],
dynamic_axes = {"input": {0: "batch_size"},
"output": {0: "batch_size"} })
”“”
If I use pytorch==1.7.1(cpu version), WinMLRunner won't even output the results under the CPU.

[yahuuu]

opset_version = 12,
WinMLRunner v1.2.2.zip
Waiting for your answer.