Testing Tracking Issue #3678
Description
This is all about our test suite and how to improve it.
Missing Tests
General
- Test Resource Conflict Validation #3132
- Test Push Constant Validation #3133
- Test Notable Special Shader Functions #3159
- Test Buffer to Buffer and Buffer to/from Image Copies with Problematic Usages #3161
- Add
copy_texture_to_texturetests #3315 - Port Extraction Tests to Tests #4239
- Add unit tests for compressed texture formats #7666
- Add robust testing of mesh shader related parsing and validation errors #8517
- Tests for Scissors #3871
- Missing test coverage for draw_indirect #4256
Features
These aren't part of WebGPU, or part of firefox's WebGPU impl currently, so should have more aggressive testing.
-
PIPELINE_STATISTICS_QUERY - Bindless
-
BindGroupLayoutEntry::countValidation Does Not Check That Shader Uses Binding Arrays #3648 - Array binding provided zero elements validation error when using PARTIALLY_BOUND_BINDING_ARRAY #3692
- Validation for shader types
- Execution tests for all kinds of bindless resources
-
- Multi-draw Indirect
- Push constants
- Address modes
- Polygon modes
- Tests for multiview support #7196
- Shader primitive index
- Early depth test
- Dual source blending
Infrastructure
- Use wasm-compatible asserts in tests #3286
- WASM Tests Unsupported on WebGPU #3677
- Consider Testing Against Mobile Devices using BrowserStack #3836
- WASM Image Tests Do Nothing #4290
- Expose Ability to Turn Important Private Capabilities Off #4582
- Run tests against noop backend? #7119
- Enable writing snapshot configuration inline #7253
- It should be easier to write tests for Naga error messages #7449
- Add checks for the validation error spans in
wgsl_errors#8153 - Naga tests should more finely specify the capabilities they require #8154
- Build architecture detection #8649
- Improve expectation management in test suite #8658
- Hard to Tell if Test is Skipped #3680
- Enable DX12 GPU Based Validation #4291
CI
Failing Tests
- Matrix of the form
matCx2not getting translated properly when in a uniform buffer #4371 - 11 tests fail on Linux/Intel(R) HD Graphics 610 #7163
-
image_32_atomicsSporadically Fails on CI #7200 -
wgpu_gpu::oom::query_set_oom_testgets killed by kernel #7817 - Intermittent crash in
copy_rangestest on dx12 in CI #8118 - RADV Failures of
wgpu_gpu::immediates::render_pass_test#8612 - Spurious Failure of
image_64_atomicson M4 #8613 - [gl] Implement Copy Texture to Buffer for Compressed Texures #8614
- Indirect validation fails to init on some GL platforms. #8616
-
wgpu_gpu::binding_array::samplers::binding_array_*fails on some lavapipe due to rounding #8617 - Acceleration Structure OOM tests sometimes fail due to lack of limits #8620
- bunnymark sometimes fails with OOM error #8621
-
primitive_idbeing enabled on unsupported device #8629 - Use LazyLock for std environments and OnceBox for no_std #8630
- Intel UHD 770 Fails d3d12 image64 atomics #8631
- Many tests don't label their requirement for indirect execution #8633
-
wgpu_gpu::device::multiple_devicesfails on devices with extra-low limits. #8634 - Vulkan on asahi fails
wgpu_gpu::multiview::draw_multiview_noncontiguous#8638 -
Computepass Encodingbenchmark fails on devices without RW R32F support #8640 -
Computepass Encodingdevice losses on Arc/RaptorLake #8644 - DX12
draw_multiviewtests fail on Arc/Windows #8645 - Early frees on CPU Implementations #3193
- AMD on DX12 Renders Nothing on
msaa-lineExample #3838 - Incorrect indices for push constants in webgl/gles backend #3910
- Dropping a failed
QuerySetwithin an error scope panics #4139 -
ComputePipeline::get_bind_group_layoutpanics if the pipeline's module is invalid #4167 -
draw_instanced_offsetfails on GL #4276 - Multithreaded Compute Segfaults in CI on GL/Linux #4285
- With Restricted Image Loads, Invalid Spirv Generated #4581
- Make
SAMPLER_CREATION_FAILUREtest case pass on Windows WARP #7805