You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Removes unused column stride fields from attention structs
Eliminates mask_col_stride, bias_col_stride, and dbias_col_stride fields from the Mask_params, Bias_params, and Flash_bwd_params structures.
These column stride parameters were not being utilized in the attention implementation, removing unnecessary complexity and reducing memory footprint of the parameter structures.
0 commit comments