Skip to content

Commit 35ac6d8

Browse files
committed
Removes dropout functionality from flash attention interface
Eliminates dropout parameter and related logic across all attention functions and classes. Simplifies block size calculation by removing dropout-dependent branching logic. Removes random number generator state handling and validation checks for dropout probability. Streamlines the interface by focusing on core attention computation without stochastic regularization, reducing complexity in function signatures and internal logic.
1 parent cb7997b commit 35ac6d8

File tree

1 file changed

+46
-146
lines changed

1 file changed

+46
-146
lines changed

0 commit comments

Comments
 (0)