Commit 7f776fa
committed
fix(pt): Enforce conditions for type embedding compression in se_atten
- Added runtime checks to ensure type embedding compression only operates in "strip" mode.
- Introduced validation for the initialization of `filter_layers_strip` to prevent runtime errors.
- Updated comments to clarify the expected dimensions of type embeddings, enhancing code readability.
These changes improve error handling and maintain the integrity of the type embedding compression logic.1 parent d70a397 commit 7f776fa
1 file changed
+11
-4
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
464 | 464 | | |
465 | 465 | | |
466 | 466 | | |
| 467 | + | |
| 468 | + | |
| 469 | + | |
| 470 | + | |
| 471 | + | |
| 472 | + | |
| 473 | + | |
467 | 474 | | |
468 | 475 | | |
469 | 476 | | |
| |||
632 | 639 | | |
633 | 640 | | |
634 | 641 | | |
635 | | - | |
| 642 | + | |
636 | 643 | | |
637 | 644 | | |
638 | | - | |
| 645 | + | |
639 | 646 | | |
640 | 647 | | |
641 | 648 | | |
642 | 649 | | |
643 | | - | |
| 650 | + | |
644 | 651 | | |
645 | 652 | | |
646 | 653 | | |
647 | 654 | | |
648 | | - | |
| 655 | + | |
649 | 656 | | |
650 | 657 | | |
651 | 658 | | |
| |||
0 commit comments