[CI] Temporarily pin transformers#12677

sayakpaul merged 4 commits intomainhuggingface/diffusers:mainfrom

ci-pinhuggingface/diffusers:ci-pinCopy head branch name to clipboard