Skip to content

enable fused_attn and fused_linear for CLIP_vit #3875

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: release/3.0-rc1
Choose a base branch
from

Conversation

lshpku
Copy link

@lshpku lshpku commented Apr 21, 2025

在CLIP_vit_base/large模型中启用fused_attn和fused_linear算子,可以一定程度提升fp16下的性能,但需注意fp32的兼容性问题

Copy link

paddle-bot bot commented Apr 21, 2025

Thanks for your contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant