Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add pir decoder_attention_fuse_pass #65341

Open
linkk08 opened this issue Jun 20, 2024 · 1 comment
Open

add pir decoder_attention_fuse_pass #65341

linkk08 opened this issue Jun 20, 2024 · 1 comment
Labels
status/new-issue 新建 type/feature-request 新需求申请

Comments

@linkk08
Copy link
Contributor

linkk08 commented Jun 20, 2024

需求描述 Feature Description

任务目标: 新增decoder_attention_fuse_pass;
需求场景: decoder模型性能优化;
功能描述: 新增 decoder attention 融合的pir pass, 该pass将q k v 的计算融合成一个大算子运算(不带mask)

替代实现 Alternatives

No response
linkk08 added a commit to linkk08/Paddle that referenced this issue Jun 20, 2024
@linkk08
[XPU][PIR] add decoder_attention_fuse_pass (PaddlePaddle#65341)
22baf2a
@warrentdrew
Copy link
Contributor

您好，感谢您的pr，CI通过后联系相关同学帮忙review下

linkk08 added a commit to linkk08/Paddle that referenced this issue Jun 25, 2024
@linkk08
[XPU][PIR] add decoder_attention_fuse_pass (PaddlePaddle#65341)
e5cc2b8
linkk08 added a commit to linkk08/Paddle that referenced this issue Jun 26, 2024
@linkk08
[XPU][PIR] add decoder_attention_fuse_pass (PaddlePaddle#65341)
db58c29
linkk08 added a commit to linkk08/Paddle that referenced this issue Jun 26, 2024
@linkk08
[XPU][PIR] add decoder_attention_fuse_pass (PaddlePaddle#65341)
729f1c4
linkk08 added a commit to linkk08/Paddle that referenced this issue Jun 26, 2024
@linkk08
[XPU][PIR] add decoder_attention_fuse_pass (PaddlePaddle#65341)
c9fff7b
linkk08 added a commit to linkk08/Paddle that referenced this issue Jun 28, 2024
@linkk08
[XPU][PIR] add decoder_attention_fuse_pass (PaddlePaddle#65341)
5ff031b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
status/new-issue 新建 type/feature-request 新需求申请
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@warrentdrew @linkk08