Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Paddle TensorRT No.42、45] Add (pd_op.isnanpd_op.embedding) converter #69435

Conversation

ooooo-create
Copy link
Contributor

@ooooo-create ooooo-create commented Nov 16, 2024

PR Category

Inference

PR Types

New features

Description

Copy link

paddle-bot bot commented Nov 16, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot paddle-bot bot added the contributor External developers label Nov 16, 2024
@ooooo-create ooooo-create marked this pull request as draft November 17, 2024 11:22
@ooooo-create ooooo-create marked this pull request as ready for review November 21, 2024 01:52
@ooooo-create ooooo-create changed the title pir tensorrt isnan && embedding [Paddle TensorRT No.42、45] Add (pd_op.isnanpd_op.embedding) converter Nov 21, 2024
return cast_layer.get_output(0)


@converter_registry.register("pd_op.isnan", trt_version="trt_version_ge=10.1")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

先不写10.1的converter

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

已修改

Copy link

paddle-ci-bot bot commented Dec 12, 2024

Sorry to inform you that 418f978's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.

@ooooo-create ooooo-create force-pushed the pir_tensorrt_isnan_embedding branch from 418f978 to 0e6a344 Compare December 13, 2024 08:50
lizexu123
lizexu123 previously approved these changes Dec 23, 2024
Comment on lines 1424 to 1429
if (pir::GetDefiningOpForInput(op, 1)->name() == "builtin.parameter") {
// trt.Weights don't have the shape info.
VLOG(3) << "Skip to convert into TRT while found weight is a parameter "
"in pd_op.embedding.";
return false;
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里逻辑有问题吧,为啥parameter不进trt,大部分应该都是parameter的场景

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

当时以为 parameter 进入 trt 之后都是一维的,没有形状信息,计算不了

@ooooo-create ooooo-create deleted the pir_tensorrt_isnan_embedding branch March 8, 2025 04:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributor External developers
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants